Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add NeonVoiceClient class for minimal remote audio client #23

Merged
merged 2 commits into from
Nov 3, 2023
Merged

Add NeonVoiceClient class for minimal remote audio client #23

merged 2 commits into from
Nov 3, 2023

Conversation

NeonDaniel
Copy link
Member

@NeonDaniel NeonDaniel commented Sep 7, 2023 •
edited
Loading

Description

Adds a minimal voice client with audio input/response handling

Issues

Needs NeonGeckoCom/neon-messagebus-mq-connector#46

Other Notes

Testing with config (~/.config/neon/diana.yaml)

MQ:
  server: 2021.us
  port: 25672
  users: 
    mq_handler:
      user: neon_api_utils
      password: Klatchat2021
VAD:
  module: ovos-vad-plugin-silero
microphone:
#  module: ovos-microphone-plugin-arecord
  module: ovos-microphone-plugin-alsa
listener:
  save_utterances: true
hotwords:
  hey_mycroft:
    active: false
    module: ovos-ww-plugin-precise
    listen: true
    sound: snd/start_listening.wav
    version: "0.3"
    model: "https://github.com/MycroftAI/precise-data/raw/models-dev/hey-mycroft.tar.gz"
  hey_neon:
    active: true
    module: ovos-ww-plugin-vosk
    listen: true
    sound: snd/start_listening.wav
    debug: false
    rule: fuzzy
    lang: en
    samples:
      - hey neon

@NeonDaniel
Add NeonVoiceClient class for minimal remote audio client
bb5f40a
@NeonDaniel
Add CLI entrypoint for listener
3bef712 
Add WW confirmation sound
Update logging and bugfixes around MQ event handling
@NeonDaniel NeonDaniel marked this pull request as ready for review November 2, 2023 23:41
@NeonDaniel NeonDaniel merged commit 326f5fe into dev Nov 3, 2023
7 checks passed
@NeonDaniel NeonDaniel deleted the FEAT_VoiceClient branch November 3, 2023 01:45
@github-actions github-actions bot mentioned this pull request Dec 13, 2023
Merged
NeonDaniel added a commit that referenced this pull request Dec 20, 2023
@NeonDaniel
0.1.0 (#49)
146481a 
# Changelog

## [0.0.5a21](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a21)
(2023-12-13)

[Full
Changelog](0.0.5a20...0.0.5a21)

**Merged pull requests:**

- Update Documentation and Logging
[\#48](#48)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a20](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a20)
(2023-12-13)

[Full
Changelog](0.0.5a19...0.0.5a20)

**Merged pull requests:**

- Improved config handling
[\#46](#46)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a19](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a19)
(2023-12-11)

[Full
Changelog](0.0.5a18...0.0.5a19)

**Merged pull requests:**

- Update release automation
[\#47](#47)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a18](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a18)
(2023-12-11)

[Full
Changelog](0.0.4...0.0.5a18)

**Implemented enhancements:**

- \[FEAT\] Gradio User Settings Intents
[\#35](#35)
- \[FEAT\] After submitting recorded input audio the UI element should
reset [\#30](#30)
- \[FEAT\] Speech input should print STT results to the chat UI in
addition to response
[\#29](#29)

**Fixed bugs:**

- \[BUG\] Input audio resampling is not efficiently implemented
[\#28](#28)
- \[BUG\] Implement per-user settings in web UI
[\#27](#27)

**Merged pull requests:**

- Add GitHub pre-release automation
[\#45](#45)
([NeonDaniel](https://github.com/NeonDaniel))
- Update neon-mq-connector dependency to stable spec
[\#43](#43)
([NeonDaniel](https://github.com/NeonDaniel))
- Minor fixes to audio input handling
[\#42](#42)
([NeonDaniel](https://github.com/NeonDaniel))
- Refactor audio responses to utilize Chatbot UI
[\#40](#40)
([NeonDaniel](https://github.com/NeonDaniel))
- Get Language Support from Core
[\#37](#37)
([NeonDaniel](https://github.com/NeonDaniel))
- Handle profile updates
[\#36](#36)
([NeonDaniel](https://github.com/NeonDaniel))
- Handle STT Transcripts in Chat UI
[\#34](#34)
([NeonDaniel](https://github.com/NeonDaniel))
- Remove audio resampling and add timing context support
[\#33](#33)
([NeonDaniel](https://github.com/NeonDaniel))
- Fix web\_client language handling to respect configured input language
[\#32](#32)
([NeonDaniel](https://github.com/NeonDaniel))
- Threaded input handling and multi-session support
[\#31](#31)
([NeonDaniel](https://github.com/NeonDaniel))
- Add Gradio web UI with Docker Container
[\#24](#24)
([NeonDaniel](https://github.com/NeonDaniel))
- Add NeonVoiceClient class for minimal remote audio client
[\#23](#23)
([NeonDaniel](https://github.com/NeonDaniel))
- Resolve client compat. bug
[\#22](#22)
([NeonDaniel](https://github.com/NeonDaniel))
- Add CLI endpoints to interact with API and LLM endpoints
[\#21](#21)
([NeonDaniel](https://github.com/NeonDaniel))
- Specify `setup.py` path explicitly
[\#20](#20)
([NeonDaniel](https://github.com/NeonDaniel))
- Update build automation to default branch
[\#19](#19)
([NeonDaniel](https://github.com/NeonDaniel))
- Update to use shared version\_bump.py script
[\#18](#18)
([NeonDaniel](https://github.com/NeonDaniel))
- Remove invalid release Docker action
[\#17](#17)
([NeonDaniel](https://github.com/NeonDaniel))
- Update automation to shared repository
[\#15](#15)
([NeonDaniel](https://github.com/NeonDaniel))
- Add methods with CLI entrypoints to get STT/TTS
[\#12](#12)
([NeonDaniel](https://github.com/NeonDaniel))



\* *This Changelog was automatically generated by
[github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@NeonDaniel