Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove audio resampling and add timing context support #33

Merged
merged 4 commits into from
Nov 21, 2023

Conversation

NeonDaniel
Copy link
Member

@NeonDaniel NeonDaniel commented Nov 9, 2023

Description

Sends wav recordings directly to neon-speech without processing
Validated against updated deployment at mq.neonaialpha.com (port 25672)
Adds client_sent timing context and support for client-side context
Adds debug logging of timing for troubleshooting responses

Issues

Closes #28

Other Notes

NeonGeckoCom/neon_speech#180

@NeonDaniel NeonDaniel requested a review from mikejgray November 9, 2023 02:09
@NeonDaniel NeonDaniel changed the title Remove audio resampling moved to neon-speech Remove audio resampling and add timing context support Nov 14, 2023
@NeonDaniel NeonDaniel force-pushed the FEAT_ImproveAudioHandling branch from ebe555f to 0a1fdf9 Compare November 15, 2023 00:18
@NeonDaniel NeonDaniel merged commit f14f71c into dev Nov 21, 2023
14 checks passed
@NeonDaniel NeonDaniel deleted the FEAT_ImproveAudioHandling branch November 21, 2023 03:14
@github-actions github-actions bot mentioned this pull request Dec 13, 2023
NeonDaniel added a commit that referenced this pull request Dec 20, 2023
# Changelog

## [0.0.5a21](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a21)
(2023-12-13)

[Full
Changelog](0.0.5a20...0.0.5a21)

**Merged pull requests:**

- Update Documentation and Logging
[\#48](#48)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a20](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a20)
(2023-12-13)

[Full
Changelog](0.0.5a19...0.0.5a20)

**Merged pull requests:**

- Improved config handling
[\#46](#46)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a19](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a19)
(2023-12-11)

[Full
Changelog](0.0.5a18...0.0.5a19)

**Merged pull requests:**

- Update release automation
[\#47](#47)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a18](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a18)
(2023-12-11)

[Full
Changelog](0.0.4...0.0.5a18)

**Implemented enhancements:**

- \[FEAT\] Gradio User Settings Intents
[\#35](#35)
- \[FEAT\] After submitting recorded input audio the UI element should
reset [\#30](#30)
- \[FEAT\] Speech input should print STT results to the chat UI in
addition to response
[\#29](#29)

**Fixed bugs:**

- \[BUG\] Input audio resampling is not efficiently implemented
[\#28](#28)
- \[BUG\] Implement per-user settings in web UI
[\#27](#27)

**Merged pull requests:**

- Add GitHub pre-release automation
[\#45](#45)
([NeonDaniel](https://github.com/NeonDaniel))
- Update neon-mq-connector dependency to stable spec
[\#43](#43)
([NeonDaniel](https://github.com/NeonDaniel))
- Minor fixes to audio input handling
[\#42](#42)
([NeonDaniel](https://github.com/NeonDaniel))
- Refactor audio responses to utilize Chatbot UI
[\#40](#40)
([NeonDaniel](https://github.com/NeonDaniel))
- Get Language Support from Core
[\#37](#37)
([NeonDaniel](https://github.com/NeonDaniel))
- Handle profile updates
[\#36](#36)
([NeonDaniel](https://github.com/NeonDaniel))
- Handle STT Transcripts in Chat UI
[\#34](#34)
([NeonDaniel](https://github.com/NeonDaniel))
- Remove audio resampling and add timing context support
[\#33](#33)
([NeonDaniel](https://github.com/NeonDaniel))
- Fix web\_client language handling to respect configured input language
[\#32](#32)
([NeonDaniel](https://github.com/NeonDaniel))
- Threaded input handling and multi-session support
[\#31](#31)
([NeonDaniel](https://github.com/NeonDaniel))
- Add Gradio web UI with Docker Container
[\#24](#24)
([NeonDaniel](https://github.com/NeonDaniel))
- Add NeonVoiceClient class for minimal remote audio client
[\#23](#23)
([NeonDaniel](https://github.com/NeonDaniel))
- Resolve client compat. bug
[\#22](#22)
([NeonDaniel](https://github.com/NeonDaniel))
- Add CLI endpoints to interact with API and LLM endpoints
[\#21](#21)
([NeonDaniel](https://github.com/NeonDaniel))
- Specify `setup.py` path explicitly
[\#20](#20)
([NeonDaniel](https://github.com/NeonDaniel))
- Update build automation to default branch
[\#19](#19)
([NeonDaniel](https://github.com/NeonDaniel))
- Update to use shared version\_bump.py script
[\#18](#18)
([NeonDaniel](https://github.com/NeonDaniel))
- Remove invalid release Docker action
[\#17](#17)
([NeonDaniel](https://github.com/NeonDaniel))
- Update automation to shared repository
[\#15](#15)
([NeonDaniel](https://github.com/NeonDaniel))
- Add methods with CLI entrypoints to get STT/TTS
[\#12](#12)
([NeonDaniel](https://github.com/NeonDaniel))



\* *This Changelog was automatically generated by
[github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Input audio resampling is not efficiently implemented
1 participant