Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix OpenAI realtime mode doesn't work with Simli #915

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Antonyesk601
Copy link
Contributor

Please describe the changes in your PR. If it is addressing an issue, please reference that as well.

OpenAI realtime depended on getting a BotStoppedSpeaking upstream frame which never got sent because Simli-Client was creating TTSAudioRawFrame objects even when the avatar is silent,
You can reproduce the bug which this fix solved by adding a SimliVideoService component to OpenAI foundational example
Sample SimliVideoService

simli = SimliVideoService(
            SimliConfig(
                apiKey=os.getenv("SIMLI_API_KEY"),  # API Key
                faceId=os.getenv("SIMLI_FACE_ID"),  # Face ID
                syncAudio=True,
                handleSilence=True,
                maxSessionLength=900,
                maxIdleTime=30,
            ),
            latency_interval=0,
            use_turn_server=False,
        )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant