Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

option to spatially seperate speakers in voice calls #27

Open
EmeraldSnorlax opened this issue Dec 30, 2023 · 1 comment
Open

option to spatially seperate speakers in voice calls #27

EmeraldSnorlax opened this issue Dec 30, 2023 · 1 comment

Comments

@EmeraldSnorlax
Copy link
Member

no need for this to be a protocol level thing, just on the client is fine, but having speakers in a voice call come from different directions may help with overstimulation / recognising speakers

@EmeraldSnorlax
Copy link
Member Author

EmeraldSnorlax commented Dec 31, 2023

few prelim readings to inform future tests:

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8831717/pdf/fnins-15-730744.pdf
(seems to help most with low quality audio, or when multiple people are speaking over each other, and may actually require more cognitive load in ideal [good quality, one speaker at a time] conditions?)

https://dl.acm.org/doi/10.1145/365024.365092
(audiences subjectively prefer spatial audio and are indifferent to visualisations; does this carry over to active participation in voice calls?)

https://www.researchgate.net/publication/228746589_Listening_to_unfamiliar_voices_in_spatial_audio_Does_visualization_of_spatial_position_enhance_voice_identification
(providing a visualization of the position in addition to spatial audio seems to provide most benefit in large calls, and with unfamiliar voices)

https://www.researchgate.net/publication/370156987_Spatialized_Audio_and_Hybrid_Video_Conferencing_Where_Should_Voices_be_Positioned_for_People_in_the_Room_and_Remote_Headset_Users
(waiting for the authors to send me a copy)

purely anecdotally, speaking to multiple neurodivergent people that experience overstimulation mention that spatial audio helps to reduce the effects of it (they drew a comparison between vrchat and discord voice calls)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants