Picture yourself in a busy lab, wearing thick gloves, safety goggles, and a snug lab coat. You can’t tap on a screen or use a keyboard - the gloves are too thick.
Yet you need to jot down a brilliant idea to explore later, or quickly cross check the results of another experiment.
That’s where our Agentic Voice Assistant steps in.
It connects you and all your lab’s systems, from records and notes to instructions and data. Just talk, and it retrieves what you need, makes a note, updates a system or sends a reminder.
It works alongside you on your research, keeping you efficient and safe.
- Deploy the demo
- Get UI Container App URL from the output of
azd up - Click on recording button or press 'P'
- Speak
- What are the personal protection instructions?
- How do I keep records in the lab?
- Give me the list of experiments.
- Update the status of experiment 3 by James Brown to Success. You can validate the record has been updated in CosmosDB experiments container - see
- Summarise the record keeping instructions and send them via email to "<your email>"
- Azure CLI:
az - Azure Developer CLI:
azd - Python:
python - UV:
uv - Optionally Docker:
docker
git clone https://github.com/Azure-Samples/agentic-voice-assistant.git
cd agentic-voice-assistant
azd upNote
Once deployed, you need to authorise the solution to use your M365 email account for the outbound email capability. Authorise mail access
Note
AZD will also setup the local Python environment for you, using venv and installing the required packages.
Once the environment has been deployed with azd up you can also run the aplication locally.
Please follow the instructions in the instructions in src/chainlit
Because the assistant has a modular architecture and powered by Azure Logic Apps, expanding its features is simple. You can add new steps and integrations without tearing everything apart.
This project welcomes contributions and suggestions. Please see CONTRIBUTING.md for details.
This project is licensed under the MIT License. See LICENSE.md for details.