TEN AI Agent on Apple Vision Pro

This is the finished project that forked from the HelloAgoraVision and added support for Voice AI. It uses the TEN AI framework to utilize LLM service from OpenAI and Speech service from Azure. With the TEN client plugin, a developer can build from the original project to this version in as little as 15 minutes.

Preparations

1. Set up TEN Frameworks Agent
2. Obtain credentials:

• Text to Speech Support API Key from Azure Speech Service

• API key from OpenAI

• Agora project App ID

3. Download the Unity SDK with visionPro support (AgoraRTC-Plugin-VisionOS.unitypackage)

Quick Start

1. Clone this repo and open the project from this folder.

2. Set up Unity environment for the VisionOS.

3. Import the AgoraRTC-Plugin-VisionOS.unitypackage.

4. Open the TestAgoraVP scene.

5. Fill in your App ID and server address.

6. Build and Run the project on the device.
7. Ask a question when the rotating sphere (AI Agent) shows up.

License

The MIT License (MIT).