Features

Legends (Expand to View)

Completed	In-Progress	Planned	Scoping
✅	🚧	📅	🧐

Features 🔥

• (✅) LangFuse integrations to accurate log and monitor chains.
• (✅) Use natural language to interact with integrations and tools.
• (🚧) Simple REST API interface for interfacing with the system. Used by the the HA Conversation Integration.
• (✅) Decomposes user queries to a TaskQueue with a list of ActionSteps.
• (🚧) Custom Home Assistant Conversation Integration to allow voice assistance via HA Assist.
• (✅) A chat Interface using streamlit that shows the action plan, user types, and response from the LLM.

Extras 👽

Optional feature that users can choose to install to further optimize their experience.

• (🧐) Quality Use CRITIC reflection framework to reflect on a response to a task/query using external tools via [^].
• (📅) Privacy Integrate with microsoft/presidio for customizable PII de-identification.

Integrations 📦

Status	Integration Name	Description
✅	Home Assistant	Control devices and retrieve sensor data via request
📅	Gmail	Access Gmail functionality via llama_index.tools.google.GmailToolSpec
🚧	Google Calendar	Access Google Calendar functionality via llama_index.tools.google.GoogleCalendarToolSpec
📅	Google Search	Perform Google search via llama_index.tools.google.GoogleSearchToolSpec
📅	Search recent ArXiv papers and summaries	Search and retrieve summaries of recent ArXiv papers via llama_index.tools.arxiv.ArxivToolSpec
📅	Yahoo Finance	Access stock, news, and financial data of a company from Yahoo Finance via llama_index.tools.yahoo_finance.YahooFinanceToolSpec
📅	Yelp	Search for businesses and fetch reviews from Yelp via llama_index.tools.yelp.YelpToolSpec
🧐	Android Debugging Shell	Use Home Assistant ADB Integrations to perform actions on Android TV Variants via integrations.HomeAssistant.