✅ - Supported
❌ - Not supported
Empty field means the feature is unsupported by the provider.
OpenAI | Anthropic | Cohere | DeepSeek | Groq | Mistral | xAI | Custom* | ||
---|---|---|---|---|---|---|---|---|---|
Audio | ✅ | ||||||||
Chat | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | ❌ | ✅ |
Embeddings | ✅ | ❌ | ❌ | ❌ | ❌ | ||||
Fine-Tuning | ✅ | ❌ | ❌ | ||||||
Batch | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | |||
Files | ✅ | ✅ | ❌ | ||||||
Uploads | ❌ | ||||||||
Images | ✅ | ❌ | |||||||
Models | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ |
Moderation | ✅ | ||||||||
Tokenize | ❌ | ❌ |
*Custom means any OpenAI compatible provider, such as Azure OpenAI, Ollama, KoboldCpp, etc.
Assistants | Threads | Messages | Runs | Run steps | Vector stores | Vector store files | Vector store file batches | Realtime |
---|---|---|---|---|---|---|---|---|
✅ | ✅️ | ✅️ | ✅️ | ✅️ | ✅ | ✅ | ✅ | ❌ |
Caching* | Semantic Retrieval |
---|---|
✅ | ❌ |
*Other providers expose caching as part of /chat
, or don't offer the feature.
Rerank | Embed Jobs* | Classify* | Datasets* | Connectors* |
---|---|---|---|---|
❌ | ❌ | ❌ | ❌ | ❌ |
*/v1
APIs, future support is unsure and probably won't be implemented.
FIM | Agents | Classifiers |
---|---|---|
❌ | ❌ | ❌ |
Some providers offer /admin
APIs, LlmTornado won't ship support for these, as there is little to no overlap among them. We recommend using autogenerated APIs for the consumption of these services.