Azure Support

[cole-gillespie]

Is your feature request related to a problem? Please describe.
our current implementation lacks support for azure's suite of models, which limits our ability to fully utilize their ecosystem. this creates challenges when integrating with organizations heavily invested in azure for their infrastructure and services. without support for azure models, we're unable to offer flexibility to teams looking to standardize their ai deployments within azure environments.

Describe the solution you'd like
add support for all azure models across our platform. this includes providing seamless integration for model hosting, training, and inferencing via azure's api and tools. users should be able to deploy and manage models using azure's ecosystem with the same ease and functionality offered for other supported providers.

Describe alternatives you've considered
relying on third-party middleware or custom solutions to bridge the gap between our platform and azure's services. however, these are often cumbersome and introduce maintenance overhead.
continuing to use existing supported providers exclusively, but this limits our ability to work with azure-focused organizations and may push potential users away.
developing an entirely separate module for azure models, though this could lead to fragmentation in our feature set.

Additional context
azure is one of the leading cloud platforms, with a growing presence in the ai and ml space. support for azure models would unlock access to their advanced tools like azure machine learning, cognitive services, and integration with microsoft products. this would make our platform more appealing to enterprise customers already using azure for their cloud infrastructure. this could start out as just support for openai in azure but you can imagine how powerful the azure apis could be for using all of the supported models

[github-actions]

Hello @cole-gillespie! Welcome to the ai16z community. Thank you for opening your first issue; we appreciate your contribution. You are now a ai16z contributor!

[Idmon]

You can use the "openai" model provider since it has an identical API structure

Just fill out the .env file like this

OPENAI_API_KEY=your_azure_key_here
OPENAI_API_URL=https://Mistral-Large-2411-model.northcentralus.models.ai.azure.com/v1/
LARGE_OPENAI_MODEL=Mistral-Large-2411

[cole-gillespie]

that did not work for me @Idmon particularly what this ticket is for is adding first class support for azure open ai models

[vandercrypt]

Anyone managed to successfully use Azure OpenAI? I'm trying to do it but I keep getting errors depending on the endpoint URL.