Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure GPT support #40

Open
gofort opened this issue Jan 19, 2024 · 3 comments
Open

Azure GPT support #40

gofort opened this issue Jan 19, 2024 · 3 comments

Comments

@gofort
Copy link

gofort commented Jan 19, 2024

It would be nice to support Azure GPT private instances which don't leak code inputs.
There is an action from Microsoft, but we have tested it and comments are useless really. It pushes only 1 comment and that's it.

@villesau
Copy link
Contributor

Is the API structure similar? If so, feel free to open a PR that adds a prop that allows overriding the base url 👌

@gofort
Copy link
Author

gofort commented Jan 20, 2024

Not sure. As I don't know JS it takes some time to understand :)
It also seems that their SDK is in beta right now https://learn.microsoft.com/en-us/javascript/api/overview/azure/openai-readme?view=azure-node-preview#examples

@mathiash98
Copy link

Implementing this should be quite easy, I might make a PR for this when I test out the project.
Pretty much to just add support for https://www.npmjs.com/package/@azure/openai

I know there are some NPM projects where they aim to support a range of LLM backend models like mistral, Llama, OpenAi, Azure OpenAi in the same package by just defining what to use and define required env variables.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants