Azure OpenAI showing 404

[Uralstech]

Bug Report

Overview

When I'm using the threads API through Azure OpenAI, it shows a 404 error. I've been using this plugin for my Unity projects through the normal OpenAI API without any problems. I've created a model deployment in Azure OpenAI and went through the setup process for authenticating the plugin for Azure.

This is the error I am getting:

RestException: <b>[DELETE:404]</b> <color="cyan">https://xxxxx.openai.azure.com/openai/deployments/xxxxx/threads/xxxxx?api-version=2024-05-01-preview</color> <color="red">Failed!</color>

I believe the issue here is the deployments/xxxxx/ part, as when I look at the code sample in the Azure OpenAI Studio, it shows a URL like so:

https://${endpoint}/openai/threads?api-version=2024-05-01-preview

I tried using the CURL sample from Azure OpenAI to create and delete threads, and it worked.

Temporary Solution

In OpenAIAuthSettingsInfo.cs, line 97, I changed:

BaseRequest = $"/openai/deployments/{DeploymentId}/";

to

BaseRequest = $"/openai/";

and it is working perfectly.

[StephenHodgson]

@Uralstech Did Azure change their url for deployments?

[StephenHodgson]

Hmm doing some reading up on this. It seems they did change their endpoints for this preview version. I'll update it to support this soon.

[StephenHodgson]

yeah so GA it is fine, but you're using preview API.

• https://learn.microsoft.com/en-us/azure/ai-services/openai/reference
• https://learn.microsoft.com/en-us/azure/ai-services/openai/reference-preview

[StephenHodgson]

I'll open a chore ticket in the main repo to update this

[StephenHodgson]

Opened a new ticket for tracking RageAgainstThePixel/OpenAI-DotNet#342

[Uralstech]

I see. The Assistants API on Azure is in preview, and I didn't check the Completions endpoint, so I didn't know there was a difference in the link 😅

[StephenHodgson]

you could also workaround this by specifying custom domain:

https://YOUR_RESOURCE_NAME.openai.azure.com/openai/threads/{thread_id}/runs?api-version=2024-05-01-preview

[Uralstech]

Can I do this through the ScriptableObject? Or do I have to do this through code?

[StephenHodgson]

yes, that is correct. in OpenAIConfiguration or in the code. Up to you.

[Uralstech]

Thanks! The custom domain is the "Proxy Domain" field right? When I enable "Use Azure OpenAI", the field disappears, and I can't set it.

[StephenHodgson]

Ah my bad. Well in the meantime keep what you have and I'll have it fixed as soon as possible.

[Uralstech]

I should also add that Vision is not supported in assistant messages on Azure, although this is not related to the issue.