Exporting an OpenAI compatible API for an agent

[matbee-eth]

What feature would you like to be added?

I would love to have a /v1/chat endpoint that communicates with my Autogen agents. Is there any simple platforms that support this with autogen agents?

Why is this needed?

So I can interface with it with external openai api compatible clients

[ekzhu]

You can read about the API doc: https://microsoft.github.io/autogen/dev/reference/python/autogen_ext/autogen_ext.models.html#autogen_ext.models.OpenAIChatCompletionClient

[matbee-eth]

No I want to SERVE the agent over an OpenAI API compatible endpoint

[ekzhu]

No I want to SERVE the agent over an OpenAI API compatible endpoint

No, we don't have it in the current Python API. If you are interested, you can start a community package. See: https://microsoft.github.io/autogen/dev/user-guide/extensions-user-guide/index.html.

It is even more interesting to support (partially) an Assistant API.