Vector search and embeddings API

[samuelcolvin]

Currently we don't have anything, and the RAG example just uses OpenAI's plain API to generate embeddings.

It seems simple enough to add a dedicated API to models to generate embeddings, would wouldn't provide much on top of what the OpenAI SDK already offers, but would help a lot with Gemini where there's currently not interface in what we have.

I suspect that the vector search part is harder to provide an API for: anything beyond toy examples will require full control of the database being searched, and we're not (yet) building an ORM.

Am I wrong or missing something?

[davidhewitt]

Can the retriever pattern be reused for vector search?