Embeddings quality and alternatives to OpenAI

[filopedraz]

Description

Currently, OpenAI embeddings are not the state of the art. We should write a blog post about it and see if developers can actually use open-source solutions as a real alternative to OpenAI.

• https://huggingface.co/spaces/mteb/leaderboard

NOTE: I noticed the context dimension of the different models while going through the leaderboard. Only the OpenAI model reaches ~8K tokens.