Skip to content

embeddings-benchmark/arena

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

57 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

title emoji colorFrom colorTo sdk sdk_version app_file pinned tags
MTEB Arena
⚔️
indigo
blue
gradio
4.21.0
app.py
false
arena
leaderboard

MTEB Arena

Setup

  1. Install PyTorch according to your system
  2. pip install -r requirements.txt
  3. wget https://huggingface.co/datasets/BeIR/nq/resolve/main/corpus.jsonl.gz
  4. gunzip corpus.jsonl.gz
  5. Maybe allow creating index here

Run

python app.py

Results

Results are auto-saved to mteb/arena-results.

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •