Skip to content

Issues: embeddings-benchmark/mteb

Merge v2.0.0: Overview issue
#1791 opened Jan 13, 2025 by KennethEnevoldsen
Open 2
Overview: Leaderboard release
#1867 opened Jan 24, 2025 by x-tabdeveloping
Open 26
MAEB Overview Issue
#2072 opened Feb 16, 2025 by isaac-chung
Open 5
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

182 Open 606 Closed
182 Open 606 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

voyage zero-shot checkmark
#2099 opened Feb 18, 2025 by Muennighoff
1
Models missing after leaderboard code refresh more information needed More information is needed before this issue can be resolved
#2096 opened Feb 18, 2025 by sfc-gh-lmerrick
1
Add tasks relations enhancement New feature or request
#2094 opened Feb 18, 2025 by Samoed
2
Create audio clustering AbsTask and Evaluator maeb Audio extension
#2093 opened Feb 18, 2025 by isaac-chung
4
Integrate mmE5 good first issue Good for newcomers mieb The image extension of MTEB new model Questions related to adding a new model to the benchmark
#2079 opened Feb 16, 2025 by Samoed
1
[v2] Merge MIEB and MTEB tasks v2 Issues and PRs related to `v2` branch
#2078 opened Feb 16, 2025 by Samoed v2.0.0
6
MAEB Overview Issue maeb Audio extension
#2072 opened Feb 16, 2025 by isaac-chung
19 tasks
5
Define an encoder interface for audio maeb Audio extension
#2071 opened Feb 16, 2025 by isaac-chung
1
Create multilabel audio classification AbsTask and Evaluator maeb Audio extension
#2070 opened Feb 16, 2025 by isaac-chung
1
Create zeroshot audio classification AbsTask and Evaluator maeb Audio extension
#2069 opened Feb 16, 2025 by isaac-chung
Create audio-text retrieval AbsTask and Evaluator maeb Audio extension
#2068 opened Feb 16, 2025 by isaac-chung
Add MAEB contribution guide/README maeb Audio extension
#2067 opened Feb 16, 2025 by isaac-chung
Create audio classification AbsTask and Evaluator maeb Audio extension
#2066 opened Feb 16, 2025 by isaac-chung
1
column_width interferes with pinned_columns in gradio leaderboard issues related to the leaderboard
#2060 opened Feb 13, 2025 by shikhar1729
Add FSD50K maeb Audio extension new dataset Issues related to adding a new task or dataset
#2056 opened Feb 13, 2025 by Muennighoff
3
Add Audio Caption maeb Audio extension new dataset Issues related to adding a new task or dataset
#2055 opened Feb 13, 2025 by Muennighoff
Add AudioCaps maeb Audio extension new dataset Issues related to adding a new task or dataset
#2054 opened Feb 13, 2025 by Muennighoff
3
Add Clotho maeb Audio extension new dataset Issues related to adding a new task or dataset
#2053 opened Feb 13, 2025 by Muennighoff
Add ESC50 maeb Audio extension new dataset Issues related to adding a new task or dataset
#2052 opened Feb 13, 2025 by Muennighoff
VGGSound maeb Audio extension new dataset Issues related to adding a new task or dataset
#2051 opened Feb 13, 2025 by Muennighoff
Add CommonVoice maeb Audio extension new dataset Issues related to adding a new task or dataset
#2050 opened Feb 13, 2025 by Muennighoff
1
Add AudioSet maeb Audio extension new dataset Issues related to adding a new task or dataset
#2049 opened Feb 13, 2025 by Muennighoff
Add MARBLE maeb Audio extension new dataset Issues related to adding a new task or dataset
#2048 opened Feb 13, 2025 by Muennighoff
1
Add SoundDescs maeb Audio extension new dataset Issues related to adding a new task or dataset
#2047 opened Feb 13, 2025 by Muennighoff
2
Allow benchmark to select custom metrics enhancement New feature or request
#2046 opened Feb 13, 2025 by KennethEnevoldsen
ProTip! Adding no:label will show everything without a label.