Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

leaderboard 2.0: custom urls #1518

Open
Muennighoff opened this issue Nov 27, 2024 · 2 comments
Open

leaderboard 2.0: custom urls #1518

Muennighoff opened this issue Nov 27, 2024 · 2 comments
Labels
leaderboard issues related to the leaderboard

Comments

@Muennighoff
Copy link
Contributor

would be great to have custom urls for each benchmark selection for the new leaderboard like we have for the current one e.g. https://huggingface.co/spaces/mteb/leaderboard?task=retrieval&language=bright

@x-tabdeveloping
Copy link
Collaborator

I looked into this, and unfortunately, it's a one way street. You can't modify the URL query parameters while people are browsing the leaderboard, which is a limitation of Gradio, I can't remember if I filed an issue on this but if not, we probably should.
On the other hand, we can totally parse query parameters.
I'm wondering if it would make sense to add a "Share" button or like a text field people can copy a link from, which leads to the current leaderboard they're looking at.

@KennethEnevoldsen
Copy link
Contributor

It sounds like it would be doable just to have an entry point link for e.g. "the English MTEB", but which is not updated with selection.

@isaac-chung isaac-chung added the leaderboard issues related to the leaderboard label Nov 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
leaderboard issues related to the leaderboard
Projects
None yet
Development

No branches or pull requests

4 participants