Skip to content

Pull requests: huggingface/lighteval

New pull request New
12 Open 243 Closed
12 Open 243 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix splitting for generative tasks
#400 opened Nov 20, 2024 by NathanHB Loading…
Add swiss legal evals as new community tasks
#389 opened Nov 11, 2024 by JoelNiklaus Loading…
33
Fixes an error with getting the golds from the formatted_docs.
#388 opened Nov 11, 2024 by JoelNiklaus Loading…
6
Add litellm inference
#385 opened Nov 11, 2024 by JoelNiklaus Loading…
6
Add new Arabic benchmarks (5) and enhance existing tasks
#372 opened Oct 23, 2024 by alielfilali01 Loading…
24
A more general solution to model answer extraction instead of output_regex
#358 opened Oct 11, 2024 by sadra-barikbin Loading…
1
3
Allow AdapterModels to have custom tokens
#306 opened Sep 14, 2024 by mapmeld Loading…
2
Adding chat completion task to endpoint models
#281 opened Aug 27, 2024 by sadra-barikbin Loading…
9
Added option for specifying model config directly, for programmatic use
#245 opened Jul 29, 2024 by shaltielshmid Loading…
5
Tiny improvements to endpoint_model.py, base_model.py,...
#219 opened Jul 8, 2024 by sadra-barikbin Loading…
3
Nanotron tests
#160 opened Apr 19, 2024 by zzhhjjj • Draft
5
Add optimum model
#106 opened Mar 11, 2024 by echarlaix • Draft
ProTip! Add no:assignee to see everything that’s not assigned.