Skip to content

Pull requests: huggingface/lighteval

New pull request New
37 Open 451 Closed
37 Open 451 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add TUMLU-mini benchmark, solves #577
#811 opened Jun 12, 2025 by ceferisbarov Loading…
Fix Typos in Documentation and Task Description
#810 opened Jun 11, 2025 by leopardracer Loading…
fix: add offline dataset support via LOCAL_DATASET_PATH
#807 opened Jun 10, 2025 by xjli360 Loading…
fix context size check in sglang model
#787 opened May 29, 2025 by xgwang Loading…
3
fix(openai): improve tokenizer fallback and remove env_config param
#786 opened May 27, 2025 by ryantzr1 Loading…
1
fix: update python api user docs
#784 opened May 27, 2025 by ryantzr1 Loading…
1
1
Add org_to_bill parameter to documentation
#781 opened May 26, 2025 by tfrere Loading…
1
Complete TranslationLiterals for Language.ESTONIAN
#779 opened May 23, 2025 by spyysalo Loading…
1
Update translation_literals.py with icelandic
#775 opened May 22, 2025 by joenaess Loading…
3
Add support for vLLM KV-cache quantization
#773 opened May 22, 2025 by eldarkurtic Loading…
1
Add TranslationLiterals for Language.DANISH
#770 opened May 22, 2025 by spyysalo Loading…
1
Add Romanian literals feature/enhancement New feature/request
#764 opened May 21, 2025 by dianaonutu Loading…
4
Newer openai and loosened httpx
#758 opened May 21, 2025 by jamesbraza Loading…
1
4
Add Chinese (zh) Translation of Documentation documentation Improvements or additions to documentation
#744 opened May 19, 2025 by CassiopeiaCode Loading…
13
Adds RULER benchmark new-task
#722 opened May 15, 2025 by NathanHB Loading…
1
12
update for CB
#714 opened May 9, 2025 by ArthurZucker Loading…
1
4
refacto prompt building
#709 opened May 7, 2025 by NathanHB Loading…
1
[WIP] Fix nanotron compatibility
#706 opened May 6, 2025 by duynht Loading…
3
Add way to load local datafile feature/enhancement New feature/request
#687 opened Apr 24, 2025 by ScottHoang Loading…
1
2
Nanotron model updates feature/enhancement New feature/request
#652 opened Mar 31, 2025 by anton-l Loading…
1
Add CLI arg generate_until_token to support reasoning and CoT models
#617 opened Mar 17, 2025 by mapmeld Loading…
1
2
added vllm lora support. feature/enhancement New feature/request
#611 opened Mar 11, 2025 by haizhou-shi Loading…
4
Add draft functionality for a generic sandboxed code running
#580 opened Feb 21, 2025 by plaguss • Draft
1 of 2 tasks
2
Add CodeElo new-task
#575 opened Feb 19, 2025 by plaguss • Draft
1
new metrics and pr-fouras dataset add
#558 opened Feb 13, 2025 by BertrandCabotIDRIS Loading…
5
ProTip! Updated in the last three days: updated:>2025-06-13.