Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
11 Open 1,334 Closed
11 Open 1,334 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: only use eos_token_id as pad_token_id if int
#2774 opened Nov 22, 2024 by dvrogozh Loading…
1
Move JSON grammar -> regex grammar conversion to the router
#2772 opened Nov 22, 2024 by danieldk Loading…
5 tasks
3
Use FP8 KV cache when specified by compressed-tensors
#2761 opened Nov 20, 2024 by danieldk Loading…
5 tasks
Enable qwen2vl video
#2756 opened Nov 18, 2024 by drbh • Draft
6 of 9 tasks
2
Support continue final message
#2733 opened Nov 8, 2024 by drbh Loading…
6
Add llama.cpp backend
#2723 opened Nov 4, 2024 by mfuntowicz Loading…
Get opentelemetry trace id from request headers instead of creating a new trace
#2648 opened Oct 15, 2024 by kozistr Loading…
3 of 5 tasks
1
3
[WIP] Add gfx1100 support to AMD pytorch build
#2642 opened Oct 13, 2024 by cazlo • Draft
1 of 5 tasks
1
1
[DOCS] Add Google Cloud TGI integration via dedicated DLCs
#2612 opened Oct 5, 2024 by alvarobartt • Draft
1 of 5 tasks
8
Improve vlm support (add idefics3 support)
#2437 opened Aug 20, 2024 by drbh • Draft
4 tasks
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
ProTip! Follow long discussions with comments:>50.