Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
22 Open 1,302 Closed
22 Open 1,302 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add support for compressed-tensors w8a8 int checkpoints
#2745 opened Nov 14, 2024 by danieldk Loading…
5 tasks
1
fix response type of document for Text Generation Inference
#2743 opened Nov 13, 2024 by jitokim Loading…
3 of 5 tasks
1
Upgrade outlines to 0.1.1
#2742 opened Nov 12, 2024 by aW3st Loading…
1 of 4 tasks
1
benchmark: fix prefill throughput
#2741 opened Nov 12, 2024 by danieldk Loading…
5 tasks
Fix: Change model_type from ssm to mamba
#2740 opened Nov 10, 2024 by mokeddembillel Loading…
2 of 5 tasks
1
Fix: Change embeddings to embedding
#2738 opened Nov 10, 2024 by mokeddembillel Loading…
2 of 5 tasks
1
Support continue final message
#2733 opened Nov 8, 2024 by drbh Loading…
feat: add payload limit
#2726 opened Nov 5, 2024 by OlivierDehaene Loading…
3
Add llama.cpp backend
#2723 opened Nov 4, 2024 by mfuntowicz • Draft
feat: support flash attention 2 in qwen2 vl vision blocks
#2721 opened Nov 4, 2024 by drbh Loading…
Update to moe-kernels 0.7.0
#2720 opened Nov 4, 2024 by danieldk Loading…
5 tasks
add ipex moe implementation to support Mixtral and PhiMoe
#2707 opened Oct 30, 2024 by sywangyi Loading…
5
fix: improve find_segments via numpy diff
#2686 opened Oct 24, 2024 by drbh Loading…
feat: return streaming errors as an event formatted for openai's client
#2668 opened Oct 18, 2024 by drbh Loading…
Get opentelemetry trace id from request headers instead of creating a new trace
#2648 opened Oct 15, 2024 by kozistr Loading…
3 of 5 tasks
1
1
PR 2634 CI - Fix the tool_choice format for named choice by adapting OpenAIs scheme
#2645 opened Oct 14, 2024 by drbh Loading…
49
[WIP] Add gfx1100 support to AMD pytorch build
#2642 opened Oct 13, 2024 by cazlo • Draft
1 of 5 tasks
1
1
Fix the tool_choice format for named choice by adapting OpenAIs scheme
#2634 opened Oct 10, 2024 by linusbierhoff Loading…
[DOCS] Add Google Cloud TGI integration via dedicated DLCs
#2612 opened Oct 5, 2024 by alvarobartt • Draft
1 of 5 tasks
8
feat: Add automatic nightly benchmarks
#2591 opened Sep 30, 2024 by Hugoch Loading…
1 of 5 tasks
@Hugoch
Improve vlm support (add idefics3 support)
#2437 opened Aug 20, 2024 by drbh • Draft
4 tasks
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
ProTip! Exclude everything labeled bug with -label:bug.