Skip to content

Issues: sgl-project/sglang

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

284 Open 918 Closed
284 Open 918 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] Watchdog caught collective operation timeout help wanted Extra attention is needed
#3784 opened Feb 22, 2025 by teadross
5 tasks done
6
[Feature, Hardware] add support for Ascend NPU feature
#3781 opened Feb 22, 2025 by 22dimensions
2 tasks done
[Bug] AWQ scalar type error help wanted Extra attention is needed
#3780 opened Feb 22, 2025 by zjp-shadow
5 tasks done
3
sgl-kernel for aarch64 help wanted Extra attention is needed
#3769 opened Feb 21, 2025 by GeorgiosSmyrnis
1
[Bug] Segmentation Fault and Connection Closed by Peer Exceptions in CUDA Graph Runner Initialization help wanted Extra attention is needed
#3768 opened Feb 21, 2025 by khw934
5 tasks
@zhaochenyang20
2
[Bug] use Eagle with speculative-num-steps=1 bug Something isn't working
#3762 opened Feb 21, 2025 by CodeSlogan
5 tasks done
2
[Feature] Optimizing DeepSeek with the DeepSeek Infra OSS component deepseek high priority performance
#3758 opened Feb 21, 2025 by zhyncs
3 tasks
@yizhang2077 @ispobock @zhyncs
[Bug] fix amd runner offline amd high priority
#3755 opened Feb 21, 2025 by zhyncs
5 tasks
@HaiShaw @saienduri
1
[Bug] Process terminated abnormally help wanted Extra attention is needed
#3753 opened Feb 21, 2025 by Arcmoon-Hu
1 of 5 tasks
2
[Bug] --enable-torch-compile encounter Watchdog timeout error
#3752 opened Feb 21, 2025 by wangdaw2023
5 tasks done
1
[Feature] attention dp + attention tp for deepseek v3
#3750 opened Feb 21, 2025 by shiqingzhangCSU
2 tasks
[Feature] A800 kernel config file to support deepseek r1 bf16
#3748 opened Feb 21, 2025 by wangdaw2023
2 tasks done
Qwen2.5 VL sglang's output much worse than transformers visIon-LM
#3746 opened Feb 21, 2025 by heibaidaolx123
@zhaochenyang20
8
[Bug] torch.distributed.all_reduce raised Segmentation fault on 2 * 8 * H800 deepseek
#3745 opened Feb 21, 2025 by YEXINGZHE54
5 tasks
@zhaochenyang20
2
[Feature] [Eagle] Are there any plans to support the feature for batching prefill? speculative-decoding
#3736 opened Feb 21, 2025 by BucherLi
2 tasks done
@zhaochenyang20
1
[Bug] update_weights_from_tensor raise EOFError when TP>1 RLHF Using SGLang for post training
#3726 opened Feb 20, 2025 by thisjiang
4 of 5 tasks
@jhinpan
2
Extensive benchmarking of reasoning models including variance good first issue Good for newcomers
#3725 opened Feb 20, 2025 by simveit
@zhaochenyang20
1
[Bug] Structured output request with nextn speculation causes sglang server to crash bug Something isn't working high priority
#3724 opened Feb 20, 2025 by dsingal0
2 of 5 tasks
@zhyncs
[Feature] facebook/contriever support requring good first issue Good for newcomers help wanted Extra attention is needed
#3720 opened Feb 20, 2025 by yichuan520030910320
2 tasks
@nitinjoseph11
5
[Bug] v0.4.3 performance degradation 2x8xH100
#3719 opened Feb 20, 2025 by Hugh-yw
2 of 5 tasks
@ispobock @BBuf
2
ITL metrics
#3718 opened Feb 20, 2025 by marquis-wang
@Fridge003 @PopSoda2002
7
[Bug] TCPStore Error processing client message: Too many keys being waited. keys: 3891110078061282660, max: 13107
#3717 opened Feb 20, 2025 by Superskyyy
4 of 5 tasks
@FrankLeeeee @Fridge003
2
[Bug] MLA slower than default for small context long outputs *and* generating bad output reproducibly bug Something isn't working deepseek high priority
#3716 opened Feb 20, 2025 by pseudotensor
5 tasks done
@Fridge003
10
[Bug] failed to serve Deepseek R1 via SGLang, encounter sqlite3.OperationalError: no such column: "size" - should this be a string literal in single-quotes? error
#3714 opened Feb 20, 2025 by Yonggie
5 tasks done
@Fridge003
2
[Bug] Crash when run with lora.
#3713 opened Feb 20, 2025 by yinjiaoyuan
5 tasks done
@Fridge003
8
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.