Skip to content

Issues: sgl-project/sglang

Development Roadmap (2024 Q4)
#1487 opened Sep 21, 2024 by Ying1123
Open 22
[Feature] DeepSeek V3 optimization
#2591 opened Dec 26, 2024 by zhyncs
Open 12
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

173 Open 685 Closed
173 Open 685 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Feature] Launch sglang-router without worker
#2796 opened Jan 8, 2025 by KYLN24
2 tasks done
[Bug] deepseek v3 inference on multiple nodes is very slow
#2794 opened Jan 8, 2025 by inforly
5 tasks
4
[Feature] Integration of TurboMind AWQ and GPTQ good first issue Good for newcomers help wanted Extra attention is needed
#2788 opened Jan 8, 2025 by zhyncs
2 tasks
1
[Bug] Failed to create router: Timeout 300s waiting for workers to become healthy
#2778 opened Jan 7, 2025 by stas00
2 of 5 tasks
[Bug] Benchmarks with EAGLE-2
#2777 opened Jan 7, 2025 by xavier-h-10
5 tasks done
@yukavio
[Bug] Cannot capture kernel trace using nsys
#2776 opened Jan 7, 2025 by yixue-qq
5 tasks done
Output Results are not the same for the same model [lmms-lab/LLaVA-Video-7B-Qwen2]
#2775 opened Jan 7, 2025 by Noctis-SC
[willing to PR] Add Lookahead speculative decoding enhancement New feature or request good first issue Good for newcomers
#2772 opened Jan 7, 2025 by jjjjohnson
2 tasks done
@jjjjohnson
1
[Bug] Error occurs when loading in bitsandbytes format.
#2769 opened Jan 7, 2025 by upskyy
2 of 5 tasks
1
[Feature] add unit test for block wise fp8 good first issue Good for newcomers help wanted Extra attention is needed
#2768 opened Jan 7, 2025 by zhyncs
2 tasks
[Bug] Deepseek v3 forward_absorb() of attention bug
#2764 opened Jan 7, 2025 by yixue-qq
5 tasks done
4
[Bug] launch dsv2 service failed
#2763 opened Jan 7, 2025 by lvhan028
2 of 5 tasks
@ispobock
1
[Bug] Issue with batch mode
#2762 opened Jan 7, 2025 by dmakhervaks
5 tasks
[Bug] Forking state before submitting any string causes backend crashing in sgl.function: "UnboundLocalError: local variable 'model_worker_batch' referenced before assignment"
#2755 opened Jan 6, 2025 by VegeWong
5 tasks done
[Feature] Implement Dynamic Depth Decoding (DDD) for EAGLE-2
#2754 opened Jan 6, 2025 by Swipe4057
2 tasks done
[Bug] Long output and issues when running benchmark_serving.py on DeepSeek-V3
#2746 opened Jan 6, 2025 by lhl
5 tasks done
5
[Feature] Docs: Collect all the commands for DeepSeek in SGlang documentation Improvements or additions to documentation good first issue Good for newcomers
#2744 opened Jan 6, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
1
[Feature] Rewrite docs for LLama 405B and ModelSpace documentation Improvements or additions to documentation good first issue Good for newcomers
#2743 opened Jan 6, 2025 by zhaochenyang20
1 of 2 tasks
@zhaochenyang20
2
[Bug] SGLang stops working after a few requests when serving DeepSeek V3
#2741 opened Jan 5, 2025 by seungduk-yanolja
5 tasks done
1
[Feature] support ep for DeepSeek V3 good first issue Good for newcomers help wanted Extra attention is needed
#2740 opened Jan 5, 2025 by zhyncs
2 tasks
@annp0
2
[Feature] adapt fused sigmoid gate for MoE model good first issue Good for newcomers performance
#2739 opened Jan 5, 2025 by zhyncs
2 tasks
@zhaochenyang20
2
[Feature] several features for veRL integration enhancement New feature or request
#2736 opened Jan 5, 2025 by PeterSH6
2 tasks done
@PeterSH6 @zhaochenyang20
3
I wonder if the offline engine API supports OpenAI input format.
#2734 opened Jan 5, 2025 by hljjjmssyh
[Feature] optimize moe_align_block_size_kernel good first issue Good for newcomers high priority performance wip
#2732 opened Jan 5, 2025 by zhyncs
2 tasks
@BBuf @zhaochenyang20 @NovTi
6
[Feature] Support bitsandbytes in QWen2 VL good first issue Good for newcomers help wanted Extra attention is needed
#2729 opened Jan 4, 2025 by gaocegege
2 tasks done
ProTip! no:milestone will show everything without a milestone.