← Back to Discover
jpezzulli

jpezzulli/sglang-rtxpro6000

PythonApache-2.0activerising
85Health

Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.

Stars90
Forks12
Open Issues8
Contributors12
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
12
Popularity
23
#blackwell#dflash2#fp8#fr-spec#hicache#llm-inference#local-llm#long-context#nixl#nvfp4#qwen#qwen3#qwen3-8#qwen3-8-27b#qwen3-8-flash-next#qwen38#rtx-pro-6000#sglang#sm120#speculative-decoding
View on GitHub ↗Issues (8) ↗Pull Requests ↗Wiki ↗

Should you contribute to jpezzulli/sglang-rtxpro6000?

jpezzulli/sglang-rtxpro6000 has a FoundDev health score of 85/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Python, so prior Python experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

jpezzulli85

Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.

activerising
9012 contributors8 issues
0d ago

More Python repos

anasty17
anasty17/mirror-leech-telegram-bot
Official Repository: Telegram bot which can download direct links, torrents, nzb, google drive, telegram document, any file/folder from rclone supported clouds, all yt-dlp supported sites and jdownloader supported sites, then upload them to google drive, telegram cloud or to one of rclone supported clouds
4.3k100
Azure-Samples
Azure-Samples/azure-search-openai-demo
A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
7.8k95
commaai
commaai/opendbc
a Python API for your car
3.4k94