C · Trending
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
2667Curated repositories
64,857.5kTotal GitHub stars
Open sourceBuilt by the community
inference-engine repositories
Hand-picked tools to improve your workflow.
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.