Pinned Loading

1. EfficientContext/ContextPilot EfficientContext/ContextPilot Public

   Accelerating Long Context LLM Inference with Accuracy-Preserving Context Optimization in SGLang, vLLM, llama.cpp, OpenClaw, RAG, and Agentic AI.

   Python 122 5

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.6k 7.3k

3. openmlsys/openmlsys openmlsys/openmlsys Public

   《Machine Learning Systems: Design and Implementation》 (V2 is launching soon）

   TeX 4.8k 475

4. ServerlessLLM/ServerlessLLM ServerlessLLM/ServerlessLLM Public

   Serverless LLM Serving for Everyone.

   Python 693 75

5. Auto-CAP/MoE-CAP Auto-CAP/MoE-CAP Public

   [NeurIPS 2025] Benchmarking Cost, Accuracy and Performance for MoE systems

   Python 7 4

6. ServerlessLLM/pylet ServerlessLLM/pylet Public

   Python 5