Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and multi-modality models.

   Python 22k 3.9k

2. sgl-project/genai-bench sgl-project/genai-bench Public

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python 250 43

3. sgl-project/ome sgl-project/ome Public

   Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

   Go 350 52

4. rlworkgroup/garage rlworkgroup/garage Public

   A toolkit for reproducible reinforcement learning research.

   Python 2.1k 322