Popular repositories Loading

1. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   Fast and memory-efficient exact attention

   Python

2. mlx mlx Public

   Forked from ml-explore/mlx

   MLX: An array framework for Apple silicon

   C++

3. mlx-lm mlx-lm Public

   Forked from ml-explore/mlx-lm

   Run LLMs with MLX

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. depthchart depthchart Public

   Context-length-aware speculative decoding scheduler — the (B, ctx) K controller for long-context decode

   Python

6. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python