Pinned Loading

1. llm-d-kv-cache llm-d-kv-cache Public

   Forked from llm-d/llm-d-kv-cache

   Distributed KV cache scheduling & offloading libraries

   Go 1

2. ceph ceph Public

   Forked from ceph/ceph

   Ceph is a distributed object, block, and file storage platform

   C++

3. kubeflex kubeflex Public

   Forked from kubestellar/kubeflex

   A flexible and scalable platform for running Kubernetes control plane APIs.

   Go

4. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. llm-d-benchmark llm-d-benchmark Public

   Forked from llm-d/llm-d-benchmark

   llm-d benchmark scripts and tooling

   Python