#

llm-d

Here are 10 public repositories matching this topic...

llm-d / llm-d-deployer

Helm charts for llm-d

helm helm-chart llm-d

Updated Jul 22, 2025
Shell

aleskandro / llm-d-lab

Accelerate reproducible inference experiments for large language models with LLM-D! This lab automates the setup of a complete evaluation environment on OpenShift/OKD: GPU worker pools, core operators, observability, traffic control, and ready-to-run example workloads.

inference platform-engineering vllm llm-inference distributed-inference llm-d

Updated Dec 23, 2025
Python

redhat-na-ssa / demo-ocp-llm-d

Demo - Distributed Inference on OpenShift (aka llm-d)

openshfit vllm llm-d

Updated Dec 15, 2025
Python

whaili / llm-d

一个 Kubernetes 原生的高性能分布式大语言模型推理框架

llm-d

Updated Oct 31, 2025

whaili / llm-d-inference-sim

A light weight vLLM simulator, for mocking out replicas.

llm-d

Updated Oct 2, 2025
Go

whaili / llm-d-benchmark

llm-d benchmark scripts and tooling

llm-d

Updated Oct 1, 2025
Jupyter Notebook

whaili / llm-d-inference-scheduler

Inference scheduler for llm-d

llm-d

Updated Oct 2, 2025
Go

whaili / llm-d-kv-cache-manager

Distributed KV cache coordinator

llm-d

Updated Oct 2, 2025
Go

redhat-na-ssa / cnuland-ocp-llm-d

LLM-d on OCP

openshfit llm-d

Updated Oct 2, 2025
Shell

maneeshsit / PCIe

Open Source software code for use with PCIe card-based hardware AI accelerators catering to both inference and training use cases

Updated Jan 5, 2026
Python

Improve this page

Add a description, image, and links to the llm-d topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-d topic, visit your repo's landing page and select "manage topics."