Deterministic Rust inference scheduler with paged KV admission, backend mirror adapters, and release gates
rust distributed-systems performance-engineering canary inference kv-cache vllm llm-inference sglang continuous-batching release-gates backend-adapter
-
Updated
Jun 28, 2026 - Rust