Real-time serving of full-duplex interaction models: per-tick deadline scheduling + KV-budget admission control. Systems research.
real-time scheduling inference full-duplex interaction-models mlsys kv-cache admission-control llm-serving vllm deadline-scheduling
-
Updated
Jul 8, 2026 - Python