RPC distributed prefill + slot-state PD disaggregation PoC for llama.cpp
rpc kv-cache llama-cpp local-llm gguf distributed-inference pd-disaggregation disaggregated-inference prefill-decode-disaggregation slot-state
-
Updated
Sep 7, 2026 - PowerShell