-
Notifications
You must be signed in to change notification settings - Fork 1
OpenMay 29, 2026
No due date
•Last updated Decouple batchgen/batchgen_worker.py (12,914 LOC, 187 methods, one class) into 9 handler classes under batchgen/worker/. Pattern: frozen-snapshot inputs per call (no shared mutable state), typed Backend Protocols per slice, dual-path gate + compare-mode parity check per slice, 3 PRs per slice (port → gate → cleanup). 28 PRs total. Builds on the Phase A/B/C cuda-graph contract pattern (PR #162/#163/#164). Plan: /Users/andrew/.claude/plans/the-task-for-this-declarative-melody.md
79% complete
List view
0 of 6 selected 0 issues of 6 selected
Worker decouple — Phase 2 / Slice 5: KVCacheManager (biggest cohesive subsystem)
enhancementNew feature or requestNew feature or requestworker-decoupleWorker monolith decouple initiative (May 2026)Worker monolith decouple initiative (May 2026)Status: Open.#175 In batchgen-project/batchgen;Worker decouple — Phase 2 / Slice 6: PrefillScheduler
enhancementNew feature or requestNew feature or requestworker-decoupleWorker monolith decouple initiative (May 2026)Worker monolith decouple initiative (May 2026)Status: Open.#176 In batchgen-project/batchgen;Worker decouple — Phase 2 / Slice 7: HostKVRebalancer
enhancementNew feature or requestNew feature or requestworker-decoupleWorker monolith decouple initiative (May 2026)Worker monolith decouple initiative (May 2026)Status: Open.#177 In batchgen-project/batchgen;Worker decouple — Phase 2 / Slice 8: BoundaryHandler
enhancementNew feature or requestNew feature or requestworker-decoupleWorker monolith decouple initiative (May 2026)Worker monolith decouple initiative (May 2026)Status: Open.#178 In batchgen-project/batchgen;Worker decouple — Phase 2 / Slice 9: DecodeScheduler
enhancementNew feature or requestNew feature or requestworker-decoupleWorker monolith decouple initiative (May 2026)Worker monolith decouple initiative (May 2026)Status: Open.#179 In batchgen-project/batchgen;refactor(worker): retire KVCacheManager stats legacy + gate (Phase 5.1c, refs #175)
ci:runTrigger build + GPU regression on H20Trigger build + GPU regression on H20enhancementNew feature or requestNew feature or requestworker-decoupleWorker monolith decouple initiative (May 2026)Worker monolith decouple initiative (May 2026)Status: Open (in progress).batchgen-project/batchgennumber 196#196 In batchgen-project/batchgen;