feat(serve): the server now supports vision for streaming-experts (larger than RAM) models - #59

Merged

asher merged 4 commits into

mainfrom

serve-stream-vlm

Aug 13, 2026

Commits on Aug 13, 2026

feat(serve): accept stream: experts on a VLM entry, placing it on the text tower, and document streamed serve as single-stream
asher
committed
5abe576
fix(vlm): evaluate the Kimi image processor's outputs on the building thread so the serve engine thread can use them
asher
committed
0273669
test(apc): drain the async disk writer before the anchor-shadow lookup so the deep skeleton is published
asher
committed
132a821
test: drop the dtype scoping pin and filter upstream's Pillow getdata deprecation
asher
committed
4dd8585