Skip to content

Optimize recompute latency: Add query embedding cache and reusable ZMQ connections#226

Open
VedantMadane wants to merge 1 commit into
StarTrail-org:mainfrom
VedantMadane:optimize-recompute-latency
Open

Optimize recompute latency: Add query embedding cache and reusable ZMQ connections#226
VedantMadane wants to merge 1 commit into
StarTrail-org:mainfrom
VedantMadane:optimize-recompute-latency

Commits

Commits on Jun 8, 2026