Repository navigation

feat(prefill-probe): add learned prefill complexity router - #97

Merged

ryan-lempka merged 12 commits into

NVIDIA-NeMo:sabhatinas/switch-876-vllm-hidden-state-docsfrom

mich-xu:michxu/prefill-complexity-router

Jul 22, 2026

Merged

feat(prefill-probe): add learned prefill complexity router#97
ryan-lempka merged 12 commits into
NVIDIA-NeMo:sabhatinas/switch-876-vllm-hidden-state-docsfrom
mich-xu:michxu/prefill-complexity-router

Commits on Jul 20, 2026
- feat(prefill-probe): add learned artifact inference
  mich-xu
  committed
  e41278b
- feat(prefill-probe): add cost-aware routing policy
  mich-xu
  committed
  f025f7c
- feat(prefill-probe): add hidden-state feature extraction
  mich-xu
  committed
  b621d4f
- feat(prefill-probe): add vllm learned scorer
  mich-xu
  committed
  a60ba03
- feat(prefill-probe): add learned profile configuration
  mich-xu
  committed
  4b03701
- docs(prefill-probe): add deployment guide and sample config
  mich-xu
  committed
  9fb6405
- feat(prefill-probe): accept explicit probe input
  mich-xu
  committed
  8ea2bd2
- test(benchmark): inject explicit prefill probe input
  mich-xu
  committed
  ae02bc7
- docs(prefill-probe): document explicit probe input
  mich-xu
  committed
  7f00b7f
Commits on Jul 22, 2026
- feat(prefill-probe): extract Terminus task internally
  mich-xu
  committed
  18bfa11
- docs(prefill-probe): document stock Terminus routing
  mich-xu
  committed
  83d55a7
- refactor(prefill-probe): rename config field to checkpoint_dir
  mich-xu
  committed
  242790e