feat(harness): typed adapters + format-aware session-inject proxy + multi-turn bandit driver#266

Closed

dusterbloom wants to merge 39 commits into

Luce-Org:mainfrom

dusterbloom:feat/harness-typed-adapters

Commits on May 23, 2026

docs: ship-in-days PLAN for adaptive keep_ratio MVP (mrciffa scope)
dusterbloom
committed
feat(pflash): plumb DFlash accept_rate into GenerateResult (Day 1 of bandit MVP)
dusterbloom
committed
feat(pflash): adaptive keep_ratio bandit state machine (Day 2)
dusterbloom
committed
feat(pflash): integrate adaptive bandit into live HTTP path (Day 3)
dusterbloom
committed
bench(mvp): Day 4 — adaptive bandit vs fixed-keep A/B on claude_code
dusterbloom
committed
feat(harness): inject extra_body.session_id via PFLASH_SESSION_ID env
dusterbloom
committed
bench(mvp): Day 5 — adaptive bandit vs fixed-keep on identical prompts
dusterbloom
committed
fix(pflash): adaptive_keep_ratio uses dflash::common namespace (follow project convention)
dusterbloom
committed
fix(pflash): replace dead EMA log line with real post-update EMA value
dusterbloom
committed
fix(pflash): bandit updates on spec_decode_ran, not accept_rate>0 (0-accept must signal too)
dusterbloom
committed
chore(mvp): trim bench-result noise + move PLAN.md to thoughts/ per project convention
dusterbloom
committed
ci: fix submodule fetch for fork PRs
dusterbloom
committed
bench(mvp): NIAH 16K/32K + 3-seed Day-5 for PR #264 evidence
dusterbloom
committed
feat(pflash): plumb DFlash accept_rate into GenerateResult (Day 1 of bandit MVP)
dusterbloom
committed
test: anthropic /v1/messages round-trip regression lock + stub server (seeds #1, #2)
dusterbloom
committed
feat+test: OpenAI /v1/chat/completions + /v1/responses injection (seed #1)
dusterbloom
committed
harness: preflight_require_bin in common.sh + exit-78 test (seed #3)
dusterbloom
committed
harness: wire preflight_require_bin + cpp backend into 5 run scripts
dusterbloom
committed
harness: typed metrics parser with Optional[float] for missing fields (seed #5)
dusterbloom
committed
harness: ClientAdapter protocol + 5 concrete adapters + bandit subcommand (seeds #4, #6)
dusterbloom
committed
harness: --adapter flag + CLI smoke tests for bandit subcommand
dusterbloom
committed
harness: add live_run to adapters, delete 4 bash launchers, update README
dusterbloom
committed
fix(harness): start_server respects LUCEBOX_SERVER_BACKEND (cpp default)
dusterbloom
committed
fix(harness): preflight invokes binary (not shutil.which) to catch broken asdf shims
dusterbloom
committed
fix(harness): live_run drives client binary directly (was shelling into deleted bash scripts)
dusterbloom
committed
docs(harness): replace stale bash-launcher refs with Python adapter pattern
dusterbloom
committed
fix(harness): wire metrics_parser into adapter result (accept_rate was dead column)
dusterbloom
committed
fix(harness): preflight uses same env as live_run (catches asdf shim breaks)
dusterbloom
committed
fix(harness): enable pflash on bandit-condition server launches (bandit was never firing)
dusterbloom
committed
fix(harness): bandit server launch — positional model arg + drop unknown flags
dusterbloom
committed
fix(harness): migrate ClaudeCodeAdapter to direct invocation, skip hermes/opencode preflights
dusterbloom
committed
feat(harness): bandit-session subcommand + multi-turn adaptive evidence
dusterbloom
committed
bench: add server.log for adaptive evidence run (force-add over .gitignore)
dusterbloom
committed
fix(harness): wire HermesAdapter end-to-end; fix proxy port collision
dusterbloom
committed
chore(harness): move followups to thoughts/ per project convention
dusterbloom
committed
fix(harness): opencode/pi/codex adapter binary resolution under isolated HOME
dusterbloom
committed
feat(harness): wire session-inject proxy into bandit-session; revert max_ctx 65K->49K
dusterbloom
committed

Commits on May 24, 2026

fix(harness): skip --draft for pflash-only server profiles
dusterbloom
committed

Commits on May 26, 2026

fix(bandit): bound HttpServerSessions to cap LRU eviction
dusterbloom
committed