Skip to content

SP-TRACE-CFR: remaining work blocked on external resources (live key, prod emitters, doctrine docs) #315

Description

@mdheller

The SP-TRACE-CFR narration-fidelity verifier is built, tested (270 tests), and merged to main — two-engine recovery, the sp-run narration-gate / attest-run surface, signed run attestations, a live reference runtime, and a real Claude ModelPolicy (PRs #311, #312, #313, #314; sourceos-spec #131). What remains is blocked on resources not available in the build environment.

1. Live end-to-end smoke against a real Anthropic key ⛔ needs ANTHROPIC_API_KEY / ant auth

ModelPolicy (tools/model_policy.py) drives the runtime via a dependency-injected Anthropic client; tests use a scripted fake (no live API). We have not run it against a real model turn.

  • default_client() + AgentRuntime.run_react on a real task; confirm control-flow events emerge from a genuine claude-opus-4-8 turn
  • confirm attest() gates the model's real narration (truthful → PASS, induced mismatch → FAIL)
  • Everything from model turn → recovery → verdict is already wired; this is an observation run, not new code.

2. Wire production emitters to emit control-flow ReasoningEvents ⛔ other repos / possibly other lane

sourceos-spec #131 added the controlFlow vocabulary. The real surfaces (TurtleTerm / Noetica / BearBrowser / the governed runner) don't emit these events yet.

  • emit reasoning.tool.called / decision.branched / subrun.spawned|joined / run.completed from at least one real emitter
  • Consumer side is done (trace_cfr_reasoning_bridge.py); once an emitter produces the events, gating runs on real runs with zero further change.

3. Deploy hardening ⛔ needs a real secret + CI decision

  • harness signing key from a deployment secret instead of the dev default (--key-seed / env)
  • CI hook so every governed run gets attest-run

4. Mellumwork + CBES doctrine grounding ⛔ needs source docs from @mdheller

tools/mellumwork.py grounds the T1/T2 tiering we actually use, but the named external frameworks weren't locatable. CBES's 7 axioms were never provided (not fabricated).

  • point at where Mellumwork / CBES live (Documents estate?) or confirm the in-code grounding is canonical

5. Composition primitives blocked on other infra

  • §10 AttributionIR — needs a replay-job runtime
  • §12 CINormIR — needs Policy Fabric / OPA integration

Doable here without any of the above (not blocked; separate follow-ups if wanted): ReceiptIR base fold additive edit; R_PI 3rd engine; eval strata S2/S3/S6; conformal anytime-valid/PASC.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions