Research: pressure-test released Decision Engine v1.0.0 across domains - #71
camerontjs-dot wants to merge 25 commits into
Conversation
|
RC0 first hosted cut preserved as an evaluator/harness deviation. Run Observed substantive gates passed: exact published v1.0.0 archive verification, unchanged released runtime proof, exact C/D/CAL authority checks, fresh CAL v0.5.0 Contract C generation, released-artifact domain/adversarial matrix, downstream Contract D consumer step, source mutation guard, artifact upload. However artifact inspection found a harness coverage defect: Classification: Disposition: preserve this run; correct only the missing FAILED-to-downstream coverage and rerun. No maintained runtime change, Contract mutation, Authorization, execution, promotion, merge, tag, or release. |
|
RC0 second hosted cut preserved as a second evaluator expectation defect. Run
It then failed in Exact released Contract D consumer authority at
Therefore a FAILED Decision with exact authority/policy/target correctly remains Classification: Also observed in this run: the known Contract-B aperture reproduced exactly on the published v1.0.0 artifact. Five internal proposition/evidence substitutions were rejected by exact indexed Contract-C validation but both released V1 policies returned CLEAR under the documented bundle-level-only ingress. This is a reproduced known release limitation, not a newly discovered regression. Next action: correct only the FAILED-operation expectation and rerun. No maintained runtime change, Contract mutation, Authorization, execution, promotion, merge, tag, or release. |
|
RC0 third hosted cut is behaviorally PASS but preserves one remaining receipt-label defect before terminalization. Hosted run Artifact:
Observed downstream outcomes across 22 exact Contract D objects:
HOLD and FAILED did not escalate. Wrong target/authority remained non-applicable. Wrong requested operation was non-applicable for completed Decisions; exact FAILED Decisions correctly remained The combined artifact receipt has a record-label defect: it writes Classification: Next action: change only receipt labeling to record both exact values, then run one final exact-head cycle. No Decision Engine runtime, Contract, Authorization, execution, promotion, merge, tag, or release change. |
RC0 terminal dispositionDISPOSITION: CONFORMS WITH KNOWN AUTHORITY APERTURE AND CAPABILITY GAPS. NO PROMOTION IMPLIED. KEEP DRAFT. Exact research branch head: Exact released subject: Final hosted evidence:
The terminal receipt correctly distinguishes research branch head Observed pressure resultThe published v1.0.0 source artifact itself was downloaded and verified against release SHA-256 RC0 exercised both maintained V1 policies across nine domain-shaped Contract-C-valid cases spanning six domain families:
A fresh real producer control was also generated from exact CAL v0.5.0, yielding Contract C SHA-256 Across the ordinary domain/real-producer matrix, 20 exact Contract D Decisions were emitted. Two additional independent FAILED controls brought the downstream total to 22. Exact Contract D consumption observed:
No HOLD or FAILED Decision escalated. Wrong authority and wrong target were non-applicable. Wrong requested operation was non-applicable for completed Decisions; FAILED Decisions correctly remained Additional controls passed for wrong Contract-C whole-object identity, wrong expected Contract-B top-level binding, wrong Contract-C authority root, unknown policy identity, cross-case claim replay, cross-case citation replay, stale same-ID claim target, stale same-ID citation target, caller evaluator/registry substitution, exact-repeat determinism, context-key-order invariance, policy-A verdict sensitivity, policy-B basis-membership sensitivity, documented assessment-stage invariance, and CLI/library parity. Important semantic observationsThe two maintained policies remained independent in useful ways:
Therefore a positive claim-tag Decision does not imply that every attached source is a deciding citation, and a negative/held claim Decision does not suppress exact counterevidence citation authority. Known authority aperture reproduced on the published releaseRC0 replayed the prior Contract-B internal-reference experiment from exact science head Five substitutions were tested:
For every substitution, exact Contract-C validation with the independently supplied Contract-B index rejected the object, while released V1's documented bundle-level ingress accepted the recomputed exact Contract-C object and both maintained policies reached CLEAR. Classification: This remains the most material trust-boundary limitation if V1 is ever asked to consume Contract C from an untrusted or independently assembled producer path. Capability gaps surfacedRC0 records ten desired decision requirements that V1 does not maintain and does not emulate through approximate policy reuse:
These are Evaluator recordThree harness defects were preserved rather than erased:
Each was classified as evaluator/harness defect, corrected narrowly, and rerun. The final exact-head run passed with unambiguous receipts. BoundaryNo maintained Decision Engine runtime change, Contract mutation, Authorization, execution, merge, promotion, tag, or release occurred in RC0. No new Decision Engine runtime defect was observed within the tested scope. RC0 does not establish universal correctness, semantic/world truth of the synthetic domain cases, arbitrary CAL successor compatibility, or suitability for whole-document regulated approval. |
Terminal RC0 disposition
Exact released subject
Decisive science execution
Terminal record-only reproduction
The terminal commit changes only the research evidence record and removes a duplicate research workflow/setup-marker clutter. No maintained Observed resultThe published v1.0.0 artifact passed the preregistered multi-angle cohort across:
Twenty-two canonical Contract D Decisions were independently consumed:
No HOLD or FAILED Decision escalated and no Authorization or execution occurred. Fresh CAL v0.5.0 Contract C SHA-256:
Known authority boundary reproducedThe already-documented Contract-B internal-reference aperture was reproduced on the published artifact. With top-level B bundle identity held fixed, five coherent C-internal substitutions were rejected by exact indexed Contract-C validation but remained acceptable to maintained bundle-level V1 ingress when freshly canonicalized and freshly targeted:
Classification: This is preserved as a known release limitation, not relabelled a newly discovered V1 defect. Capability gapsRC0 records 10 explicit capability gaps rather than overloading the two maintained policies: MainFrame note lifecycle promotion, controlled-document/SOP approval, regulated publication/use approval, typed human review, evidence remediation, task dispatch, release qualification approval, aggregate multi-claim approval, conditional approval, and explicit negative actions such as reject/remove/retract. Preserved harness failureAccidental duplicate-workflow run Next boundaryThe highest-value successor is not another generic mutation sweep. First close or explicitly externalize the C→B exact-reference authority boundary using the already-supported strict indexed-ingress shape with an independently established exact B-index identity. Then test one explicit new Decision domain, preferably MainFrame audited-note promotion, without changing the meaning of the two v1.0.0 policies. Full terminal synthesis: No merge or production promotion is authorized by this research record. |
Classification
Draft Research Infrastructure / post-release pressure campaign. Keep Draft regardless of outcome.
No maintained Decision Engine runtime, release metadata, Contract C/D authority, Authorization, execution, merge, tag, release, or production-default change is authorized.
Exact subject
The test subject is the published Decision Engine v1.0.0 release artifact, not the research branch checkout.
7be709b2141c767c5da89b8b94cf90233c4238fe4e92703e781024de62c77f2f14e9164aceb16815v1.0.0c440d5de2a3853db9f4ccc2ba37d273e29ce8d9e71e0d646fc0c20eee0cd5902The workflow downloads that exact published archive, verifies its digest, extracts it, and executes the pressure harness against the extracted release object. It separately proves that this research branch does not modify maintained
src/**,scripts/**, ortests/**.Real producer control
The campaign also checks out exact Claim Audit Lab
v0.5.0:5533bbcf27a3ee3a7d901f7dfc44c241bc558e2c193c07178a8d891231746fca97c8c1bef0e9dc3cCAL v0.5.0 regenerates a fresh Contract C 1.0.0 object from its released locked Contract-B fixture. This is the real released-producer control.
Pressure surface
RC0 preregisters:
Consumer-constructed domain cases must first pass exact released Contract C validation. They are explicitly not claimed as current CAL producer reachability or real-world semantic gold.
Capability questions under test
Rather than forcing existing policies to impersonate broader product behavior, RC0 records absence as a capability gap for questions such as:
Prior evidence deliberately not rediscovered
Earlier Decision Engine research already established real CAL supported/contradicted/not-checkable behavior, mixed evidence handling, execution-state precedence, producer-identity scope, the Contract-B internal-reference aperture, B-index strict-ingress prototype, maintained mutation testing, heterogeneous research domains, evaluator-substitution falsification, and immediate bound materialization.
RC0 uses those as known boundaries and concentrates on the released artifact, broader domain-shaped consumption, cross-object composition pressure, and capability coverage.
Falsifier
Any cross-case/stale/misbound object acquiring CLEAR, any HOLD/FAILED result becoming
candidate_for_authorization, unknown-policy fallthrough, caller implementation substitution, nondeterminism, CLI/library disagreement, invalid authority acceptance, or unexplained metamorphic sensitivity/invariance weakens or falsifies the released surface.Evidence record
Preregistration:
research/v1-pressure-test-rc0/README.mdNo interpretation is final until the hosted run and resulting artifact are inspected.