Skip to content

docs: readiness evidence-chain audit#84

Merged
Jammy2211 merged 1 commit into
mainfrom
feature/heart-evidence-audit
Jul 16, 2026
Merged

docs: readiness evidence-chain audit#84
Jammy2211 merged 1 commit into
mainfrom
feature/heart-evidence-audit

Conversation

@Jammy2211

Copy link
Copy Markdown
Contributor

Summary

Audit deliverable for #83 (build-chain campaign PyAutoBuild#155, Phase 2): docs/readiness_evidence_audit.md — the per-leg evidence map behind the readiness verdict, three measured integrity findings, the resolution of the missing-dataset question, and the judgment on what GREEN is worth today. Docs only — no behaviour change; the fix PRs (test_run entrypoint wiring, verify_install exercise run, surface-definition recording, version_skew floor rework, HowTo* simulator stage) each follow behind their own plan.

Headline findings (all measured, commands/timestamps in the doc):

  • test_run's server-first cloud path is unreachable from every real entrypoint (main() always passes results_dirfetch_cloud=False); the leg runs on the 2026-07-09 local surface while newer cloud runs exist.
  • version_skew is structurally unfailable by releases (8/8 MATCH on comparands #120 froze); the invariant that matters now — floors name installable versions — is guarded by nothing.
  • verify_install has never been satisfied post-PR#77 (fix merged 13:08Z; the day's only ingest ran 10:29Z, pre-merge; artifact absent).
  • Finding 3 resolved: the HowTo* smoke surface passed for months on datasets releases had force-committed (purged #151, 2026-07-13); the tutorials never simulated for themselves. Pre-existing falsehood newly revealed, not a regression.
  • Verdict-worth judgment: the gate holds partly by paralysis — it cannot wrongly GREEN today (degraded legs fail safe) but can barely GREEN at all; recommendation on the nightly grant is in §4.

Shipped under the human-authorized corrective-PR exception for Heart RED (standing this session). PR-open only; merge stays human.

API Changes

None — documentation only.

Test Plan

  • PyAutoHeart suite run in the worktree (gate leg).
  • Every finding carries its establishing command or timestamp pair; the doc's "Trust nothing here" discloses this audit's own caught instrument error.

Generated by the PyAutoLabs agent workflow.

Audit deliverable for the build-chain campaign (PyAutoBuild#155 Phase 2):
per-leg evidence map, three measured integrity findings (test_run server-first
path unreachable from every real entrypoint; version_skew unfailable by
releases; verify_install never satisfied post-PR#77), the missing-dataset
question resolved (smoke surface depended on force-committed release
artifacts, purged in #151 — pre-existing falsehood, not a regression), and the
what-is-GREEN-worth judgment with a nightly-grant recommendation. Docs only;
fix PRs follow behind plan approval.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@Jammy2211 Jammy2211 added the pending-release Merged changes awaiting the next release cycle label Jul 16, 2026
@Jammy2211
Jammy2211 merged commit fbcd972 into main Jul 16, 2026
4 checks passed
@Jammy2211
Jammy2211 deleted the feature/heart-evidence-audit branch July 16, 2026 14:23
Jammy2211 added a commit that referenced this pull request Jul 18, 2026
The boundary line read '-> Hands (execute)' while ORGANISM.md and the generated
organism map say 'Build'. Part of the organism docs sweep (#84, WS1).


Claude-Session: https://claude.ai/code/session_01ERDgNVKpQohYXVcJwAHzmw

Co-authored-by: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pending-release Merged changes awaiting the next release cycle

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant