test_run: carry the report's surface into the sidecar#86
Merged
Conversation
Consumer half of §5.3: PyAutoBuild#164 makes report.json state the surface it measured; the leg now carries that block through to test_run.json, so the verdict can cite its own denominator instead of comparing counts across incomparable runs. Absent on pre-#164 reports -> None, never a crash. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Jammy2211
added
the
pending-release
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Consumer half of the evidence-chain audit's §5.3 fix (#83; campaign PyAutoBuild#155 Phase 2 satellite). PyAutoLabs/PyAutoHands#164 (merged) makes
report.jsonstate the surface it measured — projects, shards, run_types, env_profiles, script_count. This carries that block through intotest_run.json, so the leg can state its own denominator rather than having counts compared across incomparable runs (the 07-15 "3 failed → 30 failed" false regression).Pre-#164 reports have no surface → the field is
None, never a crash.Shipped under the standing corrective-PR exception (Heart RED). PR-open only; merge stays human.
API Changes
None —
test_run.jsongains an additivesurfacekey.Test Plan
None.Generated by the PyAutoLabs agent workflow.