docs(hubv3): human-in-the-loop acceptance testing runbook (§6 test 12)#2200
Open
Mikecranesync wants to merge 4 commits into
Open
docs(hubv3): human-in-the-loop acceptance testing runbook (§6 test 12)#2200Mikecranesync wants to merge 4 commits into
Mikecranesync wants to merge 4 commits into
Conversation
PRD §6 has 12 acceptance items; 11 are automated-green (174 tests across Python + Hub TS unit + import integration + contextualizer lanes). Item 12 — the cross-stack Garage Conveyor demo (offline → bundle → Hub import → batch/ dedupe/match/stage → human approval → publish → available to MIRA) — cannot be fully automated: two stacks, real fixtures, and a human approval that publishes the model. This runbook is the witness procedure for it. Includes: automated-coverage floor + §6 matrix mapping, prerequisites (dev/ staging only, migs 055+056, UUID tenant, §7 fixtures), an 11-step checklist with 12 blocking MUST boxes + per-step evidence (screenshot rule), an optional Telegram leg exercising §6 test 9 live, and a sign-off table. Ships as markdown source + rendered PDF (markdown→HTML→headless-Chrome). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Owner
Author
Agent Pre-Flight Complete — Ready for Human TestingAn automated pre-flight of the HubV3 HITL acceptance testing runbook has been completed on branch Full report: Summary
Issues filed during pre-flight
The automated foundation is solid. A human tester can pick up from here: start the Hub dev server, walk through the UI import → review → approve flow, and verify MIRA answers a grounded question about the conveyor. |
Mikecranesync
pushed a commit
that referenced
this pull request
Jun 27, 2026
… update hot.md + runbooks README - docs/runbooks/hubv3-hitl-agent-preflight-report.md: add PR/issue cross-references, Round 13 finding pointers, and 'where this fits' context for the §6 test matrix. - docs/runbooks/README.md: add HubV3 contextualization testing section linking the HITL runbook, pre-flight report, demo runbook, and rollback runbook. - wiki/hot.md: update header to 2026-06-26 with HITL pre-flight status summary. GitHub issues filed: #2320, #2321, #2322 (already filed). Tracking issue: #2324. Comments posted on: #2110, #2111, #2200. Refs: #2134, #2141, #2142, #2324
added 2 commits
June 26, 2026 20:37
- Add docs/runbooks/hubv3-hitl-agent-preflight-report.md: automated pre-flight results for the HubV3 human-in-the-loop acceptance testing runbook. Verifies prerequisites, automated test floor (172+ tests green), offline Contextualizer Steps 1-4 (bundle well-formed), and Hub import/match/approve logic via integration tests. Flags remaining human-only steps. - Regenerate mira-hub/docs/SITEMAP.md + sitemap.snapshot.json: contextualization routes (4 pages + 10 API routes) were missing from the committed snapshot, causing sitemap-drift.test.ts to fail. Fixed by running 'bun run sitemap'. Refs: #2142 (testing guide), #2134 (HubV3 P0-P6 merge)
… update hot.md + runbooks README - docs/runbooks/hubv3-hitl-agent-preflight-report.md: add PR/issue cross-references, Round 13 finding pointers, and 'where this fits' context for the §6 test matrix. - docs/runbooks/README.md: add HubV3 contextualization testing section linking the HITL runbook, pre-flight report, demo runbook, and rollback runbook. - wiki/hot.md: update header to 2026-06-26 with HITL pre-flight status summary. GitHub issues filed: #2320, #2321, #2322 (already filed). Tracking issue: #2324. Comments posted on: #2110, #2111, #2200. Refs: #2134, #2141, #2142, #2324
Owner
Author
Pre-flight report + sitemap fix cherry-picked into this PRTwo commits from
Pre-flight summary
Issues closed during pre-flight
Issues still open (docs improvements for this PR)
Tracking issue
This PR now carries both the human witness procedure AND the automated evidence that the foundation is solid. A human tester can start from Step 5. |
…e 3 (#2321) + CHANGELOG entry - hubv3-human-in-the-loop-testing.md §2: add 'How to run the automated floor' section with exact commands for all 4 lanes, including the vitest-not-bun-test warning (#2320) and the local Postgres setup for Lane 3 (#2321). - docs/CHANGELOG.md: add HubV3 HITL pre-flight + sitemap fix entry documenting the agent pre-flight results, sitemap fix (#2322), and issues closed/opened. Closes #2320, closes #2321.
This was referenced Jun 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds the human-in-the-loop acceptance testing runbook for HubV3 — the witness procedure for PRD §6 test 12 (the cross-stack Garage Conveyor demo), the one acceptance item that cannot be automated.
Ships as markdown source + rendered PDF:
docs/runbooks/hubv3-human-in-the-loop-testing.mddocs/runbooks/hubv3-human-in-the-loop-testing.pdf(6 pages)Why
HubV3 (
docs/plans/2026-06-20-hubv3-contextualization-intake-prd.md) has a 12-item §6 matrix. 11 are automated-green — verified onfeat/plc-mapper-gui @ 4eaa2dec: 174 tests across four lanes (Python Telegram intake 29, Hub TS unit 60, Hub TS import-integration vs live Postgres 4, mira-contextualizer 81). Item 12 spans two stacks (offline Contextualizer + cloud Hub), needs real fixtures, and ends in a human approval that publishes the model — the doctrinal core of "Hub owns truth." A person must witness it.Contents
Micro820_v4.1.9_Program.st,MbSrvConf_v4.xml,gs10usermanual.pdf).docs/promo-screenshots/).apply-migrations.yml).Docs-only; no code paths touched.
🤖 Generated with Claude Code