Integrate negotiated Heft child reporting

[Sean Larkin (TheLarkInn)]

Part of #5980

Stack

Parent: #5997 (copilot/reporter-r5b-demo-reporters)

This PR is based directly on the latest R5B demo tip and intentionally excludes the parallel R6 #5993 bootstrap work. Auto-merge remains disabled while stack ancestors are open.

Negotiated Heft reporting

Rush now allocates a pair of private inherited descriptors for operation children: one carries child-to-parent NDJSON events and the other returns the parent hello acknowledgement. The handshake negotiates protocol major, optional capabilities, required features, and parent-owned reporter context (reporter, log level, color, and terminal width).

Compatible Heft versions:

• advertise heft-child-events-v1 and reporter-context-v1;
• emit bounded externalOutput and structured diagnostics without selecting or constructing the parent's reporters;
• preserve child session, parent request/session/operation correlation, privacy classification, and child sourceSequence;
• propagate structured warnings back into Rush operation status calculation.

The Heft-side bootstrap uses a node-only frozen wire client rather than a runtime dependency on @rushstack/rush-reporter, avoiding a Heft/self-hosting dependency cycle. It activates only when Rush supplies both private descriptors; direct standalone Heft behavior is unchanged.

Fallback and problem matchers

Older Heft and opaque external children continue through ordered raw stdout/stderr. Missing or capability-incompatible negotiation falls back without losing output. Unsupported protocol majors or required features produce RUSH_PROTOCOL_UPDATE_REQUIRED; malformed, oversized, or truncated streams produce RUSH_PROTOCOL_INVALID_CHILD_STREAM.

Raw output is published before matcher diagnostics. Matchers consume ANSI-normalized copies keyed independently by operation, child record, and stdout/stderr stream, retain bounded partial lines, cap duplicates, and never mutate, suppress, or reorder the source output. They are disabled only after heft-child-events-v1 is actually accepted, preventing duplicate recovery when structured diagnostics exist.

Validation

• rush build --only @rushstack/heft --only @rushstack/rush-reporter --only @microsoft/rush-lib --only @microsoft/rush --verbose
• reporter protocol/matcher/Heft integration suite: 317 tests
• Rush child-process cross-version fixtures: 5 tests
• Rush operation stream/sharding/raw-order suite: 15 tests
• Heft child bootstrap fixtures: 3 tests
• apps/rush frontend suite: 28 tests
• node apps/rush/src/test/sandbox/reporter-demo/run.mjs
• rush check
• rush change --verify --no-fetch

Coverage includes new Rush + new Heft, old/capability-less child fallback, unsupported major/required features, unknown optional and required events, malformed/truncated/oversized records, descriptor close and child crash, stdout/stderr interleaving, UTF-8 chunk limits, sourceSequence, request/session/operation correlation, privacy, matcher recovery and duplicate caps, sharded operations, warning status propagation, and parent context.

Non-goals

• no install-run-rush bootstrap handoff or R6 ownership ([rush reporter][R6A] Add bootstrap handoff and compatibility adapters #5993);
• no agent auto-selection;
• no Rush 6 default flip or terminal API removal;
• no child authority to select parent reporters.

[Sean Larkin (TheLarkInn)]

Independent /pr-agentmerge review completed.

Findings fixed in 1f910c2

• Structured Heft externalOutput bypassed Rush project logs and build-cache log chunks. Structured output now enters the archival pipeline through a no-reemit terminal provider, preserving child correlation while avoiding duplicate reporter output and problem matching.
• Heft trusted inherited descriptor numbers and could write to or close unrelated descriptors when an intermediate launcher preserved environment variables but dropped fd mappings. Heft now requires pipe/socket descriptors before negotiation; Windows lifecycle commands explicitly retain safe raw stdout/stderr fallback because the shell launch path does not preserve Node fd mappings.
• The parent host now rejects child-session changes, non-monotonic source sequence, malformed externalOutput payloads, and chunks above the 64 KiB protocol limit.
• The reporter demo now accepts the valid fromCache operation terminal state when comparing rendered output with raw events.

Validation

• rush test --only @rushstack/rush-reporter --only @microsoft/rush-lib --only @microsoft/rush: 6/6 operations passed.
• Focused Heft HeftChildReporter suite: 4/4 passed.
• Reporter demo passed, covering negotiated current-Heft events, parent correlation/sourceSequence order, chunk bounds, legacy rollback parity, raw grouping, and duplicate suppression.
• rush check, rush change --verify, API Extractor, lint, and the focused post-fix review passed.
• The full Heft suite reached four unrelated pre-existing GitUtilities.checkIgnoreAsync failures caused by this hidden worktree path; the changed Heft suite passes directly.

There are no review threads to resolve. #6000 remains stacked on open #5997 with auto-merge disabled. Merge is blocked until the ancestor chain reaches main, the PR is retargeted/rebased one step at a time with an R7-only diff, and full required CI/review gates pass.

[Sean Larkin (TheLarkInn)]

Combined deep review of current head 1f910c26e8.

1. HIGH extra reporter descriptors are attached to every Unix shell operation. Forked grandchildren can retain the pipes and hang operation completion. Allocate descriptors only for negotiated children.
2. MEDIUM the acknowledgement stream lacks an error handler. A closed child pipe can raise an unhandled EPIPE.
3. MEDIUM forwarded child envelopes retain child-chosen source and privacy. Override both from trusted parent context before telemetry or reporter fan-out.
4. MEDIUM handshake/context exceptions can escape the stream data handler and terminate Rush. Validate once and reject attachAsync() instead.

[Sean Larkin (TheLarkInn)]

R7 acceptance review against #5980: malformed negotiated streams, readable diagnostics, and real platform fallback.