Skip to content

test(ci): add native hosted smoke checks - #89

Open
ben-ranford wants to merge 3 commits into
mainfrom
feat/59-native-smokes
Open

ben-ranford wants to merge 3 commits into
mainfrom
feat/59-native-smokes

Conversation

@ben-ranford

@ben-ranford ben-ranford commented Sep 13, 2026

Copy link
Copy Markdown
Owner

Summary

Closes #59.

  • Add bounded macOS 14 and Windows 2025 hosted CI jobs that execute the same deterministic root-module smoke selection.
  • Add a go test -json smoke harness that fails if the command fails or any selected root test has no completed pass event; selected skips and failures also fail the harness.
  • Resolve the operator-selected Go executable to an absolute path before execution; missing and relative-path lookups fail explicitly.
  • Preserve pinned actions, the current Go toolchain, and the workflow runner guard; its only new allowlisted labels are the two native-smoke jobs in ci.yml.
  • Document the selected coverage, accounting rule, timeout budget, and future skip policy.

Scope firewall

A review item is in scope only when it directly prevents #59 acceptance and is an incremental correction in .github/workflows/ci.yml, scripts/rigor/native-smoke, the workflow guard, generated inventories, or native-smoke documentation. Sharing a file with this change is not sufficient.

Validation

  • go run ./scripts/rigor/native-smoke
  • go test ./scripts/rigor/native-smoke -count=1
  • (cd scripts/rigor/workflow-guard && go test ./... -count=1)
  • make workflow-validate
  • make dependency-inventory license-inventory
  • git diff --check
  • make ci (completed through the release-contract target after regenerating the dependency inventory for the new standard-library-only smoke package)

The updated head requires fresh hosted macOS and Windows smoke results before merge. Local smoke execution passes all 10 selected tests; it does not substitute for those native hosted checks.

Release Notes

Adds CI-only macOS and Windows hosted smoke coverage. There is no public API, protocol, or release behavior change.

@ben-ranford ben-ranford added area:runtime Terminal lifecycle, events, input, cancellation, and effects rigor-uplift Repository hygiene, CI, release, or governance hardening type:verification Executable compatibility, testing or release verification priority:p2 Normal milestone priority labels Sep 13, 2026
@ben-ranford ben-ranford self-assigned this Sep 13, 2026
@ben-ranford ben-ranford added this to the v1.1.0 milestone Sep 13, 2026
@ben-ranford
ben-ranford marked this pull request as ready for review September 13, 2026 12:14
@ben-ranford
ben-ranford requested a lite review from Copilot September 13, 2026 12:14
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 13, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-09-14T13:07:07.265122Z 42ebce5 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 0e14c62884

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/rigor/native-smoke/main.go Outdated

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Add Unicode-input coverage to the native smoke selection.

Get a fresh assessment by requesting another Copilot review.

Pull request overview

Adds bounded macOS and Windows hosted smoke checks with JSON test accounting, runner safeguards, documentation, and inventory updates.

Changes:

  • Adds pinned native smoke jobs and runner allowlist entries.
  • Adds smoke selection and test-event validation.
  • Updates tests, generated inventory, and documentation.
File summaries
File Description
scripts/rigor/workflow-guard/main.go Updates native runner allowlisting.
scripts/rigor/workflow-guard/main_test.go Tests runner restrictions.
scripts/rigor/native-smoke/main.go Runs and accounts for selected smoke tests.
scripts/rigor/native-smoke/main_test.go Tests smoke event accounting.
scripts/rigor/generated/dependency-inventory.json Updates generated dependency data.
docs/README.md Links native smoke documentation.
docs/native-hosted-smokes.md Documents coverage and budgets.
.github/workflows/ci.yml Adds macOS and Windows smoke jobs.
Review details
  • Files reviewed: 7/8 changed files
  • Comments generated: 1
  • Review effort level: Lite

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread scripts/rigor/native-smoke/main.go
@ben-ranford
ben-ranford requested a lite review from Copilot September 13, 2026 13:37
@ben-ranford
ben-ranford marked this pull request as draft September 13, 2026 13:37
@ben-ranford
ben-ranford marked this pull request as ready for review September 13, 2026 13:37

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@ben-ranford
ben-ranford marked this pull request as draft September 14, 2026 13:03
@ben-ranford
ben-ranford marked this pull request as ready for review September 14, 2026 13:03
@sonarqubecloud

Copy link
Copy Markdown

@ben-ranford

Copy link
Copy Markdown
Owner Author

Sonar API audit

Reviewed commit: 42ebce5affb5e0643c48bdda116083c42a2a57e8.

Live public SonarCloud API queries for PR #89 returned:

  • Open issues: 0 (api/issues/search, resolved=false, all severities; total 0).
  • Security hotspots: 0 (api/hotspots/search; total 0).
  • Current-head Sonar check: passed (check run 103985094776).

Audited via CLI at 2026-09-14T13:04:56.752554+00:00. Project visibility was verified as public. No findings were changed or suppressed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:runtime Terminal lifecycle, events, input, cancellation, and effects priority:p2 Normal milestone priority rigor-uplift Repository hygiene, CI, release, or governance hardening type:verification Executable compatibility, testing or release verification

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Run native macOS and Windows runtime smoke tests on hosted runners

2 participants