Skip to content

[AGENT] Select browser CI separately from visual evidence - #370

Merged
BASIC-BIT merged 2 commits into
mainfrom
codex/optional-browser-ci
Oct 15, 2026
Merged

BASIC-BIT merged 2 commits into
mainfrom
codex/optional-browser-ci

Conversation

@BASIC-BIT

@BASIC-BIT BASIC-BIT commented Oct 15, 2026 •

Copy link
Copy Markdown
Owner

[AGENT]

Default PR CI runs core checks and the web build without browsers or a Storybook build. ci:browsers selects all existing browser assertions and the Storybook build. ci:visuals alone implies browsers and also selects review captures and both image comparisons.

Selection is fixed at the normal PR event. Label edits do not launch application CI. The report validates core results, selected coverage and current artifacts, marks unselected coverage explicitly, and fails on unknown selection, unexpected skips and stale evidence. Local defaults, functional diagnostics, assertions, baselines and deploy controls are preserved. Agent and developer docs describe when to select each mode.

All three Linux runs passed on 45ac074af8efb79f0b5874f79ac23a26afdbf409:

Mode Observed coverage Summed job minutes
Default Core and web build passed; all browsers and Storybook skipped; eight NOT SELECTED rows; no artifacts 14.6
Browsers only Five browser jobs and Storybook build passed; both comparisons skipped; public and Storybook previews each reported zero review PNGs 41.4
Visuals alone All browser jobs and both comparisons passed; 86 public and 74 Storybook review PNGs; seven current artifacts 47.2

These are sums of elapsed job durations, including parallel jobs, for Baseline Checks only. They are not wall time, billed dollars or guaranteed savings. The earlier reference run used 40.5 summed job minutes. No baselines changed.

The downloaded browsers-only local-flow artifact retained the profile, search and submit-success diagnostic PNGs. Linux full scripts passed with 261 passed, zero failed and one skipped. All 21 CJS selection/report/removal contracts passed on Linux, including exact inline trusted code and stale-head/remove-readd races. Local focused contracts passed 34/34, and full docs verification passed. The unchanged Windows Gemini shutdown timing failure remains outside this change: latest local full run was 260 passed, one failed and one skipped.

Independent whole-branch review found two important issues, both reproduced and fixed before publication. Current-head Claude and Greptile reviews found no actionable defects. Codex and Copilot reviews are quota-unavailable, not approvals. The nonblocking duplicate-helper observation is disposed here.

The existing live ci:visuals removal run passed, preserving prior results and appending the historical note without launching application CI. Since pull_request_target runs trusted base code, the bounded live ci:browsers removal check remains pending after merge under the accepted evidence boundary. Its exact inline contracts passed on Linux; trust controls were preserved.

No merge or deployment is included.

@github-actions

github-actions Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

PR verification report

All required checks and selected coverage passed.

Browsers selected for this run: yes.
Visuals selected for this run: yes.

Check Result Evidence
Web lint PASSED Open run
Docs PASSED Open run
API and MCP PASSED Open run
Web types and unit tests PASSED Open run
Backend types and unit tests PASSED Open run
Backend bootstrap PASSED Open run
Restream checks PASSED Open run
Web build PASSED Open run
Storybook build PASSED Open run
Public route smoke PASSED Open artifact
Mutation data flow PASSED Open artifact
Hosted data flow PASSED Open artifact
Public route screenshots PASSED Open artifact
Public route image diff PASSED Open artifact
Storybook screenshots PASSED Open artifact
Storybook image diff PASSED Open artifact

Changed visual baselines: none.

Updated from Baseline Checks run 38686489081, attempt 1 for 45ac074. This comment is updated in place.

Selection observed at 2026-10-15T08:37:35.353Z for commit 45ac074af8efb79f0b5874f79ac23a26afdbf409: Browser coverage selected: no. Visual evidence selected: no. Historical run results above are preserved, including failures. Label edits do not run application CI; request a normal PR run for current selected coverage.

@BASIC-BIT
BASIC-BIT marked this pull request as ready for review October 15, 2026 05:08
Copilot AI balanced review requested due to automatic review settings October 15, 2026 05:08

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-10-15T05:23:05.649277Z 45ac074 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, add credits to your account and enable them for code reviews in your settings.

@github-actions

github-actions Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

[AGENT]

Claude Review

Claude review for commit 45ac074af8efb79f0b5874f79ac23a26afdbf409 is unavailable because the pull request was merged.

This is not a current review or approval.

Copy link
Copy Markdown
Owner Author

[AGENT] Disposition for the Claude review’s nonblocking duplication note: retained. The dependency-prepared core job runs all three contract files, including the YAML-backed removal tests. The report job repeats the small dependency-free helper checks and still runs via always() when upstream work fails. Removing that overlap is deferred; no measured dollar-cost claim is made.

@greptile-apps

greptile-apps Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

RetriggerView in GreptileConfidence Score: 5/5

[High impact] The reviewed changes appear safe to merge; no actionable defects were found.

Summary

Separates browser coverage from visual evidence while keeping core checks and the web build on by default.

  • PR labels choose whether browser and visual checks run.
  • The PR report checks core jobs and marks unselected coverage.
  • Removing a selection label updates the report and keeps its history.

Review checks were static; no tests or workflows were run during this review.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart TD
  Event[Normal PR event] --> Selection[Snapshot labels]
  Event --> Core[Core checks and web build]
  Selection --> Mode{Selected coverage}
  Mode -->|Neither label| Skip[Skip browsers and Storybook]
  Mode -->|ci:browsers| Browsers[Browser assertions and Storybook build]
  Mode -->|ci:visuals| Browsers
  Mode -->|ci:visuals| Visuals[Review captures and both comparisons]
  Core --> Report[Check results and selected artifacts]
  Skip --> Report
  Browsers --> Report
  Visuals --> Report
  Report --> Head{PR head still matches?}
  Head -->|Yes| Publish[Update report with run selection]
  Head -->|No| Ignore[Do not publish stale evidence]
Loading

Reviews (2) · Last reviewed commit: "Preserve diagnostics and execute CI sele..." · Reviewed by Greptile

@BASIC-BIT
BASIC-BIT marked this pull request as draft October 15, 2026 05:23
@BASIC-BIT
BASIC-BIT marked this pull request as ready for review October 15, 2026 05:23
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, add credits to your account and enable them for code reviews in your settings.

@BASIC-BIT
BASIC-BIT merged commit d419012 into main Oct 15, 2026
88 checks passed
@BASIC-BIT
BASIC-BIT deleted the codex/optional-browser-ci branch October 15, 2026 05:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants