Skip to content

fix(audit,gate): withdraw the five residues — a file-based census cannot see GitHub-generated checks - #876

Merged
hyperpolymath merged 1 commit into
mainfrom
fix/census-residues-refuted
Sep 20, 2026
Merged

hyperpolymath merged 1 commit into
mainfrom
fix/census-residues-refuted

Conversation

@hyperpolymath

Copy link
Copy Markdown
Owner

What

Withdraws the five "unsatisfiable required contexts" this census reported, because all five are published.

Each one reports in the check-run history of the repository that requires it — as a job of a GitHub-generated workflow (code scanning default setup and friends) that no file in the repository mentions:

Repository Context Evidence (check-runs, default branch, 2026-09-20)
awesome-gleam Analyze (actions) 8 of the last 8 commits, and PR #12's head
awesome-gleam Adjust Configuration reports on main (intermittent)
casket-ssg Analyze Code (actions) 15 of the last 30 commits
coord-tui CodeQL Analysis (actions, none) 5 of the last 8 commits, and PR #63's head
vext CodeQL Analysis (actions, none) 12 reports over 8 commits, and PR #51's head

Why the previous pass got it wrong

The verification in the previous commit asked whether the rules were live — active enforcement, ~DEFAULT_BRANCH, integration_id: 15368. It never asked whether a publisher exists. For these five the publisher is the platform itself, not the repository, so a census over repository files cannot see it.

That is not a footnote. Acting on the previous version would have meant patching four repositories' required-status-check lists to delete working gates, on false evidence, and the names deleted would have been the ones nothing in the repository can see.

What changes

  • results read 0 unsatisfiable; the five are recorded as refuted candidates with their evidence;
  • the operational rule is stated where a reader will meet it: a file-based pass may only produce candidates; an unsatisfiable verdict becomes a finding only after check-run history confirms the name never reports; a required context is never deleted on a file-based verdict alone;
  • the gate says this in its header, in its warning and error text, and in --print-commands, next to the remediation it prints;
  • the census caveats section cites this as the worked example instead of a hypothetical.

Verification

  • bash scripts/tests/check-required-contexts-test.sh — 5/5 pass.
  • bash scripts/check-canonical-names.sh origin/main — clean.
  • The refutation is reproducible: for each context, compare GET /repos/{r}/commits/{default}/check-runs and the check-runs on a recent PR head.

…not see GitHub-generated checks

The five contexts this census flagged as unsatisfiable are all published: every one
reports in the check-run history of the repository that requires it, as a job of a
GitHub-generated workflow (code scanning default setup and friends) that no file in
the repository mentions.

Evidence, gathered 2026-09-20 from check-runs on the default branch:

  awesome-gleam  Analyze (actions)               8 of the last 8 commits, and PR #12's head
  awesome-gleam  Adjust Configuration            reports on main (intermittent)
  casket-ssg     Analyze Code (actions)          15 of the last 30 commits
  coord-tui      CodeQL Analysis (actions, none)  5 of the last 8 commits, and PR #63's head
  vext           CodeQL Analysis (actions, none) 12 reports over 8 commits, and PR #51's head

The previous commit stated that all five were re-checked and are "live defects".
That re-check answered the wrong question: it confirmed the *rules* were live
(active enforcement, ~DEFAULT_BRANCH, integration_id 15368) and never asked whether
a *publisher* exists. The publisher is the platform.

This matters beyond the ledger: merged guidance to go and patch four repositories'
required-status-check lists would have deleted working gates on false evidence, and
the deleted names would have been the ones nothing could see — the checks GitHub
generates itself.

Changes:

* the audit's results now read 0 unsatisfiable, with the five candidates and their
  evidence; the residues table becomes the refuted-candidates table;
* the method note becomes the operational rule: a file-based pass may only produce
  candidates; an unsatisfiable verdict becomes a finding only after check-run
  history confirms the name never reports; a required context is never deleted on a
  file-based verdict alone;
* the gate carries the same limit in its header, in its warning and error text,
  and in --print-commands, so the person reading a finding is told to confirm it
  before acting;
* the census caveats section cites this as the worked example rather than a
  hypothetical.

The class remains real — tropical-types#17 was a genuine mis-named requirement.
What changes is the confidence level a file-based census may claim.
@coderabbitai

coderabbitai Bot commented Sep 20, 2026

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

Next included review available in 41 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Advanced

Run ID: e57cdc35-2cd5-4fdb-890e-67f33ad9ca10

📥 Commits

Reviewing files that changed from the base of the PR and between 59a3f18 and ba0947b.

📒 Files selected for processing (2)
  • docs/audits/audit-ci-context-producibility-2026-09-20.adoc
  • scripts/check-required-contexts.sh

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@sonarqubecloud

Copy link
Copy Markdown

@hyperpolymath
hyperpolymath merged commit 84a438e into main Sep 20, 2026
15 of 23 checks passed
@hyperpolymath
hyperpolymath deleted the fix/census-residues-refuted branch September 20, 2026 22:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant