Skip to content

docs(self-eval): label terminal/repair/eval checks as documentation-completeness - #43

Merged
SollanSystems merged 1 commit into
mainfrom
fix/issue-35-self-eval-honesty
Jul 10, 2026
Merged

SollanSystems merged 1 commit into
mainfrom
fix/issue-35-self-eval-honesty

Conversation

@SollanSystems

Copy link
Copy Markdown
Owner

Closes #35.

Scope-honesty relabel of the three self_eval.py checks that are documentation-completeness scans, with zero behavioral change (the pass/fail logic of every check is byte-unchanged):

  • Check labels renamed to say what they prove: terminal-states-documented, repair-record-fields-documented, eval-layers-and-metrics-documented (still exactly 13 checks, labels unique; check_license_present / check_readme_differentiation untouched — test_self_eval calls them by name).
  • A comment above each of the three functions states the scope: canonical vocabulary present in the skill prose, not behavioral/runtime enforcement. check_repair_fields' comment also notes its second half (the examples/ failure-mode taxonomy scan) is structural.
  • CONTRIBUTING.md and the README structural-check list now distinguish doc-completeness checks from behavioral enforcement — the runtime gate remains loop doctor + the contract's own verify scripts. The "gates are the bar" ground rule is unchanged: self_eval is still a hard CI gate; only the character of these three checks is clarified.

Note on the issue's stated proof gate: scripts/test_docs_claims.py only asserts receipts-claims-vs-artifacts, so it is vacuous for this change — the binding gates are self_eval 13/13 + test_self_eval + the full suite, all green (verified independently twice: 393 passed / 14 skipped; skips are the engine-extra env guards that run in CI).

Copilot AI review requested due to automatic review settings July 10, 2026 03:02

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@SollanSystems
SollanSystems merged commit 2c9f315 into main Jul 10, 2026
7 checks passed
@SollanSystems
SollanSystems deleted the fix/issue-35-self-eval-honesty branch July 10, 2026 03:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Label self_eval terminal/repair/eval checks honestly as doc-completeness

2 participants