Skip to content

feat: show what the model flagged on the Changes tab - #135

Merged
HarryRandall merged 2 commits into
mainfrom
feat/review-confidence-flags
Sep 23, 2026
Merged

HarryRandall merged 2 commits into
mainfrom
feat/review-confidence-flags

Conversation

@HarryRandall

Copy link
Copy Markdown
Owner

Summary

Follows #134. Review is the only check on a model-owned sync, but the model's own notes were produced on every sync and then thrown away: nothing stored them and nothing showed them.

  • Stored. A new catalogue_version_flags table holds each source version's flags, sealed with the version like its provenance. Only catalogue reviewers can read it (can_read_catalogue_drafts), and it is not part of the content hash, so notes never create a review on their own.

  • Shown. The Changes tab opens with What to check:

    • parts that could not be read and were left empty (errors);
    • wording to compare with the ANU page (warnings);
    • the fields the model was least sure of, below 80% confidence, weakest first, with the page wording behind each.

    Field names read as an administrator knows them: requisites.prerequisiteRule becomes "Prerequisite rule" and requirements.rule.children.3 becomes "Requirements, branch 4". The section is absent when nothing was flagged.

Verification

  • Format, lint, types and 537 unit and component tests (pnpm verify was not rerun on this branch)
  • Browser smoke test: not run. Docker Desktop was off and the local stack is shared.
  • Supabase migration and generated types: not run locally. apps/web/types/database.ts is committed from the Database gate's own generator output, so that gate is the check.

Deployment notes

  • Migration 011_catalogue_version_flags.sql creates the table, its seal trigger, row-level security, a reviewer read policy and grants. A pgTAP test covers the access boundary.
  • Flags are stored for source versions created after this deploys. Existing versions have none.

The model's review notes were produced on every sync and then discarded:
nothing stored them and nothing showed them. They are now sealed with the
source version they describe, alongside its evidence, and the Changes tab
opens with what to check: parts that could not be read, wording to compare
with the ANU page, and the fields the model was least sure of, in words an
administrator reads rather than extraction paths.
@vercel

vercel Bot commented Sep 23, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
coursemap Ready Ready Preview Sep 23, 2026 7:51am UTC

@HarryRandall
HarryRandall added this pull request to stack #137 September 23, 2026 07:55
@HarryRandall
HarryRandall merged commit 0a431ce into main Sep 23, 2026
6 checks passed
@HarryRandall
HarryRandall deleted the feat/review-confidence-flags branch September 23, 2026 07:55

This branch was successfully deployed

1 active deployment
Preview caa05a3d Deployed Sep 23, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant