Skip to content

review: feed demoted and refuted claims to the next reviewer #335

Description

@pdbethke

The design doc has described this channel for a while; the code has never had it.

Round three's R5 was declared REPRODUCED and demoted to CODE-READ by our own harness — its script expected a negative duration, but the int64 overflow lands on exactly 0s. The verifier then observed the claim held anyway, since zero triggers the same 60s fallback.

That is a precise, hard-won correction about how a reproduction can be wrong while its claim is right — and it currently dies on the record. Across the 25 reviews on the public branch, 6 of 42 claims declared REPRODUCED did not survive their own script.

Feeding demoted and refuted claims forward is the one learning channel that is already designed, already has data, and is not built.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions