Skip to content

Commit a real example report, regenerated by CI so it cannot go stale #16

Description

@Bubblegunn

examples/ holds basic.mjs and basic.sh, which show how to call the tool. What is missing is the thing a visitor actually wants in the first ten seconds: a real report to look at, without installing anything or pointing the tool at their own history.

That gap matters more here than in most tools, because the output is the product. The README describes the figures; a committed report shows what a reader is being asked to trust.

Done when

  • A report generated from a public repository is committed, along with the exact command that produced it and the commit it was taken at, so anyone can reproduce it.
  • The Markdown rendering is committed next to the JSON, since most readers will only look at the Markdown.
  • CI regenerates it and fails when the committed copy no longer matches a fresh run, the way bench/PRECISION.md is kept honest in a sibling repository. A committed artefact that nothing checks is a stale artefact waiting to happen, and this project has been bitten by hand-typed numbers before.
  • The chosen repository is one whose history is stable and public, and the pull request says why you picked it.

Out of scope. Anything involving a private repository, and any report about a real person who has not agreed to it. Pick a repository where the authorship figures are about the project's own public contributors and say so, or use a repository you own.

A wrinkle to think about. A report pinned to a moving branch changes as the project does, so CI will fail for reasons that are nobody's fault. Pinning to a tag or a fixed commit is the obvious answer; if you find a better one, say so.


Taking this on: comment and it is yours, so two people do not write the same patch. No design document needed unless the issue asks for one.

What gets a pull request rejected here: a change with no test; a new runtime dependency; or a number written into a README or a document that did not come from a run somebody else can repeat. CONTRIBUTING.md has the rest.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationgood first issueGood for newcomers

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions