Skip to content

research: generate deterministic pilot v1 paper figures and tables - #156

Merged
ErenAri merged 19 commits into
mainfrom
research/final-paper-assets-v1
Sep 19, 2026
Merged

ErenAri merged 19 commits into
mainfrom
research/final-paper-assets-v1

Conversation

@ErenAri

@ErenAri ErenAri commented Sep 19, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Publish deterministic final pilot-v1 paper figures and tables generated only from
committed frozen/normalized evidence.

Generated assets

  • Figure 1: study architecture
  • Figure 2: ring-buffer version prediction versus observation
  • Figure 3: 7×10 compatibility matrix
  • Table 1: frozen corpus and validation contracts
  • Table 2: calibration-separated failure taxonomy
  • Table 3: exact environment provenance
  • Table 4: repeat-run stability
  • research/paper/generated/asset-manifest.json binding generator, inputs,
    and all seven output SHA-256 values

The generator uses only the Python standard library and emits deterministic SVG
and Markdown.

Reproduction gate

scripts/research/test-paper-assets-v1.sh regenerates the complete output
directory in a temporary location and requires a byte-for-byte diff match.

The dedicated research-paper-assets-v1 workflow:

  1. compiles/static-checks the generator;
  2. generates all assets from committed evidence;
  3. uploads the generated directory as an Actions artifact;
  4. runs the byte-for-byte committed-output gate.

Evidence boundary

No new experiment is executed. Assets derive from:

  • research/data/v1/processed/
  • research/analysis/v1/generated/
  • frozen corpus identity locks
  • research/repeat/v1/data/stability-summary.json

Calibration remains visually and analytically separated. The repeat result
remains explicitly described as a bounded post-collection stability sample, not
a population-wide nondeterminism estimate.

Publication state

This closes the Phase 3 final-figures/tables gate. The next publication gate is
the machine-readable archival manifest and research-tagged release/DOI package.

Copilot AI lite review requested due to automatic review settings September 19, 2026 14:58

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@coderabbitai

coderabbitai Bot commented Sep 19, 2026 •

Copy link
Copy Markdown

Warning

Review limit reached

Next included review available in 29 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Advanced

Run ID: 7a83a598-bd65-4064-8f1b-5ff44a6c7289

📥 Commits

Reviewing files that changed from the base of the PR and between 7b11ddb and 84637e0.

⛔ Files ignored due to path filters (9)
  • research/paper/generated/README.md is excluded by !**/generated/**
  • research/paper/generated/asset-manifest.json is excluded by !**/generated/**
  • research/paper/generated/figures/figure-1-study-architecture.svg is excluded by !**/*.svg, !**/generated/**
  • research/paper/generated/figures/figure-2-ringbuf-version.svg is excluded by !**/*.svg, !**/generated/**
  • research/paper/generated/figures/figure-3-compatibility-matrix.svg is excluded by !**/*.svg, !**/generated/**
  • research/paper/generated/tables/table-1-corpus-contracts.md is excluded by !**/generated/**
  • research/paper/generated/tables/table-2-failure-taxonomy.md is excluded by !**/generated/**
  • research/paper/generated/tables/table-3-environments.md is excluded by !**/generated/**
  • research/paper/generated/tables/table-4-repeat-stability.md is excluded by !**/generated/**
📒 Files selected for processing (6)
  • .github/workflows/research-paper-assets-v1.yml
  • research/README.md
  • research/ROADMAP.md
  • research/paper/PREPRINT.md
  • scripts/research/generate-paper-assets-v1.py
  • scripts/research/test-paper-assets-v1.sh

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Comment thread scripts/research/generate-paper-assets-v1.py Fixed
@ErenAri
ErenAri merged commit 920dd7e into main Sep 19, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants