Open artifact repository for the paper:
Evaluating Protocol-Scaffolded Agentic Workflows Across LLM Providers
This repository is the public evidence surface for the current Quantyra Teaching paper. It exposes the manuscript, supplement, benchmark packets, retained run artifacts, reviewer materials, synthesis notes, figures, and selected reproducibility scripts used in the paper's current release path.
Repository URL:
https://github.com/Quantyra/protocol-scaffolded-agentic-workflows- fixed paper-support release:
https://github.com/Quantyra/protocol-scaffolded-agentic-workflows/releases/tag/v1.0.7 - Zenodo concept DOI:
https://doi.org/10.5281/zenodo.20552809 - fixed
v1.0.7archive DOI:https://doi.org/10.5281/zenodo.20553373
This repository is intentionally broad within the paper boundary. It includes:
- manuscript sources and submission-facing files
- benchmark packets and task/source-truth materials
- retained run artifacts across hosted and local branches
- human and model-based hosted review materials
- manuscript figures and evidence memos
- reviewer packet materials
- selected benchmark and packaging scripts
The main exclusions are Drive/OAuth helper scripts and other credential-handling glue that are operational rather than research-facing.
- Journal upload set:
docs/evidence/review-packets/emse-submission-v1/upload-set/
- Branded manuscript review copy:
docs/evidence/review-packets/emse-submission-v1/manuscript-draft-v1.docx
- Manuscript source:
docs/evidence/manuscript-draft-v1.md
- Supplement source:
docs/evidence/manuscript-supplement-v1.md
- Benchmark packets:
docs/benchmarks/packets/
- Retained pilot and run artifacts:
docs/benchmarks/pilots/
- Hosted human
L2review artifacts:docs/benchmarks/reviews/l2-hosted-matrix/
- Hosted model-based
L2Areview artifacts:docs/benchmarks/reviews/l2a-hosted-matrix/
Quantyra is treating this work as open research. The goal of this repository is to maximize public visibility into the paper's empirical spine rather than expose only a minimal supplement bundle.
Where the paper references retained evidence, benchmark packets, review materials, or synthesis memos, the expectation is that those materials are available here unless they are purely local machine byproducts or credential-bearing operational helpers.
docs/benchmarks/benchmark specifications, run sheets, retained runs, and review outputsdocs/evidence/manuscript sources, figures, submission packet materials, and evidence memosdocs/hitl/distinct-evaluator review packet and human-review handoff materialsscripts/selected reproducibility and packaging scripts
If you use this repository, cite it via CITATION.cff.
For reproducible citation of the current paper-support artifact, cite the
fixed v1.0.7 archive DOI: https://doi.org/10.5281/zenodo.20553373.
All repository contents are released under the MIT License for maximal reuse. See LICENSE.