Feature/add leaderboard - #27

Draft

Am1n3e wants to merge 71 commits into

mainfrom

feature/add-leaderboard

Commits on Feb 7, 2026

Add Phase 0 leaderboard canonical models and specs
amine-elh-sn
committed
46c7914
Add leaderboard submission PR CI validator with fail-closed rate limits
amine-elh-sn
committed
1dbcc6e
Implement Track A control-plane transitions and validation
amine-elh-sn
committed
d6b7797
Merge branch 'codex/leaderboard-track-a-control' into add-leadearboard-site
amine-elh-sn
committed
6cbded5
Address Track B review: move validator to dev and harden PR checks
amine-elh-sn
committed
b24cc00
Implement Astro leaderboard site with tabbed rankings and styled responsive table
amine-elh-sn
committed
1a0bd03
Refine leaderboard controls alignment and hide page size label
amine-elh-sn
committed
da1fd4f
Merge branch 'codex/leaderboard-track-b-ci' into add-leadearboard-site
amine-elh-sn
committed
09a4c2a
Address Track C review: base-aware site paths and schema parity
amine-elh-sn
committed
f99cb8e
Merge branch 'codex/leaderboard-track-c-site' into add-leadearboard-site
amine-elh-sn
committed
3037c70
Implement Track D atomic leaderboard publish workflow and dev tooling
amine-elh-sn
committed
0da507b
Merge branch 'codex/leaderboard-track-d-docs-e2e' into add-leadearboard-site
amine-elh-sn
committed
2974072

Commits on Feb 8, 2026

Commits on Mar 7, 2026

Refactor leaderboard CI validation modules (#26)
Am1n3e
authored
f944845
Add leaderboard implementation planning docs
Am1n3e
committed
ae39d24
Allow leaderboard manifest URL override via env
Am1n3e
committed
c3008fe
Freeze Lane B contracts around integer submission IDs (#31)
Am1n3e
authored
d4fe3aa
Add read-only PR gate intake validation (#33)
Am1n3e
authored
79a6a63
Implement Lane D finalize workflow with canonical records (#32)
Am1n3e
authored
f1a6970
Implement Lane E canonical rebuild single-writer flow (#34)
Am1n3e
authored
1e17610
Document Lane A governance plan and execution status (#30)
Am1n3e
authored
c7342eb
Complete Lane F source wiring and Lane G contract coverage (#35)
Am1n3e
authored
a757128
Harden leaderboard submission pipeline and remove legacy HF sync path
Am1n3e
committed
6c392d9
Remove legacy leaderboard workflows and processed publish path
Am1n3e
committed
a91b8a6
Move leaderboard scripts and inline rebuild into finalize workflow
Am1n3e
committed
4904e66
Harden leaderboard finalize trust boundaries and public row contract
Am1n3e
committed
d244f35
Fix leaderboard site bugs and improve visual polish
Am1n3e
committed
27d1972
Clean up redundant content and add sticky footer
Am1n3e
committed
8612ad7
Replace legacy leaderboard intake with HF-direct control flow

Am1n3e
and
sisyphus-dev-ai
committed
6b019b8
Remove FAQ page, fix full-width layout, nav highlight, and table alignment
Am1n3e
committed
da0029a
Remove temporary plan docs and apply review cleanups
Am1n3e
committed
75a006c
Remove tracked .wip docs and rename file lock helper
Am1n3e
committed
a47e114
Remove leaderboard spec docs from branch
Am1n3e
committed
8dfa83c
Separate CI leaderboard schemas from submission types
Am1n3e
committed
2a0754a
Remove redundant leaderboard row field checks
Am1n3e
committed
51ad00a
Remove webhook bridge and unused leaderboard templates
Am1n3e
committed
ec238dd
Consolidate leaderboard types into core modules
Am1n3e
committed
fea946b
Remove dead utility modules from leaderboard scripts

Am1n3e
and
sisyphus-dev-ai
committed
c9222b3
Simplify leaderboard type validators and payload contracts

Am1n3e
and
sisyphus-dev-ai
committed
4b1befc
Add backward-compat key stripping for submission control records

Am1n3e
and
sisyphus-dev-ai
committed
21611ac
Simplify publish path and ingest workflow

Am1n3e
and
sisyphus-dev-ai
committed
b05997a
Fix stale-event submission_uid consistency in HF ingest

Am1n3e
and
sisyphus-dev-ai
committed
ef02ad4
Remove stale site lockfile and update AGENTS docs

Am1n3e
and
sisyphus-dev-ai
committed
fd20c96
Remove tar archive generation from create-submission-pkg

Am1n3e
and
sisyphus-dev-ai
committed
9e64a38

Commits on Mar 8, 2026

Add leaderboard submit CLI and documentation
Am1n3e
committed
46c6ea1
Refactor submission handlers for two-step create-then-submit workflow

Am1n3e
and
sisyphus-dev-ai
committed
425f4c0
Update CLI args for two-step submission workflow

Am1n3e
and
sisyphus-dev-ai
committed
0c2e5fa
Update submission docs for two-step workflow

Am1n3e
and
sisyphus-dev-ai
committed
2ccf696
Refactor leaderboard workflows to use script entrypoints
Am1n3e
committed
f233b2e
Simplify submission packaging metadata and validation
Am1n3e
committed
fa1c86b
Refine submission metadata schema and validation
Am1n3e
committed
268fd4c
Harden vNext submission ingest and leaderboard rebuild flow
Am1n3e
committed
4e741ab
Fix deterministic rebuilds and coverage-aware evaluation scoring
Am1n3e
committed
638f83f
Remove leaderboard smoke workflow and related code
Am1n3e
committed
865e44e
Remove manual leaderboard rebuild workflow and task wiring
Am1n3e
committed
94ad740
Simplify leaderboard CI to single ingest workflow
Am1n3e
committed
20cb52b
Consolidate leaderboard script modules

Am1n3e
and
sisyphus-dev-ai
committed
a30761c
Move leaderboard-only code from client package to leaderboard scripts

Am1n3e
and
sisyphus-dev-ai
committed
6e765bd
Add docstrings to all classes and public functions in leaderboard scripts
Am1n3e
committed
c862036
Unify docs and leaderboard deploy into single gh-pages workflow
Am1n3e
committed
30cf9c4
Add Pydantic settings config for leaderboard scripts

Am1n3e
and
sisyphus-dev-ai
committed
ec95265
Add HF API backend facade for submission data access

Am1n3e
and
sisyphus-dev-ai
committed
5d2068d
Refactor leaderboard builder with deduplication and logging

Am1n3e
and
sisyphus-dev-ai
committed
1c0f058
Simplify ingest pipeline to direct function calls

Am1n3e
and
sisyphus-dev-ai
committed
3541682
Update rebuild tests to use LeaderboardBuilder directly

Am1n3e
and
sisyphus-dev-ai
committed
0a4bea9
Rename ingest_hf_submission to sync_submission and reuse backend instance
Am1n3e
committed
4459ef1
Make backend a required parameter in sync_submission
Am1n3e
committed
c54e999
Add docstring to _locate_submission_directory
Am1n3e
committed
a85d1e2
Construct leaderboard artifacts via Pydantic models instead of raw dicts
Am1n3e
committed
427b7b5
Consolidate score computation into core TasksEvalResults
Am1n3e
committed
088f496