Skip to content

Add frontier experiment orchestration stack - #3

Merged
dipeshbabu merged 1 commit into
mainfrom
dev
Jul 15, 2026
Merged

Add frontier experiment orchestration stack#3
dipeshbabu merged 1 commit into
mainfrom
dev

Conversation

@dipeshbabu

Copy link
Copy Markdown
Collaborator

Summary

  • Adds the missing frontier orchestration commands and wiring for protocol, controls, and ablations.
  • Implements dry-run support for ablation suite and propagates it through frontier experiment wrappers.
  • Introduces the full experiment-stage CLI scripts needed to run prompt generation, activation extraction, bening screening, baselines, falsification slices, and monitoring.
  • Adds/updates protocol docs and command infrastructure for end-to-end frontier execution.

Verification

  • uv run pytest tests/test_common.py -q
  • uv run pytest tests/test_protocol_orchestrator.py -q
  • uv run pytest tests/test_config_validation.py -q
  • uv run python -m cli.run_frontier_suite --config experiments/protocol/neurips_main_manifest.yaml --dry-run --skip-validation --device mps
  • uv run python -m cli.run_ablation_suite --config experiments/protocol/ablation_suite.yaml --dry-run --device mps

Paper/dataset content intentionally left out of this branch.

@dipeshbabu
dipeshbabu merged commit 0e04790 into main Jul 15, 2026
1 of 3 checks passed
@dipeshbabu
dipeshbabu deleted the dev branch July 15, 2026 03:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant