Merge `dev` into `main`#349

Merged

MrtinoRG merged 57 commits intomainfrom

Apr 22, 2026

Commits on Jan 1, 2026

Commits on Jan 2, 2026

feat: refactor metrics and report (#236)
MrtinoRG
authored

Commits on Jan 12, 2026

feat: attach logprobs in message, add to hook context (#263)
n0w0f
authored

Commits on Jan 17, 2026

feat: llm response object and messages have id (#266)
n0w0f
authored

Commits on Jan 21, 2026

added docstrings for scoring functions (#272)
chandan21gupta
authored

Commits on Jan 22, 2026

feat: load from trace and fix toolcalling intervention (#271)
n0w0f
authored

Commits on Jan 24, 2026

feat: make the visualization tool general (#261)
MrtinoRG
authored

Commits on Feb 3, 2026

Commits on Feb 13, 2026

fix: solve scoring for the spectra and retro subtasks (#285)
MrtinoRG
authored

Commits on Feb 14, 2026

Commits on Feb 15, 2026

Commits on Feb 16, 2026

Commits on Feb 24, 2026

Commits on Feb 26, 2026

Commits on Mar 2, 2026

chore: rm older runs (#305)
n0w0f
authored

Commits on Mar 4, 2026

Commits on Mar 5, 2026

Commits on Mar 17, 2026

feat: add plot scripts (#312)
MrtinoRG
authored

Commits on Mar 19, 2026

Commits on Mar 20, 2026

feat: react oss - catalyst subtask and resistor comprehensive (#322)
n0w0f
authored

Commits on Mar 24, 2026

chore: utility shared across plots (#314)

n0w0f
and
kjappelbaum
authored

Commits on Mar 26, 2026

Commits on Apr 2, 2026

feat: add appendix tables (#325)
MrtinoRG
authored

Commits on Apr 3, 2026

feat: retro db can be pulled from ghcr
MrtinoRG
authored

Commits on Apr 8, 2026

Commits on Apr 11, 2026

feat: panel 2 performance plots (#313)

n0w0f
and
dependabot[bot]
authored

Commits on Apr 12, 2026

feat: panel 4 irt plots (#315)
n0w0f
authored

Commits on Apr 13, 2026

chore: remove report files (#337)

MrtinoRG
and
n0w0f
authored

Commits on Apr 18, 2026

feat: intervention experiment pipeline (#334)
n0w0f
authored

Commits on Apr 19, 2026

Commits on Apr 21, 2026