Skip to content

feat(scripts): full 89-task run on Windows/WSL - #18

Merged
canyang25 merged 1 commit into
mainfrom
ruoshi/feat-full-run
Oct 7, 2026
Merged

canyang25 merged 1 commit into
mainfrom
ruoshi/feat-full-run

Conversation

@rzhang569

Copy link
Copy Markdown
Collaborator

Tooling for the plan's next step: run all 89 tasks once on x86, then pick a new dev slice from the results.

  • scripts/run_full.sh — all tasks, one trial each; resume continues an interrupted job and re-runs gateway failures (harbor jobs resume). A full run is 8–12 h, so it will get interrupted.
  • scripts/export_trials.py — one CSV row per trial (outcome, turns, tokens, time), small enough to commit so the run can be analysed off the machine that ran it.
  • scripts/env.sh — loads the gateway settings, resolving the key with op or, in WSL, op.exe. 1Password has no WSL integration and op run can't launch Linux programs from there.
  • Fixes run_task.sh, which ran op run against the .env.op template with its <item> placeholder and couldn't have worked.
  • Rewrites docs/setup-windows.md with memory sizing, the GlobalProtect/WSL networking fix, power settings and tmux.

The WSL parts are untested until I set up the machine today; I'll fix the doc from what actually happens.

@rzhang569
rzhang569 marked this pull request as draft October 7, 2026 19:29
@rzhang569

Copy link
Copy Markdown
Collaborator Author

Moved to draft: the WSL steps (op.exe, GlobalProtect networking) haven't been run on a real machine yet. I'm setting up the Windows box today and will fix the doc from what actually happens, then mark it ready.

@canyang25
canyang25 marked this pull request as ready for review October 7, 2026 21:02
@canyang25
canyang25 merged commit 1d69747 into main Oct 7, 2026
1 check passed
@rzhang569
rzhang569 deleted the ruoshi/feat-full-run branch October 11, 2026 20:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants