Skip to content

Add terminal viewer for ARC tasks#65

Merged
gkamradt merged 2 commits into
mainfrom
feature/terminal-viewer
Jan 15, 2026
Merged

Add terminal viewer for ARC tasks#65
gkamradt merged 2 commits into
mainfrom
feature/terminal-viewer

Conversation

@ericc59
Copy link
Copy Markdown
Contributor

@ericc59 ericc59 commented Jan 15, 2026

Screenshot 2026-01-15 at 12 14 16 PM

Summary

  • Colored grid visualization in terminal using ANSI 256-color codes
  • View task files showing train + test pairs side-by-side
  • Compare submissions to expected output (shows ✓/✗ for correct/incorrect)

Usage

# View a task
python -m arc_agi_benchmarking.utils.viewer --task data/evaluation/00576224.json

# Compare submission to ground truth
python -m arc_agi_benchmarking.utils.viewer --task data/tasks/task.json --submission submissions/model/task.json

# View multiple tasks
python -m arc_agi_benchmarking.utils.viewer --dir data/evaluation --limit 3

# Show color legend
python -m arc_agi_benchmarking.utils.viewer --legend

Test plan

  • 13 unit tests added and passing
  • Tested against evaluation dataset

- Colored grid visualization using ANSI 256-color codes
- View task files (train + test pairs)
- Compare submissions to expected output (shows ✓/✗)
- Proper alignment accounting for ANSI escape codes
- CLI: python -m arc_agi_benchmarking.utils.viewer --task <file>
- Includes 13 unit tests
- View single submission with auto-resolved task: --submission X --task-dir Y
- View all submissions in directory: --submissions-dir X --task-dir Y
- Handle attempt_1/attempt_2 submission format
@gkamradt gkamradt merged commit e8a55eb into main Jan 15, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants