Skip to content

Scorecard links after running benchmark do not work #86

@blakewest

Description

@blakewest

Following the quickstart, I ran...

uv run python -m arcagi3.runner \
    --agent adcr \
    --game_id dc22-4c9bff3e \
    --config claude-sonnet-4-5-20250929-thinking-32k \
    --max_actions 3

Benchmark completed successfully and provided a public scorecard link, which when entered in the browser, does not work:

┌──────────────────────────────────────────────────────────────────────────┐
│ 🔗 SCORECARD                                                              │
├──────────────────────────────────────────────────────────────────────────┤
│ View detailed scorecard online:                                            │
│ https://three.arcprize.org/scorecards/7b011d5f-629e-455a-a3de-06a19f185318 │
│                                                                            │
│ Card ID: 7b011d5f-629e-455a-a3de-06a19f185318                              │
└──────────────────────────────────────────────────────────────────────────┘

link: https://three.arcprize.org/scorecards/7b011d5f-629e-455a-a3de-06a19f185318

Example link:
https://three.arcprize.org/scorecards/7b011d5f-629e-455a-a3de-06a19f185318

Expectation

  • Links would open up to some kind of scorecard

Result

  • All links open up to the same ARC AGI 3 homepage

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions