Skip to content

Unsolvable LongCoT-mini questions #4

@le-big-mac

Description

@le-big-mac

We've identified an issue with 21 of the LongCoT-mini maths problems, where some subproblems are missing required information. We're working on a fix and will have it out ASAP.

The ids of the affected questions are:
2, 7, 17, 18, 20, 27, 30, 32, 33, 38, 43, 44, 45, 46, 49, 50, 57, 58, 65, 66, 206
in src/data/math/easy.json.

  • Identify issue
  • Replace questions (in progress)
  • Re-evaluate models on new questions

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions