Skip to content

Replace Python challenge validator with shared Rust validation #2

Description

@ifsheldon

The challenge repository currently carries a Python validation script that mirrors parts of Agentics bundle validation. This duplicated logic has already drifted from the Rust source of truth for execution modes, resource profiles, image policy, and executor fields.\n\nFollow-up: reuse existing Rust validation from Agentics, or expose a small Rust validation binary/library that this repository can invoke in CI. Once that path exists, remove or heavily shrink scripts/validate_challenges.py so challenge CI does not carry a second copy of the platform contract.\n\nContext from Agentics review on 2026-05-21: the Python validator needs temporary fixes for coexecuted_benchmark direct validation, piped_stdio validation_session, supported image policy, CUDA metadata, and executor result_file, but the durable direction should be shared Rust validation.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions