Skip to content

Add more deterministic eval assertion types #6

@RPSingh1990

Description

@RPSingh1990

Expand run_evals.py beyond the current assertion set.\n\nUseful candidates:\n- forbidden_regex\n- required_json_key\n- max_line_count\n- exact_section_order\n\nAcceptance criteria:\n- Add at least two assertion types.\n- Add self-tests.\n- Update docs/evals-and-benchmarks.md.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions