Add vision evaluation metrics (exact_match, relaxed_accuracy, word_sort_ratio)#2476

Open

jiafatom wants to merge 7 commits into

mainfrom

jiafa/add-vision-eval-metrics

Commits on May 29, 2026

Add vision evaluation metrics (exact_match, relaxed_accuracy, word_sort_ratio)

jiafatom
and
Copilot
committed
Add benchmark documentation to vision metric classes and enum

jiafatom
and
Copilot
committed
Remove internal project references from comments

jiafatom
and
Copilot
committed
Address review comments: fix task type extraction, formatting, and docs

jiafatom
and
Copilot
committed
Address PR review comments and add public dataset examples

jiafatom
and
Copilot
committed
Address PR review comments for vision evaluation metrics

jiafatom
and
Copilot
committed
Remove redundant MagicMock reimport in vision metric tests

jiafatom
and
Copilot
committed