Search results

[Bug] Qwen3.5-35B，textVQA评测，prediction目视正常，评测分数为0

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#212 In AISBench/benchmark;

· YuhanBai opened on Mar 23, 2026

[需求] 希望支持aime2026数据集的精度测试

content_check_passedissue content check passedissue content check passed

enhancementNew feature or requestNew feature or request

Status: Open.

#211 In AISBench/benchmark;

· chenweiqiang11 opened on Mar 23, 2026

[Bug] 使用自定义数据集，在模型输出正确答案的情况下，统计结果不准确

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#209 In AISBench/benchmark;

· xiaobaitu-lh opened on Mar 20, 2026

[Bug] 在工具性能测试的所有请求推理完成后，卡在数据统计阶段，没有输出结果。

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#205 In AISBench/benchmark;

· DangKan2 opened on Mar 19, 2026

[疑问] MMLU_PRO如何看总分

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#199 In AISBench/benchmark;

· SJTUyh opened on Mar 18, 2026

[疑问] 精度测试适配于哪些模型？

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#197 In AISBench/benchmark;

· cxj01 opened on Mar 17, 2026

[Bug] TextVQA，输出predcition正确，但是result精度为0

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#187 In AISBench/benchmark;

· MansonX opened on Mar 12, 2026

[Bug] 测试完成后解析结果的时候发生报错，提示需设置trust_remote_code=True

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#183 In AISBench/benchmark;

· NSDie opened on Mar 11, 2026

[Bug] textvqa多模态测试预测结果为空，acc为0

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#166 In AISBench/benchmark;

· zy-charon opened on Mar 5, 2026

[文档] ARC-e下载结果与文档描述不符

content_check_passedissue content check passedissue content check passed

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#158 In AISBench/benchmark;

· JohnH868 opened on Mar 3, 2026

[文档] generated_prompts_path参数描述不够完善，可用数据集任务名称应为mooncake_trace_gen

content_check_passedissue content check passedissue content check passed

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#154 In AISBench/benchmark;

· liuyang-2026 opened on Feb 28, 2026

[疑问] aisbench哪里可以控制 不发 penalties 在配置文件里已经注释掉了

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#146 In AISBench/benchmark;

· chenghaitao1987 opened on Feb 11, 2026