Announce evaluator fixes and leaderboard update

README.md

@@ -16,6 +16,7 @@ The benchmark currently covers **47 tasks** across computing, quantum informatio
 
 ## News
 
+- **2026-09-16** — **Evaluator fixes and leaderboard update.** Following community feedback, we strengthened candidate–evaluator isolation and corrected validation issues in tasks included in the leaderboard. We reviewed affected submissions and reran evaluations or independently recomputed scores where needed. Task scores, medal thresholds, and the v1/v1-lite leaderboards have been updated accordingly. These corrections address cases where invalid solutions or manipulated scores could previously receive credit. Thanks to the community for reporting these issues and helping improve the benchmark. See the [updated leaderboard](leaderboard/README.md).
 - **2026-06-30** — **New scoring metric: the Medal Score (gold/silver/bronze).** Alongside average rank, we now release a peer-relative *Medal Score* (normalized to `[0,1]`). On each task the top-3 best-feasible scores in the v1 snapshot are frozen as gold/silver/bronze baselines; a model earns 1.00 / 0.67 / 0.33 for reaching each, averaged over the task set, and is reported on both v1 (47 tasks) and v1-lite (10 tasks). It rewards only reaching each task's frontier and ignores negligible long-tail margins, making cross-task aggregation fairer. Per-task podium values and the leaderboard live in [`leaderboard/`](leaderboard/README.md).
 - **2026-06-30** — **`v1-lite` released.** A 10-task representative subset of `v1` covering all five categories with distinct benchmark families, selected for tasks whose scores climb gradually under budget (not one-shot-saturated or all-or-nothing). Run it with `frontier_eval/conf/batch/v1_lite.yaml`.
 - **2026-07-17** — **Version branches clarified.** The historical baseline has been frozen at `v1-arxiv` for reproducibility and arXiv-era compatibility. Active development for the next version is now tracked on `main`, and community contributions are welcome there.

README_zh-CN.md

@@ -10,6 +10,7 @@ Frontier-Eng 是一个面向 **generative optimization** 的 benchmark：Agent 
 
 ## News
 
+- **2026-09-16** — **评测器修复与榜单更新。** 根据社区反馈，我们加强了榜单所涉及任务中候选代码与评分器之间的隔离，并修复了正确性校验问题。我们审查了受影响的提交，按需重新评测或独立重算分数，并据此更新了逐题成绩、奖牌门槛及 v1/v1-lite 榜单。这些修正解决了此前部分无效解或被篡改的分数可能获得成绩的问题。感谢社区帮助发现这些问题，推动评测改进。查看[更新后的榜单](leaderboard/README.md)。
 - **2026-06-30** — **新增评测指标：金银铜 Medal Score。** 在 average rank 之外，我们发布同侪相对的 *Medal Score*（归一化到 `[0,1]`）：每道题取 v1 snapshot 中最好的前三名分数冻结为金/银/铜 baseline，模型达到金/银/铜分别得 1.00 / 0.67 / 0.33，对题集求均值；同时汇报 v1（47 题）与 v1-lite（10 题）。它只奖励"达到该题最前沿（领奖台）"，忽略长尾里可忽略的微小差距，使跨题汇总更公平。每题 podium 分数与榜单见 [`leaderboard/`](leaderboard/README.md)。
 - **2026-06-30** — **发布 `v1-lite`。** `v1` 的 10 题代表性子集，覆盖全部五大类、family 各不相同，专选"分数随预算逐步提升（而非一步做满或非高即低）"的题，配置见 `frontier_eval/conf/batch/v1_lite.yaml`。
 - **2026-07-17** — **版本分支说明。** 过往论文版本已冻结为 `v1-arxiv` 分支，用于复现与对标基线；当前 `main` 作为新版本开发主线，欢迎大家持续在 `main` 提交贡献。