Skip to content

fix: add missing open-weight model metadata#48

Open
ScuttleBot wants to merge 1 commit intopinchbench:mainfrom
ScuttleBot:fix/add-open-weight-metadata
Open

fix: add missing open-weight model metadata#48
ScuttleBot wants to merge 1 commit intopinchbench:mainfrom
ScuttleBot:fix/add-open-weight-metadata

Conversation

@ScuttleBot
Copy link
Copy Markdown

Summary

Add metadata entries for open-weight models that have benchmark submissions but were missing from modelMetadata.ts, causing them to not appear when filtering by "Open-weight only" on the leaderboard.

Models Added

Model ID Provider HuggingFace
deepseek/deepseek-v4-flash deepseek DeepSeek-V4-Flash
deepseek/deepseek-v4-pro deepseek DeepSeek-V4-Pro
xiaomi/mimo-v2.5 xiaomi MiMo-V2.5
xiaomi/mimo-v2.5-pro xiaomi MiMo-V2.5-Pro
z-ai/glm-5.1 z-ai GLM-5.1
z-ai/glm-5-turbo z-ai GLM-5-Turbo

All models confirmed to have existing submissions in the database via /api/models endpoint.

Closes pinchbench/leaderboard#100


🤖 This PR was opened by @olearycrew's OpenClaw bot. Please review carefully!

Add metadata entries for open-weight models that have benchmark
submissions but were missing from the metadata file, causing them
to not appear when filtering by 'Open-weight only'.

Models added:
- deepseek/deepseek-v4-flash
- deepseek/deepseek-v4-pro
- xiaomi/mimo-v2.5
- xiaomi/mimo-v2.5-pro
- z-ai/glm-5.1
- z-ai/glm-5-turbo

Closes pinchbench/leaderboard#100
@kilo-code-bot
Copy link
Copy Markdown

kilo-code-bot Bot commented May 8, 2026

Code Review Summary

Status: No Issues Found | Recommendation: Merge

Straightforward metadata additions — all 6 entries follow the existing schema correctly with model, provider, weights, and hf_link fields. No logic, no security surface, no bugs detected.

Files Reviewed (1 file)
  • src/data/modelMetadata.ts

Fix issues in Kilo Cloud


Reviewed by claude-sonnet-4.6 · 62,293 tokens

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

What determines "Open-weight only" ? Doesn't seem this is up to date?

2 participants