Skip to content

Weekly Coverage Report #3

Description

@github-actions

ModelSpec Weekly Coverage Report

Generated automatically | 1143 valid cards, 0 errors

Summary

Metric Value
Total models 1143
Valid cards 1143
Invalid cards 0
Providers 47
Avg completeness 12.7%
Models without benchmarks 594
Models without cost data 663
Models without parameters 132

Provider Breakdown

Provider Cards Avg Completeness
01-ai 21 13.0%
ai21 14 12.2%
allen-ai 30 12.5%
anthropic 23 13.4%
baai 30 12.5%
baichuan 15 12.3%
black-forest-labs 20 12.0%
cerebras 4 12.2%
cohere 12 12.3%
deepseek 32 13.7%
google 117 12.8%
ibm 40 12.3%
inception 4 11.7%
intfloat 12 12.2%
jina 20 12.5%
kakao 1 12.2%
liquid 10 12.3%
meta 50 13.3%
microsoft 50 12.4%
minimax 6 12.9%
mistral 55 13.1%
moondream 2 12.2%
moonshot 6 12.7%
nomic 15 12.9%
nous-research 20 13.6%
nvidia 50 12.9%
openai 51 13.1%
openbmb 15 12.3%
perplexity 4 11.3%
qwen 110 12.6%
rwkv 20 12.2%
salesforce 30 12.2%
samsung 2 11.9%
sentence-transformers 20 12.1%
skywork 10 13.0%
snowflake 14 12.4%
stability 30 12.3%
stepfun 3 11.8%
teknium 5 13.4%
tencent 30 12.2%
tii 30 12.5%
together 15 12.5%
unsloth 20 13.4%
upstage 3 11.6%
voyage 6 10.0%
xai 25 12.9%
zhipu 41 12.4%

Top 10 Most Complete

Model Completeness Benchmarks Cost Parameters
anthropic/claude-opus-4-6 17.2% yes yes n/a
qwen/qwen3-30b-a3b 16.7% yes yes 30,000,000,000
meta/llama-3-1-70b-instruct 16.3% yes yes 70,000,000,000
meta/llama-3-1-70b 16.2% yes yes 70,000,000,000
meta/llama-3-1-8b-instruct 15.9% yes yes 8,000,000,000
nous-research/hermes-3-llama-3-1-8b 15.9% yes yes 8,000,000,000
nvidia/llama-3-1-8b-instruct-fp8 15.9% yes yes 8,000,000,000
deepseek/deepseek-v3-2 15.7% yes yes 671,000,000,000
meta/llama-3-1-8b 15.7% yes yes 8,000,000,000
nvidia/llama-3-3-70b-instruct-nvfp4 15.7% yes yes 70,000,000,000

Top 10 Least Complete

Model Completeness Benchmarks Cost Parameters
qwen/qwen3-asr-flash 11.1% no yes n/a
qwen/qwen3-tts-12hz-1-7b-base 11.1% no no 1,700,000,000
cohere/c4ai-aya-vision-32b 10.9% no no 32,000,000,000
cohere/c4ai-aya-vision-8b 10.9% no no 8,000,000,000
voyage/voyage-3-lite 10.0% yes no n/a
voyage/voyage-3 10.0% yes no n/a
voyage/voyage-code-3 10.0% yes no n/a
voyage/voyage-finance-2 10.0% yes no n/a
voyage/voyage-law-2 10.0% yes no n/a
voyage/voyage-multilingual-2 10.0% yes no n/a

Models Without Benchmarks (594 total)

Show list
  • ai21/ai21-jamba-large-1-5
  • ai21/ai21-jamba-large-1-6
  • ai21/ai21-jamba-mini-1-5
  • ai21/ai21-jamba-mini-1-6
  • ai21/ai21-jamba-mini-1-7
  • ai21/ai21-jamba-reasoning-3b-gguf
  • ai21/ai21-jamba-reasoning-3b
  • ai21/ai21-jamba2-3b
  • ai21/ai21-jamba2-mini-fp8
  • ai21/ai21-jamba2-mini
  • ai21/jamba-tiny-dev
  • ai21/jamba-tiny-random
  • ai21/jamba-tiny-reward-dev
  • allen-ai/biomed-roberta-base
  • allen-ai/led-base-16384
  • allen-ai/longformer-base-4096
  • allen-ai/molmo-7b-d-0924
  • allen-ai/molmo2-4b
  • allen-ai/molmo2-8b
  • allen-ai/molmo2-o-7b
  • allen-ai/molmo2-videopoint-4b
  • allen-ai/molmopoint-vid-4b
  • allen-ai/olmo-2-0425-1b-instruct
  • allen-ai/olmo-2-0425-1b
  • allen-ai/olmo-3-1-32b-instruct
  • allen-ai/olmo-3-1025-7b
  • allen-ai/olmo-3-1125-32b
  • allen-ai/olmo-3-7b-instruct-sft
  • allen-ai/olmo-3-7b-instruct
  • allen-ai/olmo-3-7b-think
  • allen-ai/olmo-hybrid-7b
  • allen-ai/olmocr-2-7b-1025-fp8
  • allen-ai/olmocr-2-7b-1025
  • allen-ai/olmocr-7b-0225-preview
  • allen-ai/scibert-scivocab-uncased
  • allen-ai/specter2-base
  • allen-ai/unifiedqa-t5-small
  • allen-ai/wildguard
  • baai/altclip
  • baai/aquilachat-7b
  • baai/aquilachat2-7b
  • baai/bge-reranker-base
  • baai/bge-reranker-large
  • baai/bge-reranker-v2-gemma
  • baai/emu3-chat-hf
  • baai/emu3-visiontokenizer
  • baai/llm-embedder
  • baai/robobrain2-5-8b-nv
  • baai/seggpt-vit-large
  • baichuan/baichuan-13b-base

... and 544 more

Models Without Cost Data (663 total)

Show list
  • 01-ai/yi-1-5-6b-chat
  • 01-ai/yi-1-5-6b
  • 01-ai/yi-34b-200k
  • 01-ai/yi-34b-chat
  • 01-ai/yi-34b
  • 01-ai/yi-6b-200k
  • 01-ai/yi-6b-chat-4bits
  • 01-ai/yi-6b-chat
  • 01-ai/yi-6b
  • 01-ai/yi-9b-200k
  • 01-ai/yi-9b
  • 01-ai/yi-coder-9b-chat
  • 01-ai/yi-coder-9b
  • ai21/ai21-jamba-large-1-5
  • ai21/ai21-jamba-large-1-6
  • ai21/ai21-jamba-mini-1-5
  • ai21/ai21-jamba-mini-1-6
  • ai21/ai21-jamba-mini-1-7
  • ai21/ai21-jamba-reasoning-3b-gguf
  • ai21/ai21-jamba-reasoning-3b
  • ai21/ai21-jamba2-3b
  • ai21/ai21-jamba2-mini-fp8
  • ai21/ai21-jamba2-mini
  • ai21/jamba-tiny-dev
  • ai21/jamba-tiny-random
  • ai21/jamba-tiny-reward-dev
  • ai21/jamba-v0-1
  • allen-ai/biomed-roberta-base
  • allen-ai/led-base-16384
  • allen-ai/longformer-base-4096
  • allen-ai/molmo-7b-d-0924
  • allen-ai/molmo2-4b
  • allen-ai/molmo2-8b
  • allen-ai/molmo2-o-7b
  • allen-ai/molmo2-videopoint-4b
  • allen-ai/molmopoint-vid-4b
  • allen-ai/olmo-1b-hf
  • allen-ai/olmo-hybrid-7b
  • allen-ai/olmocr-2-7b-1025-fp8
  • allen-ai/olmocr-2-7b-1025
  • allen-ai/olmocr-7b-0225-preview
  • allen-ai/olmoe-1b-7b-0125-instruct
  • allen-ai/olmoe-1b-7b-0125
  • allen-ai/olmoe-1b-7b-0924
  • allen-ai/scibert-scivocab-uncased
  • allen-ai/specter2-base
  • allen-ai/unifiedqa-t5-small
  • allen-ai/wildguard
  • baai/altclip
  • baai/aquilachat-7b

... and 613 more


Last updated: 2026-06-15T10:06:09.581Z

Metadata

Metadata

Assignees

No one assigned

    Labels

    coverage-reportAutomated weekly coverage report

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions