Skip to content

data(soc): derive gpu_cores from gpu_name (139 SoCs)#51

Merged
Seungpyo1007 merged 2 commits into
mainfrom
data/soc-gpu-cores
Jun 22, 2026
Merged

data(soc): derive gpu_cores from gpu_name (139 SoCs)#51
Seungpyo1007 merged 2 commits into
mainfrom
data/soc-gpu-cores

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Jun 22, 2026

Copy link
Copy Markdown
Member

SoC gpu_cores — derive from gpu_name for 139 SoCs

Many import-stub SoC records carry a gpu_name that already encodes the GPU core count (e.g. Mali-T880 MP12, Immortalis-G715 MC11, Apple GPU (5-core)) but leave gpu_cores empty. This fills gpu_cores by deterministically reading the count from the existing name — no new data is invented.

  • 139 SoCs filled (Mali MPx, Immortalis MCx, Apple (N-core)).
  • Additive only: records that already have gpu_cores (e.g. benchmark-enriched flagships) are left untouched.
  • Value clamped to 1–32 as a sanity guard.

Validation

  • python -m app.validate ✅ · integrity_check --strict ✅ · git diff --check clean
  • Dump (site/public/v1/socs) refreshed to match (139).

Closes #1

Deterministically fill the missing gpu_cores field from the core count already encoded in gpu_name (Mali MPx, Immortalis MCx, Apple GPU (N-core)) for import-stub SoCs that lacked it. Additive only: records that already have gpu_cores (e.g. benchmark-enriched flagships) are untouched. No new data invented - the count is read from the existing GPU name.

Refs #1
@github-actions github-actions Bot added data Dataset changes enhancement New feature or request labels Jun 22, 2026
@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Jun 22, 2026
@Seungpyo1007 Seungpyo1007 merged commit 75f7b76 into main Jun 22, 2026
4 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Jun 22, 2026
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
python integrity_check.py TechAPI/data --strict PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

  • No data file changes detected.

Heuristic review

  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 189 0 189 0 189 0.0%
soc 2104 58 2046 0 2104 2.8%
smartphone 90118 184 89934 0 90118 0.2%
tablet 3048 0 3048 0 3048 0.0%
watch 378 0 378 0 378 0.0%
pda 110 0 110 0 110 0.0%
gpu 2030 0 2030 0 2030 0.0%
cpu 3977 976 3001 0 3977 24.5%
all 101954 1218 100736 0 101954 1.2%

Warning

Tracked verified coverage is below 50% for brand 0.0% (0/189), tablet 0.0% (0/3048), watch 0.0% (0/378), pda 0.0% (0/110), gpu 0.0% (0/2030), smartphone 0.2% (184/90118), all 1.2% (1218/101954), soc 2.8% (58/2104), and 1 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py --strict
loaded CPU=3977 GPU=2030
✅ integrity gate: no hard anomalies.
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 152
GPU cross-source ratio outliers + sanity 18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants