Skip to content

data(mobile): import Phones 2024 device records#36

Merged
Seungpyo1007 merged 5 commits into
mainfrom
data/import-staging
Jun 20, 2026
Merged

data(mobile): import Phones 2024 device records#36
Seungpyo1007 merged 5 commits into
mainfrom
data/import-staging

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Jun 20, 2026

Copy link
Copy Markdown
Member

Summary

  • import Phones 2024 JSON records from Kaggle with source-backed raw specs
  • add 2,726 smartphones, 417 tablets, and 96 watches as unverified records
  • split smartphone commits by era and mobile-device records by category
  • refresh public v1 dumps for smartphones, tablets, and watches

Source

Data policy

  • Bulk imported records are kept verified: false until manual/TechEngine audit.
  • Smartphone records were imported only when their SoC matched an existing TechAPI SoC.
  • Records outside schema/API ranges were skipped instead of coerced.

Verification

  • python -m app.validate PASS
  • python TechEngine\integrity_check.py data --strict PASS
  • cd site && npm.cmd run build PASS
  • git diff --check origin/main...HEAD PASS

Closes #1

@Seungpyo1007 Seungpyo1007 added data Dataset changes site Homepage and public site changes enhancement New feature or request labels Jun 20, 2026
@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Jun 20, 2026
@github-actions github-actions Bot mentioned this pull request Jun 20, 2026
Open
@TechEngineBot

TechEngineBot commented Jun 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
python integrity_check.py TechAPI/data --strict PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 2726 0 0 0 2726 2726
tablet 417 0 0 0 417 417
watch 96 0 0 0 96 96
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

smartphone added

  • smartphone/alcatel/2012/ot-997/alcatel-ot-997-1gb-4gb-3g.json - alcatel OT-997
  • smartphone/alcatel/2012/ot-997d/alcatel-ot-997d-1gb-4gb-3g.json - alcatel OT-997D
  • smartphone/alcatel/2013/fierce/alcatel-fierce-1gb-4gb-3g.json - alcatel Fierce
  • smartphone/alcatel/2013/idol-alpha/alcatel-idol-alpha-1gb-16gb-3g.json - alcatel Idol Alpha
  • smartphone/alcatel/2013/idol-s/alcatel-idol-s-1gb-4gb-4g-lte.json - alcatel Idol S
  • smartphone/alcatel/2013/one-touch-evo-8hd/alcatel-one-touch-evo-8hd-1gb-4gb-2g.json - alcatel One Touch Evo 8HD
  • smartphone/alcatel/2013/one-touch-idol-ultra/alcatel-one-touch-idol-ultra-1gb-16gb-3g.json - alcatel One Touch Idol Ultra
  • smartphone/alcatel/2013/one-touch-idol/alcatel-one-touch-idol-1gb-13gb-3g.json - alcatel One Touch Idol
  • smartphone/alcatel/2013/one-touch-m-pop/alcatel-one-touch-m-pop-1gb-4gb-3g.json - alcatel One Touch M'Pop
  • smartphone/alcatel/2013/one-touch-scribe-hd-lte/alcatel-one-touch-scribe-hd-lte-1gb-4gb-4g-lte.json - alcatel One Touch Scribe HD-LTE
  • smartphone/alcatel/2013/one-touch-scribe-hd/alcatel-one-touch-scribe-hd-1gb-4gb-3g.json - alcatel One Touch Scribe HD
  • smartphone/alcatel/2014/hero-2/alcatel-hero-2-2gb-16gb-4g-lte.json - alcatel Hero 2
  • smartphone/alcatel/2014/hero-8/alcatel-hero-8-2gb-32gb-4g-lte.json - alcatel Hero 8
  • smartphone/alcatel/2014/idol-x/alcatel-idol-x-2gb-32gb-3g.json - alcatel Idol X+
  • smartphone/alcatel/2014/pixi-7/alcatel-pixi-7-1gb-4gb-2g.json - alcatel Pixi 7
  • ... 2711 more

tablet added

  • tablet/alcatel/2013/one-touch-t10/alcatel-one-touch-t10-1gb-4gb-2g.json - alcatel One Touch T10
  • tablet/alcatel/2013/one-touch-tab-7-hd/alcatel-one-touch-tab-7-hd-1gb-8gb-2g.json - alcatel One Touch Tab 7 HD
  • tablet/alcatel/2013/one-touch-tab-7/alcatel-one-touch-tab-7-1gb-4gb-2g.json - alcatel One Touch Tab 7
  • tablet/alcatel/2019/smart-tab-7/alcatel-smart-tab-7-1-5gb-16gb-4g-lte.json - alcatel Smart Tab 7
  • tablet/apple/2010/ipad-wi-fi-3g/apple-ipad-wi-fi-3g-0-25gb-64gb-3g.json - Apple iPad Wi-Fi + 3G
  • tablet/apple/2010/ipad-wi-fi/apple-ipad-wi-fi-0-25gb-64gb-2g.json - Apple iPad Wi-Fi
  • tablet/apple/2011/ipad-2-cdma/apple-ipad-2-cdma-0-5gb-64gb-3g.json - Apple iPad 2 CDMA
  • tablet/apple/2011/ipad-2-wi-fi-3g/apple-ipad-2-wi-fi-3g-0-5gb-64gb-3g.json - Apple iPad 2 Wi-Fi + 3G
  • tablet/apple/2011/ipad-2-wi-fi/apple-ipad-2-wi-fi-0-5gb-64gb-2g.json - Apple iPad 2 Wi-Fi
  • tablet/apple/2012/ipad-3-wi-fi-cellular/apple-ipad-3-wi-fi-cellular-1gb-64gb-4g-lte.json - Apple iPad 3 Wi-Fi + Cellular
  • tablet/apple/2012/ipad-4-wi-fi-cellular/apple-ipad-4-wi-fi-cellular-1gb-128gb-4g-lte.json - Apple iPad 4 Wi-Fi + Cellular
  • tablet/apple/2012/ipad-4-wi-fi/apple-ipad-4-wi-fi-1gb-128gb-2g.json - Apple iPad 4 Wi-Fi
  • tablet/apple/2012/ipad-mini-wi-fi-cellular/apple-ipad-mini-wi-fi-cellular-0-5gb-64gb-4g-lte.json - Apple iPad mini Wi-Fi + Cellular
  • tablet/apple/2012/ipad-mini-wi-fi/apple-ipad-mini-wi-fi-0-5gb-64gb-2g.json - Apple iPad mini Wi-Fi
  • tablet/apple/2013/ipad-air/apple-ipad-air-1gb-128gb-4g-lte.json - Apple iPad Air
  • ... 402 more

watch added

  • watch/apple/2014/watch-38mm-1st-gen/apple-watch-38mm-1st-gen-0-5gb-8gb-2g.json - Apple Watch 38mm (1st gen)
  • watch/apple/2014/watch-42mm-1st-gen/apple-watch-42mm-1st-gen-0-5gb-8gb-2g.json - Apple Watch 42mm (1st gen)
  • watch/apple/2014/watch-edition-38mm-1st-gen/apple-watch-edition-38mm-1st-gen-0-5gb-8gb-2g.json - Apple Watch Edition 38mm (1st gen)
  • watch/apple/2014/watch-edition-42mm-1st-gen/apple-watch-edition-42mm-1st-gen-0-5gb-8gb-2g.json - Apple Watch Edition 42mm (1st gen)
  • watch/apple/2014/watch-sport-38mm-1st-gen/apple-watch-sport-38mm-1st-gen-0-5gb-8gb-2g.json - Apple Watch Sport 38mm (1st gen)
  • watch/apple/2014/watch-sport-42mm-1st-gen/apple-watch-sport-42mm-1st-gen-0-5gb-8gb-2g.json - Apple Watch Sport 42mm (1st gen)
  • watch/apple/2016/watch-edition-series-2-38mm/apple-watch-edition-series-2-38mm-0-5gb-8gb-2g.json - Apple Watch Edition Series 2 38mm
  • watch/apple/2016/watch-edition-series-2-42mm/apple-watch-edition-series-2-42mm-0-5gb-8gb-2g.json - Apple Watch Edition Series 2 42mm
  • watch/apple/2016/watch-series-1-aluminum-38mm/apple-watch-series-1-aluminum-38mm-0-5gb-8gb-2g.json - Apple Watch Series 1 Aluminum 38mm
  • watch/apple/2016/watch-series-1-aluminum-42mm/apple-watch-series-1-aluminum-42mm-0-5gb-8gb-2g.json - Apple Watch Series 1 Aluminum 42mm
  • watch/apple/2016/watch-series-2-38mm/apple-watch-series-2-38mm-0-5gb-8gb-2g.json - Apple Watch Series 2 38mm
  • watch/apple/2016/watch-series-2-42mm/apple-watch-series-2-42mm-0-5gb-8gb-2g.json - Apple Watch Series 2 42mm
  • watch/apple/2016/watch-series-2-aluminum-38mm/apple-watch-series-2-aluminum-38mm-0-5gb-8gb-2g.json - Apple Watch Series 2 Aluminum 38mm
  • watch/apple/2016/watch-series-2-aluminum-42mm/apple-watch-series-2-aluminum-42mm-0-5gb-8gb-2g.json - Apple Watch Series 2 Aluminum 42mm
  • watch/apple/2017/watch-edition-series-3/apple-watch-edition-series-3-0-75gb-16gb-4g-lte.json - Apple Watch Edition Series 3
  • ... 81 more

Heuristic review

  • Added records by manufacturer/brand: samsung: 394, vivo: 265, huawei: 238, lenovo: 185, zte: 183, xiaomi: 182, oppo: 172, lg: 167
  • Added records by source class: kaggle: 3239
  • Heuristic warnings: none found.

@TechEngineBot

TechEngineBot commented Jun 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 189 0 60 129 60 0.0%
soc 2079 58 2021 0 2079 2.8%
smartphone 42051 184 41867 0 42051 0.4%
tablet 1171 0 1171 0 1171 0.0%
watch 176 0 176 0 176 0.0%
pda 110 0 110 0 110 0.0%
gpu 2030 0 2030 0 2030 0.0%
cpu 3977 976 3001 0 3977 24.5%
all 51783 1218 50436 129 51654 2.4%

Warning

Tracked verified coverage is below 50% for brand 0.0% (0/60), tablet 0.0% (0/1171), watch 0.0% (0/176), pda 0.0% (0/110), gpu 0.0% (0/2030), smartphone 0.4% (184/42051), all 2.4% (1218/51654), soc 2.8% (58/2079), and 1 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py --strict
loaded CPU=3977 GPU=2030
✅ integrity gate: no hard anomalies.
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 152
GPU cross-source ratio outliers + sanity 18

@Seungpyo1007 Seungpyo1007 merged commit f471026 into main Jun 20, 2026
4 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Jun 20, 2026
@Seungpyo1007 Seungpyo1007 mentioned this pull request Jun 23, 2026
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@Seungpyo1007 Seungpyo1007

@TechEngineBot TechEngineBot

Labels

data Dataset changes enhancement New feature or request site Homepage and public site changes

Projects

TechAPI-Project
Status: Done

Milestone

Massive dataset rebuild (1989-2026)

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants

@Seungpyo1007 @TechEngineBot