Skip to content

data(mobile): import sady36 market variants#40

Merged
Seungpyo1007 merged 8 commits into
mainfrom
data/import-staging
Jun 20, 2026
Merged

data(mobile): import sady36 market variants#40
Seungpyo1007 merged 8 commits into
mainfrom
data/import-staging

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Jun 20, 2026

Copy link
Copy Markdown
Member

Summary

  • import sady36/mobile-phones-specs market variants as unverified mobile records
  • keep country/market, memory, network/model-number variants as separate records
  • refresh public v1 smartphone/tablet list and detail snapshots

Imported data

  • total added records: 23,450
  • smartphones: 23,354
  • tablets: 96
  • years: 2015 31, 2016 119, 2017 371, 2018 4,081, 2019 4,633, 2020 4,372, 2021 4,022, 2022 4,705, 2023 1,116
  • source: https://www.kaggle.com/datasets/sady36/mobile-phones-specs
  • verification state: all imported records use verified: false

Verification

  • python -m app.validate PASS
  • python TechEngine\integrity_check.py data --strict PASS
  • git diff --check origin/main...HEAD PASS
  • cd site && npm.cmd run build PASS

Closes #1

@Seungpyo1007 Seungpyo1007 added data Dataset changes enhancement New feature or request labels Jun 20, 2026
@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Jun 20, 2026
@Seungpyo1007 Seungpyo1007 mentioned this pull request Jun 20, 2026
Open
@TechEngineBot

TechEngineBot commented Jun 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
python integrity_check.py TechAPI/data --strict PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 23354 0 0 0 23354 23354
tablet 96 0 0 0 96 96
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

smartphone added

  • smartphone/acer/2022/sospiro-a60-latam/acer-sospiro-a60-latam-sady36-mexico-2gb-32gb.json - Sospiro A60 LATAM
  • smartphone/alcatel/2016/one-touch-pixi-4-4-0-dual-sim-latam-4034e/alcatel-one-touch-pixi-4-4-0-dual-sim-latam-4034e-sady36-brazil-1gb-8gb.json - One Touch Pixi 4 4.0 Dual SIM LATAM 4034E
  • smartphone/alcatel/2016/one-touch-pixi-4-4-0-dual-sim-latam-4034e/alcatel-one-touch-pixi-4-4-0-dual-sim-latam-4034e-sady36-germany-1gb-8gb.json - One Touch Pixi 4 4.0 Dual SIM LATAM 4034E
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-3g-dual-sim-emea-5010d/alcatel-one-touch-pixi-4-5-0-3g-dual-sim-emea-5010d-sady36-italy-1gb-8gb.json - One Touch Pixi 4 5.0 3G Dual SIM EMEA 5010D
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-3g-dual-sim-emea-5010d/alcatel-one-touch-pixi-4-5-0-3g-dual-sim-emea-5010d-sady36-uk-1gb-8gb.json - One Touch Pixi 4 5.0 3G Dual SIM EMEA 5010D
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-3g-emea-5010x/alcatel-one-touch-pixi-4-5-0-3g-emea-5010x-sady36-italy-1gb-8gb.json - One Touch Pixi 4 5.0 3G EMEA 5010X
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-3g-emea-5010x/alcatel-one-touch-pixi-4-5-0-3g-emea-5010x-sady36-uk-1gb-8gb.json - One Touch Pixi 4 5.0 3G EMEA 5010X
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-3g-latam-5010g/alcatel-one-touch-pixi-4-5-0-3g-latam-5010g-sady36-chile-1gb-8gb.json - One Touch Pixi 4 5.0 3G LATAM 5010G
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-3g-latam-5010g/alcatel-one-touch-pixi-4-5-0-3g-latam-5010g-sady36-mexico-1gb-8gb.json - One Touch Pixi 4 5.0 3G LATAM 5010G
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-lite-3g-dual-sim-latam-5010e/alcatel-one-touch-pixi-4-5-0-lite-3g-dual-sim-latam-5010e-sady36-brazil-1gb-8gb.json - One Touch Pixi 4 5.0 LITE 3G Dual SIM LATAM 5010E
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-lte-emea-5045x/alcatel-one-touch-pixi-4-5-0-lte-emea-5045x-sady36-italy-1gb-8gb.json - One Touch Pixi 4 5.0 LTE EMEA 5045X
  • smartphone/alcatel/2016/one-touch-pixi-4-5-0-lte-emea-5045x/alcatel-one-touch-pixi-4-5-0-lte-emea-5045x-sady36-uk-1gb-8gb.json - One Touch Pixi 4 5.0 LTE EMEA 5045X
  • smartphone/alcatel/2016/one-touch-pixi-unite-a466bg/alcatel-one-touch-pixi-unite-a466bg-sady36-usa-1gb-8gb.json - One Touch Pixi Unite A466BG
  • smartphone/alcatel/2016/one-touch-pop-4-plus-dual-sim-lte-am-5056e-pop-4-plus/alcatel-one-touch-pop-4-plus-dual-sim-lte-am-5056e-pop-4-plus-sady36-canada-2gb-16gb.json - One Touch Pop 4 Plus Dual SIM LTE AM 5056E / Pop 4+
  • smartphone/alcatel/2016/one-touch-pop-4-plus-dual-sim-lte-am-5056e-pop-4-plus/alcatel-one-touch-pop-4-plus-dual-sim-lte-am-5056e-pop-4-plus-sady36-ecuador-2gb-16gb.json - One Touch Pop 4 Plus Dual SIM LTE AM 5056E / Pop 4+
  • ... 23339 more

tablet added

  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-australia-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-austria-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-belgium-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-canada-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-czech-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-finland-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-france-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-256gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-256gb-g9fpl-sady36-germany-12gb-256gb.json - Pixel Fold 5G UW Global TD-LTE 256GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-512gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-512gb-g9fpl-sady36-australia-12gb-512gb.json - Pixel Fold 5G UW Global TD-LTE 512GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-512gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-512gb-g9fpl-sady36-austria-12gb-512gb.json - Pixel Fold 5G UW Global TD-LTE 512GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-512gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-512gb-g9fpl-sady36-belgium-12gb-512gb.json - Pixel Fold 5G UW Global TD-LTE 512GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-512gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-512gb-g9fpl-sady36-canada-12gb-512gb.json - Pixel Fold 5G UW Global TD-LTE 512GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-512gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-512gb-g9fpl-sady36-czech-12gb-512gb.json - Pixel Fold 5G UW Global TD-LTE 512GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-512gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-512gb-g9fpl-sady36-finland-12gb-512gb.json - Pixel Fold 5G UW Global TD-LTE 512GB G9FPL
  • tablet/google/2023/pixel-fold-5g-uw-global-td-lte-512gb-g9fpl/google-pixel-fold-5g-uw-global-td-lte-512gb-g9fpl-sady36-france-12gb-512gb.json - Pixel Fold 5G UW Global TD-LTE 512GB G9FPL
  • ... 81 more

Heuristic review

  • Added records by manufacturer/brand: samsung: 4433, xiaomi: 2966, oppo: 2680, huawei: 2380, motorola: 1664, apple: 1160, nokia: 999, lg: 877

  • Added records by source class: kaggle: 23450

  • Heuristic warnings: 4 total; showing first 4.

    • smartphone: smartphone/fujitsu/2019/raku-raku-me-f-01l/fujitsu-raku-raku-me-f-01l-sady36-japan-3gb-32gb.json: repeated adjacent word in name
    • smartphone: smartphone/fujitsu/2022/raku-raku-easy-smartphone-td-lte-jp-f-52b/fujitsu-raku-raku-easy-smartphone-td-lte-jp-f-52b-sady36-japan-4gb-64gb.json: repeated adjacent word in name
    • smartphone: smartphone/samsung/2019/sm-a202j-galaxy-a20-wimax-2-plus-scv46-scv46-u/samsung-sm-a202j-galaxy-a20-wimax-2-plus-scv46-scv46-u-sady36-japan-3gb-32gb.json: repeated adjacent word in name
    • smartphone: smartphone/sharp/2019/aquos-sense-3-wimax-2-plus-shv45-shv45-u/sharp-aquos-sense-3-wimax-2-plus-shv45-shv45-u-sady36-japan-4gb-64gb.json: repeated adjacent word in name

@TechEngineBot

TechEngineBot commented Jun 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 189 0 60 129 60 0.0%
soc 2104 58 2046 0 2104 2.8%
smartphone 69125 184 68941 0 69125 0.3%
tablet 1448 0 1448 0 1448 0.0%
watch 194 0 194 0 194 0.0%
pda 110 0 110 0 110 0.0%
gpu 2030 0 2030 0 2030 0.0%
cpu 3977 976 3001 0 3977 24.5%
all 79177 1218 77830 129 79048 1.5%

Warning

Tracked verified coverage is below 50% for brand 0.0% (0/60), tablet 0.0% (0/1448), watch 0.0% (0/194), pda 0.0% (0/110), gpu 0.0% (0/2030), smartphone 0.3% (184/69125), all 1.5% (1218/79048), soc 2.8% (58/2104), and 1 more.
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py --strict
loaded CPU=3977 GPU=2030
✅ integrity gate: no hard anomalies.
Integrity section Flagged lines
structural 0
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 152
GPU cross-source ratio outliers + sanity 18

@Seungpyo1007 Seungpyo1007 force-pushed the data/import-staging branch from f63c87a to 6e31839 Compare June 20, 2026 18:43
@github-actions github-actions Bot added the ci CI and workflow changes label Jun 20, 2026
@Seungpyo1007 Seungpyo1007 merged commit 70e6bf9 into main Jun 20, 2026
4 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Jun 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@Seungpyo1007 Seungpyo1007

@TechEngineBot TechEngineBot

Labels

ci CI and workflow changes data Dataset changes enhancement New feature or request

Projects

TechAPI-Project
Status: Done

Milestone

Massive dataset rebuild (1989-2026)

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants

@Seungpyo1007 @TechEngineBot