chore: refresh benchmarks for v2.1.0 - #1372
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Repository YAML (base), Central YAML (inherited), Organization UI (inherited) Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
Included review availability: Your plan provides up to 4 included reviews per hour; 3 remain after this review. 📝 WalkthroughWalkthroughChangesBenchmark refresh
Estimated code review effort: 2 (Simple) | ~10 minutes Merge Risk: ⚪ Minimal · up to This PR refreshes benchmark data and documentation without changing product or runtime behavior; no actionable merge-blocking risk remains beyond normal checks and review. Possibly related PRs
Suggested reviewers: Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Full details: Docstring CoverageExplanation No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0 files. (2 skipped: 2 unsupported.) Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Greptile SummaryRefreshes published benchmark data for aube 2.1.0 and pnpm 11.23.0.
Confidence Score: 5/5The PR appears safe to merge because the refreshed benchmark data and generated README claim are internally consistent. No concrete correctness, security, build, or documentation failure remains in the changed files; the notable measurement variance does not establish that the recorded benchmark means are invalid. Important Files Changed
Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile |
Instruction counts
No instruction-count regression above 1%. Only instruction counts gate. Wall clock is shown for context — on identical hardware it moves 4-20% run to run. Measured by tak — instruction-counted CLI benchmarks, stored in this repository's git notes.
|
🤖 Refreshed benchmarks
benchmarks/results.jsonwas pinned to aube2.0.1; the workspace is now2.1.0. Re-ranmise run bench:bumpon the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regeneratedbenchmarks/results.jsonplus the READMEBENCH_RATIOSblock. The benchmark matrix pins aube's GVS mode vianpm_config_enable_global_virtual_store=true|false(the auto-synthesized env alias for theenableGlobalVirtualStoresetting), so GitHub Actions' inheritedCI=trueenvironment does not change whether aube runs with GVS enabled or disabled.Benchmark changes
Versions:
Public ratios: warm installs vs Bun 3x -> 3x; warm installs vs pnpm 7x -> 7x; repeat test vs Bun 1.8x -> 1.8x; repeat test vs pnpm 20x -> 21x.
Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.
Once merged to main, the updated bench results flow into the next
release-plz-prrun automatically.Generated by the
bench-refreshworkflow.Note
Low Risk
Docs and benchmark JSON only; no product or runtime behavior changes.
Overview
Re-runs the hermetic benchmark suite and updates pinned results for the 2.1.0 release (pnpm 11.23.0).
benchmarks/results.jsongets new timings and stats across warm/cold fresh installs and repeatinstall && test. Notable shifts vs the prior pin include slower cold installs for pnpm (+39%) and noisier deno numbers on some scenarios; aube warm/cold and repeat-test rows stay in the same ballpark.The auto-generated
README.mdBENCH_RATIOSblock changes only the marketed repeat-test ratio vs pnpm from 20x to 21x; other headline ratios (7x vs pnpm warm, 3x vs Bun, 1.8x vs Bun on repeat test) are unchanged.Reviewed by Cursor Bugbot for commit a072a05. Bugbot is set up for automated code reviews on this repo. Configure here.
Summary by CodeRabbit