Skip to content

chore(deps): update bencherdev/bencher action to v0.6.3#616

Merged
stuebingerb merged 1 commit intomainfrom
renovate/bencherdev-bencher-0.x
Apr 24, 2026
Merged

chore(deps): update bencherdev/bencher action to v0.6.3#616
stuebingerb merged 1 commit intomainfrom
renovate/bencherdev-bencher-0.x

Conversation

@renovate
Copy link
Copy Markdown
Contributor

@renovate renovate Bot commented Apr 24, 2026

This PR contains the following updates:

Package Type Update Change
bencherdev/bencher action patch v0.6.2v0.6.3

Release Notes

bencherdev/bencher (bencherdev/bencher)

v0.6.3

Compare Source

  • Fix sample standard deviation for Z-score, t-test, and Log Normal Thresholds to use Bessel's correction (divide by n − 1) (Thank you @​ggirol-rc)
  • Fix t-test Threshold to use the prediction interval (scale the standard deviation by √(1 + 1/n)) so the boundary tests whether a new Metric is consistent with the historical distribution rather than whether it contains the historical mean (Thank you @​ggirol-rc)
  • Existing Thresholds will produce slightly wider (statistically correct) boundaries; no configuration changes required
  • Fix Alert JSON to return the Spec for the Report in which the Alert was generated instead of the Testbed's current Spec
  • BREAKING CHANGE Rename runner token to runner key across the API, CLI, and environment variables
  • Fix race condition where concurrent branch creation could cause a "branch head is null" 500 error (Thank you @​vmelamed)
  • Self-heal legacy Branches whose head_id is still NULL from the race condition above so subsequent bencher run submissions succeed instead of 500ing (Thank you @​vmelamed)
  • Add API token revocation with bencher token revoke and Revoke button in the Console

Configuration

📅 Schedule: (UTC)

  • Branch creation
    • At any time (no schedule defined)
  • Automerge
    • At any time (no schedule defined)

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.


Summary by cubic

Update bencherdev/bencher GitHub Action to v0.6.3 in all benchmark workflows. This brings statistical correctness fixes, race-condition hardening, improved alerts, and token revocation.

  • Migration
    • If you pass a runner credential, rename any “runner token” env/secret to “runner key” (e.g., use BENCHER_RUNNER_KEY). No other changes needed.

Written for commit 3e37103. Summary will update on new commits.

Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 3 files

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 24, 2026

🐰 Bencher Report

Branchrenovate/bencherdev-bencher-0.x
Testbedubuntu-latest
Click to view all benchmark results
BenchmarkThroughputBenchmark Result
operations / second (ops/s)
(Result Δ%)
Lower Boundary
operations / second (ops/s)
(Limit %)
com.apurebase.kgraphql.FunctionExecutionBenchmark.benchmarkFunctionExecution📈 view plot
🚷 view threshold
7,233,787.38 ops/s
(+23.24%)Baseline: 5,869,764.25 ops/s
5,202,227.37 ops/s
(71.92%)
com.apurebase.kgraphql.ParallelExecutionBenchmark.queryBenchmark📈 view plot
🚷 view threshold
1.30 ops/s
(+0.06%)Baseline: 1.30 ops/s
1.30 ops/s
(99.72%)
com.apurebase.kgraphql.QueryBenchmark.executionError📈 view plot
🚷 view threshold
26,777.20 ops/s
(+58.82%)Baseline: 16,859.58 ops/s
11,523.39 ops/s
(43.03%)
com.apurebase.kgraphql.QueryBenchmark.inputFromDocument📈 view plot
🚷 view threshold
30,905.45 ops/s
(+42.10%)Baseline: 21,749.82 ops/s
15,854.40 ops/s
(51.30%)
com.apurebase.kgraphql.QueryBenchmark.inputFromVariable📈 view plot
🚷 view threshold
29,738.88 ops/s
(+43.86%)Baseline: 20,671.38 ops/s
15,335.21 ops/s
(51.57%)
com.apurebase.kgraphql.QueryBenchmark.largeList📈 view plot
🚷 view threshold
5.36 ops/s
(+19.56%)Baseline: 4.48 ops/s
3.88 ops/s
(72.46%)
com.apurebase.kgraphql.QueryBenchmark.largeListWithFragment📈 view plot
🚷 view threshold
6.04 ops/s
(+21.84%)Baseline: 4.95 ops/s
4.31 ops/s
(71.35%)
com.apurebase.kgraphql.QueryBenchmark.manyChildren📈 view plot
🚷 view threshold
244.47 ops/s
(+30.17%)Baseline: 187.81 ops/s
155.62 ops/s
(63.66%)
com.apurebase.kgraphql.QueryBenchmark.manyChildrenWithFragment📈 view plot
🚷 view threshold
280.80 ops/s
(+32.19%)Baseline: 212.42 ops/s
173.71 ops/s
(61.86%)
com.apurebase.kgraphql.QueryBenchmark.manyDataChildren📈 view plot
🚷 view threshold
9.18 ops/s
(+2.72%)Baseline: 8.94 ops/s
8.84 ops/s
(96.29%)
com.apurebase.kgraphql.QueryBenchmark.manyOperations📈 view plot
🚷 view threshold
364.09 ops/s
(+29.61%)Baseline: 280.91 ops/s
226.39 ops/s
(62.18%)
com.apurebase.kgraphql.QueryBenchmark.manyOperationsWithFragment📈 view plot
🚷 view threshold
374.14 ops/s
(+30.22%)Baseline: 287.30 ops/s
229.87 ops/s
(61.44%)
com.apurebase.kgraphql.QueryBenchmark.nestedObject📈 view plot
🚷 view threshold
11,788.50 ops/s
(+58.30%)Baseline: 7,447.16 ops/s
6,216.81 ops/s
(52.74%)
com.apurebase.kgraphql.RequestCachingBenchmark.invalidRequest📈 view plot
🚷 view threshold
290,315.20 ops/s
(+28.85%)Baseline: 225,308.89 ops/s
208,694.39 ops/s
(71.89%)
com.apurebase.kgraphql.RequestCachingBenchmark.largeRequest📈 view plot
🚷 view threshold
11,424.56 ops/s
(+48.27%)Baseline: 7,705.19 ops/s
6,464.87 ops/s
(56.59%)
com.apurebase.kgraphql.RequestCachingBenchmark.smallRequest📈 view plot
🚷 view threshold
17,452.17 ops/s
(+55.12%)Baseline: 11,250.69 ops/s
9,137.91 ops/s
(52.36%)
com.apurebase.kgraphql.SimpleExecutionOverheadBenchmark.benchmark📈 view plot
🚷 view threshold
626,189.89 ops/s
(+32.79%)Baseline: 471,558.92 ops/s
452,276.91 ops/s
(72.23%)
🐰 View full continuous benchmarking report in Bencher

@stuebingerb stuebingerb merged commit d64c08a into main Apr 24, 2026
12 checks passed
@stuebingerb stuebingerb deleted the renovate/bencherdev-bencher-0.x branch April 24, 2026 08:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant