Skip to content

Relax arm64 CI jobs and align coverage with amd64#11835

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits into
masterfrom
alexeyk/relax-amd64-tests
Jul 2, 2026
Merged

Relax arm64 CI jobs and align coverage with amd64#11835
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits into
masterfrom
alexeyk/relax-amd64-tests

Conversation

@AlexeyKuznetsov-DD

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

  • Marks all *_arm64 test jobs as allow_failure: true on merge queue (mq-working-branch-*) and master by adding allow_failure to the shared .test_job_arm64 rules.
  • Fixes -PcheckCoverage on arm64 to match the amd64 jobs:
    • test_debugger_arm64: skip coverage on semeru8/semeru11/semeru17 (those disable some tests and can't reach the expected coverage).
    • test_base_arm64: run coverage only on JVM 8, mirroring test_base.

Motivation

arm64 tests were just introduced to the merge queue and master. Keeping them non-blocking lets us collect stability stats and fix flaky/failing jobs in a relaxed way without blocking the whole team. It also unbreaks the arm64 debugger job, which was failing coverage verification on Semeru JVMs (same root cause fixed for amd64 in #11807).

Additional Notes

  • ibm8/oracle8 never run on arm64 (excluded by .test_job_arm64 rules), so they're intentionally omitted from the debugger coverage condition.
  • allow_failure is temporary — remove it once the arm64 suite is proven stable.

Make arm64 tests non-blocking on merge queue and master while collecting
stability stats, and fix -PcheckCoverage setup to mirror the amd64 jobs.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Jul 2, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added type: bug fix Bug fix tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jul 2, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested a review from bric3 July 2, 2026 02:31
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review July 2, 2026 02:32
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested review from a team as code owners July 2, 2026 02:32
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested review from erikayasuda and removed request for a team July 2, 2026 02:32
@dd-octo-sts dd-octo-sts Bot added the tag: ai generated Largely based on code generated by an AI or LLM label Jul 2, 2026
@datadog-official

This comment has been minimized.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@dd-octo-sts

dd-octo-sts Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.01 s 13.94 s [-0.3%; +1.2%] (no difference)
startup:insecure-bank:tracing:Agent 12.97 s 12.98 s [-0.8%; +0.6%] (no difference)
startup:petclinic:appsec:Agent 16.48 s 16.39 s [-5.9%; +7.0%] (unstable)
startup:petclinic:iast:Agent 16.87 s 16.87 s [-0.8%; +0.7%] (no difference)
startup:petclinic:profiling:Agent 16.79 s 16.88 s [-2.0%; +0.9%] (no difference)
startup:petclinic:sca:Agent 16.87 s 16.25 s [-0.6%; +8.2%] (no difference)
startup:petclinic:tracing:Agent 15.70 s 16.02 s [-6.2%; +2.2%] (no difference)

Commit: 19745d8e · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@amarziali amarziali added this pull request to the merge queue Jul 2, 2026
@dd-octo-sts

dd-octo-sts Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351 Bot commented Jul 2, 2026

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-07-02 04:30:35 UTC ℹ️ Start processing command /merge


2026-07-02 04:30:39 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).


2026-07-02 05:34:45 UTC ℹ️ MergeQueue: This merge request was merged

@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jul 2, 2026
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot merged commit 4f5c4cc into master Jul 2, 2026
946 of 948 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot deleted the alexeyk/relax-amd64-tests branch July 2, 2026 05:34
@github-actions github-actions Bot added this to the 1.64.0 milestone Jul 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: ai generated Largely based on code generated by an AI or LLM tag: no release notes Changes to exclude from release notes type: bug fix Bug fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants