OCPBUGS-90135: Reduce parallelism for oc mirror#727
Conversation
openshift-ci-robot
added
jira/valid-reference
|
@bfournie: This pull request references Jira Issue OCPBUGS-90135, which is valid. The bug has been moved to the POST state. 3 validation(s) were run on this bug
The bug has been updated to refer to the pull request using the external bug tracker. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: bfournie The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
openshift-ci
Bot
added
the
approved
bfournie
force-pushed
the
mirror-parallel
branch
from
19a0644 to
99c926d
Compare
|
@bfournie: This pull request references Jira Issue OCPBUGS-90135, which is valid. 3 validation(s) were run on this bug
DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
bfournie
force-pushed
the
mirror-parallel
branch
from
99c926d to
7654ea7
Compare
It's really a big jump from the current ~22m |
| templateImageExtract = "oc image extract --path %s:%s --confirm %s" | ||
| templateGetMetadata = "oc adm release info %s -o json" | ||
| ocMirror = "oc mirror --v2 --config=%s docker://127.0.0.1:%d --workspace=file://%s --src-tls-verify=false --dest-tls-verify=false --parallel-images=4 --parallel-layers=4 --retry-times=10" | ||
| ocMirror = "oc mirror --v2 --config=%s docker://127.0.0.1:%d --workspace=file://%s --src-tls-verify=false --dest-tls-verify=false --parallel-images=2 --parallel-layers=4 --retry-times=5" |
There was a problem hiding this comment.
I'd try with --parallel-images=3
There was a problem hiding this comment.
Let's try that. Updated. We'll see the affect on execution time
There was a problem hiding this comment.
Using parallel-images=3...
2026-06-24 09:08:51 ISOBuilder execution time: 40m 46s
The fix openshift#722 increased the retry times to help allievate the oc mirror failures; this helped but didn't resolve the issue. Decrease the parallel images being used to attempt to increase reliability of this command.
bfournie
force-pushed
the
mirror-parallel
branch
from
7654ea7 to
dc6b20e
Compare
|
@bfournie: all tests passed! Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
|
/lgtm |
|
Based on the logs I'm not convinced this is gonna help. A single dropped connection will kill the whole mirroring, and I can't immediately think of a reason that having fewer connections in parallel makes it less likely for one to be dropped (unless Akamai thinks we're part of a DDOS?). |
|
@bfournie: Jira Issue OCPBUGS-90135: Some pull requests linked via external trackers have merged: The following pull request, linked via external tracker, has not merged:
All associated pull requests must be merged or unlinked from the Jira bug in order for it to move to the next state. Once unlinked, request a bug refresh with Jira Issue OCPBUGS-90135 has not been moved to the MODIFIED state. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
Let's test it directly now with the multi-pr. If not, we'll revert it |
5 participants
The fix #722 increased the retry times to help allievate the oc mirror failures; this helped but didn't resolve the issue. Decrease the parallel images being used to attempt to increase reliability of this command. Also add a retry mechanism on the entire oc command.