Skip to content

ci(#6655): increase dispatchWait from 12 to 18 minutes - #6657

Closed
fullsend-ai-coder[bot] wants to merge 1 commit into
mainfrom
agent/6655-increase-dispatch-wait
Closed

ci(#6655): increase dispatchWait from 12 to 18 minutes#6657
fullsend-ai-coder[bot] wants to merge 1 commit into
mainfrom
agent/6655-increase-dispatch-wait

Conversation

@fullsend-ai-coder

Copy link
Copy Markdown
Contributor

Summary

  • Increase dispatchWait timeout from 12 minutes to 18 minutes (50% headroom) in pkg/behaviourtest/drivers/ci/githubactions/githubactions.go
  • Fork PR behaviour tests were failing intermittently because workflows completed successfully but exceeded the 12-minute timeout (e.g., PR chore(dispatch): provide FULLSEND_WORK_ITEM_URL in addition to GITHUB_ISSUE_URL #6611 workflow finished in 12m16s, 16 seconds after the test gave up)
  • The dispatchMaxTry count (48) is unchanged — only the wait ceiling changes

Testing

  • All 55 tests in pkg/behaviourtest/drivers/ci/githubactions/ pass
  • go vet passes
  • No production code changed (this is test infrastructure), so no patch coverage impact

Closes #6655

Post-script verification

  • Branch is not main/master (agent/6655-increase-dispatch-wait)
  • Secret scan passed (gitleaks — d0d567bb7f882f797898e1d478948a4d82bfd1d6..HEAD)
  • PR body secret scan passed (gitleaks — no-git)

Fork PR behaviour tests fail intermittently because workflows
complete successfully but exceed the 12-minute dispatchWait
timeout. For example, PR #6611 had a workflow that completed
in 12m16s — 16 seconds after the test gave up waiting.

Increase dispatchWait to 18 minutes (50% headroom) to
accommodate normal variance in GitHub Actions execution time
while still catching genuine hangs. The dispatchMaxTry count
(48) is unchanged — only the wait ceiling changes.

Closes #6655
@fullsend-ai-coder
fullsend-ai-coder Bot requested a review from a team as a code owner August 26, 2026 19:46
@fullsend-ai-coder fullsend-ai-coder Bot added the ready-for-review Triggers review agent dispatch label Aug 26, 2026
@fullsend-ai-review

fullsend-ai-review Bot commented Aug 26, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 7:49 PM UTC · Completed 8:00 PM UTC

Commit: d397e02 · View workflow run →

Runtime: claude · Model: opus → claude-opus-4-6 · Effort: high · Cost: $2.52

@codecov

codecov Bot commented Aug 26, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@fullsend-ai-review fullsend-ai-review Bot added the risk/moderate PR risk: moderate label Aug 26, 2026
@fullsend-ai-review

Copy link
Copy Markdown

Risk Assessment: moderate (2/5)

Details

Single-line timeout constant bump in test infrastructure with perfect issue alignment and bot author, but the file's high recent churn (11 commits/30d) and regression history (8 fix/revert commits/90d) elevate risk slightly above low.

@fullsend-ai-review

Copy link
Copy Markdown

Looks good to me

@fullsend-ai-review fullsend-ai-review Bot added the ready-for-merge All reviewers approved — ready to merge label Aug 26, 2026
@ralphbean

Copy link
Copy Markdown
Member

In #6656, I figured out why they're so slow. Let's fix that, rather than extend the timeout.

@ralphbean ralphbean closed this Aug 26, 2026
@fullsend-ai-retro

fullsend-ai-retro Bot commented Aug 26, 2026

Copy link
Copy Markdown

🤖 Finished Retro · ✅ Success · Started 8:13 PM UTC · Completed 8:23 PM UTC

Commit: d397e02 · View workflow run →

Runtime: claude · Model: opus → claude-opus-4-6 · Effort: high · Cost: $3.79

@fullsend-ai-retro

Copy link
Copy Markdown

Retro: PR #6657 — Timeout extension closed in favor of root-cause fix

What happened

ralphbean created two companion issues simultaneously:

  • #6655: tactical fix — extend dispatchWait from 12 to 18 minutes
  • #6656: root-cause investigation into why fork PR workflows are slow

The code agent (run 33006220760, $1.73) faithfully implemented the prescribed single-line change in pkg/behaviourtest/drivers/ci/githubactions/githubactions.go. The review agent (run 33006987666, $2.52) approved with "Looks good to me" and assigned moderate risk (2/5). All CI checks passed.

Meanwhile, ralphbean investigated #6656 and discovered the root cause: test pool repos accumulate ~1.9GB of git history from repeated runs without cleanup, causing the pre-review shallow-clone deepening step to take 12+ minutes. He closed the PR without merging, commenting: "Let's fix that, rather than extend the timeout."

Analysis

Code agent performed well within its scope — the issue was highly prescriptive, the change was clean, conventions were followed, and cost was low ($1.73, 3 minutes wall time). The agent cannot be faulted for implementing exactly what was asked.

Review agent approved a symptomatic fix without surfacing the higher-order concern. The triage agent's comment on #6655 explicitly noted "#6656 tracks root cause investigation into why fork PR workflows are taking 12+ minutes." A human reviewer in this position would likely have said "this looks correct as a tactical fix, but consider whether it's still needed given the root-cause investigation in #6656." The review agent's intent-coherence sub-agent had access to this context but did not flag the relationship.

Total cost of discarded work: $4.25 (code + review). This is modest and partly reflects the natural cost of parallel exploration — the human was deliberately pursuing both tactical and root-cause tracks simultaneously.

Existing issue coverage

The improvement opportunities from this retro are well-covered by existing open issues. New evidence from this case:

No new proposals are warranted — the existing issues comprehensively cover the gaps observed in this workflow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready-for-merge All reviewers approved — ready to merge ready-for-review Triggers review agent dispatch risk/moderate PR risk: moderate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test(behaviour): increase dispatchWait timeout to 18 minutes for 50% headroom

1 participant