From 11a215dde688e13f5da13177babdaed5750d0dae Mon Sep 17 00:00:00 2001 From: Tim 'mithro' Ansell Date: Mon, 8 Jun 2026 18:34:45 +0930 Subject: [PATCH] CI: add muffet --rate-limit to reduce transient external failures MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The preview-verification job intermittently fails when an external host (notably github.com) returns a burst of 504s mid-scan — muffet issues requests as fast as connection limits allow, which can overwhelm a host or trip its throttling. A recent run timed out every github.com URL at once (including rock-solid repos) and took ~9 minutes. Cap muffet at 20 requests/second globally to smooth out request bursts. This is a safe, host-agnostic throttle: unlike sending an auth token via --header (which muffet would leak to every external host, since it has no per-host header scoping), --rate-limit needs no secret and cannot leak anything. Co-Authored-By: Claude Opus 4.8 (1M context) --- .github/workflows/preview-verification.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/preview-verification.yml b/.github/workflows/preview-verification.yml index 240c6c0..d4a3cf1 100644 --- a/.github/workflows/preview-verification.yml +++ b/.github/workflows/preview-verification.yml @@ -339,6 +339,7 @@ jobs: --timeout=30 \ --max-connections=10 \ --max-connections-per-host=5 \ + --rate-limit=20 \ --buffer-size=16384 \ --exclude=".*mailto:.*" \ --exclude=".*linkedin\.com.*" \