fix(test): skip HF-downloading embedding nodes in default CI lane#1234
fix(test): skip HF-downloading embedding nodes in default CI lane#1234meetp06 wants to merge 1 commit into
Conversation
…cketride-org#1120) embedding_transformer (miniLM) and embedding_video (openai-patch16) download model weights from huggingface.co while test_dynamic.py runs, so when the HF hub is unreachable or rate-limited they fail and turn the only required check (ci-ok) red — on PRs unrelated to embeddings. This has hit docs-only PRs, the Baidu Qianfan rocketride-org#1006 run, and the 2026-06-04 release prep. Add both to the existing skip_nodes set in conftest.py, matching the embedding_image precedent (same heavy-model category). They remain runnable on demand via ROCKETRIDE_INCLUDE_SKIP=embedding_transformer,embedding_video. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: ASSERTIVE Plan: Pro Run ID: 📒 Files selected for processing (1)
📝 WalkthroughWalkthroughUpdated the pytest dynamic test generation configuration to skip ChangesTest Configuration
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
🤖 Internal: Discord sync markerAuto-managed by the Discord notification workflow. Stores the linked Discord message ID. Do not edit or delete. |
Summary
Two
test/test_dynamic.py::TestDynamicNodes::test_node_casesparametrizations download model weights from huggingface.co at test time:embedding_video:services:openai-patch16(CLIP)embedding_transformer:services:miniLM(sentence-transformers)When the HF hub is unreachable or rate-limited they raise
RuntimeError: We couldn't connect to 'https://huggingface.co' ...and turn the only required check (ci-ok) red — on PRs that have nothing to do with embeddings. Per #1120 this has hit a docs-only PR, the Baidu Qianfan #1006 run, and the 2026-06-04 release prep, and it also blocks develop→stage promotion and the nightly prerelease gate.Fix
conftest.pyalready maintains askip_nodesset that excludes heavy / model-downloading nodes from the default dynamic-test lane — includingembedding_image, which is the exact same category.embedding_transformerandembedding_videowere simply missing from it. This adds them, with a comment explaining why.This is the issue's option 3 (gate so they don't run in the default lane), implemented via the mechanism the repo already uses — no new markers, no CI-image changes.
Behavior
./builder test) no longer touches the network for these nodes →ci-okbecomes deterministic.Trade-off
Like the existing skipped nodes (
embedding_image,ocr,anonymize, …), these two are no longer smoke-tested in CI — a deliberate, precedent-matching trade of a small coverage loss for a non-flaky required check. A heavier alternative (pre-cache weights +HF_HUB_OFFLINE=1) would keep coverage but needs CI-runner-image changes; out of scope here.Verification
python -m py_compile nodes/test/conftest.pypasses; the two skipped node names match the failing parametrizations named in the issue (embedding_video→openai-patch16,embedding_transformer→miniLM), each of whose defaulttestblock runs only that single network-dependent profile.Closes #1120
🤖 Generated with Claude Code
Summary by CodeRabbit