Skip to content

Run 8 (VLM physics) recorded; test suite never uses a live Anthropic key - #25

Merged
sladojevicm merged 2 commits into
developfrom
fix/vlm-test-hermetic
Sep 17, 2026
Merged

sladojevicm merged 2 commits into
developfrom
fix/vlm-test-hermetic

Conversation

@sladojevicm

Copy link
Copy Markdown
Owner

Run 8 on the pod: room_2_v2, tier 2, SOBA_STRICT=1, Anthropic key set. S6 PASS, 9/9 objects physics_origin: vlm, geometry identical to run 7. The 49.8 kg chair becomes 34.1 kg and is traced to geometry (its sealed mesh encloses 0.294 m3, 5x its siblings), not physics. Not fixed here.

Fix: with a real key in the shell, vlm.infer() builds the live backend, so test_vlm_falls_back_to_lookup_without_backend failed on the pod and every assemble() test without a backend made billed API calls. tests/conftest.py gets an autouse fixture that removes ANTHROPIC_API_KEY.

Tested: tests/scene 66 passed on the WSL box (ephemeral env, fake key exported). Not re-run on the pod.

🤖 Generated with Claude Code

https://claude.ai/code/session_01T4fWTqvtzrSuC3ZmHemmA6

sladojevicm and others added 2 commits September 17, 2026 13:04
… a live Anthropic key

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01T4fWTqvtzrSuC3ZmHemmA6
…o fallback; mass plausibility notes)

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01T4fWTqvtzrSuC3ZmHemmA6
@sladojevicm
sladojevicm merged commit 024fedc into develop Sep 17, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant