fix(vime): avoid double temperature scaling for reused logits - #423
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Advanced Run ID: 📒 Files selected for processing (2)
🚧 Files skipped from review as they are similar to previous changes (1)
Included review availability: Your plan provides up to 2 included reviews per hour; 0 remain after this review. 📝 WalkthroughWalkthroughThe strict Vime provider now resolves local-logit temperature from scaling metadata. Reused pre-scaled logits skip further scaling, while hidden-logit recomputation still uses the request temperature. Tests verify both paths. ChangesVime local-logit temperature handling
Priority: ➖ Normal Estimated code review effort: 2 (Simple) | ~10 minutes Change: Bug fix Merge Risk: ⚪ Minimal · up to The updated strict-provider paths and their regression coverage consistently preserve single temperature application for reused logits while retaining scaling for hidden-state recomputation. The change is ready to merge. 🚥 Pre-merge checks | ✅ 4 | ❌ 1❌ Failed checks (1 warning)
✅ Passed checks (4 passed)
✨ Finishing Touches 💡 2📝 Generate docstrings 💡
🛠️ Fix failing CI checks 💡
🧪 Generate unit tests (beta)
Comment |
Signed-off-by: lamentropetion <3051000145@qq.com>
Signed-off-by: lamentropetion <3051000145@qq.com>
06b6e1f to
9d13d2b
Compare
Summary
Contract details
The PR #400 experiment pins VIME commit
c80200e. That revision dividesrequest.logitsbyrollout_temperaturebefore provider dispatch and setsmetadata["logits_are_temperature_scaled"] = True. Reapplyingrequest.temperaturein RL-Kernel therefore turns 0.7 into an effective 0.49.VIME PRs #423 and #424 use the newer contract: provider-bound logits remain unscaled, the metadata marker is absent, and
request.temperaturemust still be applied once. This change supports both contracts. The marker is consumed only by the reused-local-logits path; hidden-state recomputation continues to use the request temperature.Validation
python -m pytest -q tests/test_vime_linear_logp_provider.py: 10 passedgit diff --checkpassed for the changed files