v0.2.1 #368
PanAndy
announced in
Announcements
v0.2.1
#368
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello everyone! Thank you for your interest in ROLL.
ROLL has recently received a large set of new features. Below is a summary of the latest updates. We will continue iterating on ROLL—welcome to join the ROLL community.
#366
🚀 Highlights
🚀 Major New Features
VLLM_USE_FLASHINFER_SAMPLER=0by default for vLLM on Torch 2.8.0 to mitigate overly repetitive responses.infer_dp > 1.get_node_ipcache issue in model download that could cause deadlock/timeouts.This discussion was created from the release v0.2.1.
Beta Was this translation helpful? Give feedback.
All reactions