Skip to content

Adapt vLLM LoRA request path parameter#3

Closed
amumu96 wants to merge 1 commit into
mainfrom
codex/vllm-lora-path-compat
Closed

Adapt vLLM LoRA request path parameter#3
amumu96 wants to merge 1 commit into
mainfrom
codex/vllm-lora-path-compat

Conversation

@amumu96

@amumu96 amumu96 commented Jun 1, 2026

Copy link
Copy Markdown
Owner

Summary

  • Adapt vLLM LoRA request construction for vLLM 0.14.0 and newer by passing lora_path.
  • Keep lora_local_path for older vLLM versions to preserve compatibility.

Release note

  • Fix LoRA module loading with newer vLLM versions that expect LoRARequest(lora_path=...).

Validation

  • python -m py_compile xinference/model/llm/vllm/core.py
  • git diff --check -- xinference/model/llm/vllm/core.py

@amumu96

amumu96 commented Jun 1, 2026

Copy link
Copy Markdown
Owner Author

Closed because the PR was recreated against the parent repository: xorbitsai#4980

@amumu96 amumu96 closed this Jun 1, 2026
@qinxuye qinxuye deleted the codex/vllm-lora-path-compat branch June 1, 2026 11:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant