Skip to content

Conversation

@xin3he
Copy link
Contributor

@xin3he xin3he commented Jan 12, 2026

No description provided.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR addresses a CI hang issue on XPU devices by ensuring consistent device mapping configuration in the AutoRound test suite.

Changes:

  • Introduced a class-level device attribute to centralize XPU device configuration
  • Updated hardcoded device_map references to use the centralized device attribute
  • Removed duplicate variable assignment and added clarifying comment about device_map requirements

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +17 to 18
self.device = "xpu"
pass
Copy link

Copilot AI Jan 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The pass statement on line 18 is now redundant since the method has actual implementation. Consider removing it to improve code clarity.

Copilot uses AI. Check for mistakes.
@xin3he xin3he mentioned this pull request Jan 12, 2026
Signed-off-by: Xin He <xin3.he@intel.com>
# device_map="auto" doesn't work, must use "xpu"
model = AutoModelForCausalLM.from_pretrained(
quantized_model_path, device_map="auto", quantization_config=quantization_config
quantized_model_path, device_map=self.device, quantization_config=quantization_config
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we know the root cause? Or have you verified that the BF16 model is fine or not?
Maybe it's a bug of AR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants