Skip to content

[ROCm] Initial MI355X and MI300X Integration#13

Open
micah-wil wants to merge 21 commits into
vllm-project:mainfrom
micah-wil:add-mi355x-kimi-k2-5
Open

[ROCm] Initial MI355X and MI300X Integration#13
micah-wil wants to merge 21 commits into
vllm-project:mainfrom
micah-wil:add-mi355x-kimi-k2-5

Conversation

@micah-wil

@micah-wil micah-wil commented Jun 1, 2026

Copy link
Copy Markdown

This PR integrates AMD MI355X agents into the perf eval pipeline. I've also added Kimi-K2.5 workloads for both MI300 and MI355, as well as gpt-oss-120b and DeepSeek-V4-Pro configs for mi355.

For now, these configs are set to not run on the nightly. Any combination of them can be triggered with the WORKLOADS env var, e.g. WORKLOADS=deepseek_v4_pro_mi355x,kimi_k2_5_mi355x,kimi_k2_5_mi300x

We've added two queues which have been connected to the perf-eval Buildkite pipeline: mi300_perf_eval queue, and mi355_perf_eval queue.

micah-wil added 2 commits June 1, 2026 20:59
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
@micah-wil micah-wil changed the title [ROCm] Initial MI355X Integration + Kimi K2.5 MI355X Config [ROCm] Initial MI355X Integration + Kimi-K2.5 MI355X Config Jun 1, 2026
@micah-wil micah-wil marked this pull request as ready for review June 1, 2026 21:10
micah-wil and others added 11 commits June 3, 2026 17:52
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Divin Honnappa <divin.honnappa@amd.com>
Signed-off-by: Divin Honnappa <divin.honnappa@amd.com>
Signed-off-by: dhonnappa-amd <dhonnapp@amd.com>
Signed-off-by: dhonnappa-amd <dhonnapp@amd.com>
Signed-off-by: Divin Honnappa <divin.honnappa@amd.com>
Signed-off-by: Divin Honnappa <divin.honnappa@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
@micah-wil micah-wil force-pushed the add-mi355x-kimi-k2-5 branch from 0f380ae to 5b57355 Compare June 5, 2026 21:23
micah-wil added 3 commits June 5, 2026 21:24
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
* add mi300x

Signed-off-by: Micah Williamson <micah.williamson@amd.com>

* ensure correct k8s plugin is used

Signed-off-by: Micah Williamson <micah.williamson@amd.com>

* hardcode builder for testing

Signed-off-by: Micah Williamson <micah.williamson@amd.com>

* revert hardcoded builder

Signed-off-by: Micah Williamson <micah.williamson@amd.com>

---------

Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
@micah-wil micah-wil changed the title [ROCm] Initial MI355X Integration + Kimi-K2.5 MI355X Config [ROCm] Initial MI355X and MI300X Integration Jun 9, 2026
micah-wil added 3 commits June 9, 2026 06:10
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it be better if I split workloads into subdirectories like amd/ and nvidia/?

Signed-off-by: Micah Williamson <micah.williamson@amd.com>
@micah-wil micah-wil force-pushed the add-mi355x-kimi-k2-5 branch from fe864c9 to 8c02fcd Compare June 10, 2026 21:32
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants