Skip to content

Automated merge - qualcomm/Startup-Demos:feature_rel_20260617_210058 -> qualcomm/Startup-Demos:main#292

Merged
smartcoder00 merged 2 commits into
mainfrom
feature_rel_20260617_210058
Jun 18, 2026
Merged

Automated merge - qualcomm/Startup-Demos:feature_rel_20260617_210058 -> qualcomm/Startup-Demos:main#292
smartcoder00 merged 2 commits into
mainfrom
feature_rel_20260617_210058

Conversation

@smartcoder00

Copy link
Copy Markdown
Contributor

Automated merge via script.

ZGarfield and others added 2 commits June 4, 2026 16:18
- Added LLM serving benchmark using vLLM on Qualcomm AIC100 (QAIC)
- Implemented multi-endpoint setup with device-level mapping (1:1 endpoint to QAIC device)
- Enabled concurrency scaling tests across multiple decode workloads (32 / 128 / 512 tokens)
- Collected and analyzed throughput (TPS), tokens/sec, latency, and failure behavior
- Demonstrated balanced multi-device utilization via per-endpoint performance analysis

Signed-off-by: Chu(Temp), Ryan <ryachu@qti.qualcomm.com>
- Added LLM serving benchmark using vLLM on Qualcomm AIC100 (QAIC)
- Implemented multi-endpoint setup with device-level mapping (1:1
endpoint to QAIC device)
- Enabled concurrency scaling tests across multiple decode workloads (32
/ 128 / 512 tokens)
- Collected and analyzed throughput (TPS), tokens/sec, latency, and
failure behavior
- Demonstrated balanced multi-device utilization via per-endpoint
performance analysis

@ZGarfield ZGarfield left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved the changes after reviewing all the below checklists.
𝗖𝗢𝗠𝗠𝗜𝗧𝗦 & 𝗣𝗥 𝗛𝗬𝗚𝗜𝗘𝗡𝗘

  • Clear PR title & brief description
  • Commit messages follow standards
  • All commits are signed
  • Project Info file follows project standards.
  • CI / QC Preflight checks green
    𝗖𝗢𝗗𝗘 𝗤𝗨𝗔𝗟𝗜𝗧𝗬 & 𝗔𝗨𝗧𝗛𝗘𝗡𝗧𝗜𝗖𝗜𝗧𝗬
  • No code without proper source/license
  • Ask author for source of suspicious lines
  • No ML models / datasets / binaries checked in
  • Code belongs in source files (not in README)
    𝗗𝗢𝗖𝗨𝗠𝗘𝗡𝗧𝗔𝗧𝗜𝗢𝗡 𝗗𝗜𝗦𝗖𝗜𝗣𝗟𝗜𝗡𝗘
  • README simple, clean, minimal
  • No long code blocks in README
  • Reusable docs moved to common README/docs
  • Clear git clone + setup instructions
  • Use scripts for repeatable setup
    𝗖𝗢𝗠𝗣𝗟𝗜𝗔𝗡𝗖𝗘 & 𝗦𝗔𝗙𝗘𝗧𝗬
  • Dependencies & licenses validated
  • No secrets or sensitive data
  • No copyrighted media included
  • All reviewer comments resolved before merge

@smartcoder00 smartcoder00 marked this pull request as ready for review June 18, 2026 05:36
@smartcoder00 smartcoder00 merged commit 76ffc4b into main Jun 18, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants