Skip to content

feat: enable request-reordering in optimum-compiled models#596

Draft
rebel-thkim wants to merge 1 commit into
devfrom
batch_attn_decode
Draft

feat: enable request-reordering in optimum-compiled models#596
rebel-thkim wants to merge 1 commit into
devfrom
batch_attn_decode

Conversation

@rebel-thkim
Copy link
Copy Markdown
Contributor

🚀 Summary of Changes

What does this PR do? What feature, fix, or improvement does it bring?


📌 Related Issues / Tickets

  • Resolves #
  • Related to #

✅ Type of Change

  • 🚀 Release (release)
  • ✨ Feature (feature)
  • 🧠 Model support (model)
  • 🧬 Core engine changes (core)
  • 🛠 Bug fix (fix)
  • ⚙️ Performance improvement (perf)
  • 🔁 Refactor or code cleanup (refactor)
  • 📄 Documentation (docs)
  • ❓ Other (other): please describe

🧪 How to Test

  1. Run ...
  2. Verify output: ...
  3. Edge case tested: ...

📸 Screenshots / Logs (if applicable)


📋 Checklist

  • PR title follows Conventional Commits format
  • This PR is linked to an existing issue
  • The test method is described, and the expected result is clearly stated
  • Relevant documentation has been updated (if applicable)

💬 Notes


@rebel-thkim rebel-thkim marked this pull request as draft May 11, 2026 11:08
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 11, 2026

We require pull request titles to follow the Conventional Commits specification and it looks like your proposed title needs to be adjusted.

type(optional Scope): description

type candidate:

Unknown release type "feat" found in pull request title "feat: enable request-reordering in optimum-compiled models". 

Available types:
 - release
 - feature
 - model
 - core
 - fix
 - perf
 - refactor
 - docs
 - other

@codecov
Copy link
Copy Markdown

codecov Bot commented May 11, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@rebel-eunji rebel-eunji changed the title [Draft] batch_attn_decode type1 feat: enable request-reordering in optimum-compiled models May 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants