Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
mudler
/
vllm.cpp
Public
Notifications
You must be signed in to change notification settings
Fork
53
Star
390
Code
Issues
319
Pull requests
31
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Actions: mudler/vllm.cpp
Actions
All workflows
Workflows
ci
ci
containers
containers
docs site
docs site
release
release
release-postpublish-audit
release-postpublish-audit
triton-aot-sync
triton-aot-sync
Show more workflows...
Management
Caches
Deployments
containers
containers
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
containers.yml
will be ignored since log searching is not yet available
886 workflow runs
886 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
spec(KERNEL-QUANT-CIQ-GEMM-ROCM): scope a cooperative activation share for the WMMA kernels
containers
#2895:
Pull request
#3035
opened by
joral
In progress
joral:row/KERNEL-QUANT-CIQ-GEMM-ROCM-COOPTILE
joral:row/KERNEL-QUANT-CIQ-GEMM-ROCM-COOPTILE
In progress
View #3035
View workflow file
perf(KERNEL-QUANT-CIQ-GEMM-ROCM): widen the WMMA block to 8 warps, measure, reject
containers
#2894:
Pull request
#3033
synchronize by
joral
1h 20m 47s
joral:row/KERNEL-QUANT-CIQ-GEMM-ROCM-WIDEBLOCK
joral:row/KERNEL-QUANT-CIQ-GEMM-ROCM-WIDEBLOCK
1h 20m 47s
View #3033
View workflow file
perf(KERNEL-QUANT-CIQ-GEMM-ROCM): widen the WMMA block to 8 warps, measure, reject
containers
#2893:
Pull request
#3033
opened by
joral
19m 20s
joral:row/KERNEL-QUANT-CIQ-GEMM-ROCM-WIDEBLOCK
joral:row/KERNEL-QUANT-CIQ-GEMM-ROCM-WIDEBLOCK
19m 20s
View #3033
View workflow file
feat(BACKEND-TENSTORRENT-KEEPQUANT): Q5_K/Q6_K/Q8_0 decode chains and the q4km vehicle gate (#2959)
containers
#2892:
Pull request
#3028
synchronize by
lu-zero
1h 59m 13s
lu-zero:row/BACKEND-TENSTORRENT-KEEPQUANT-W3
lu-zero:row/BACKEND-TENSTORRENT-KEEPQUANT-W3
1h 59m 13s
View #3028
View workflow file
feat(BACKEND-TENSTORRENT-KEEPQUANT): Q5_K/Q6_K/Q8_0 decode chains and the q4km vehicle gate (#2959)
containers
#2891:
Pull request
#3028
opened by
lu-zero
1h 35m 54s
lu-zero:row/BACKEND-TENSTORRENT-KEEPQUANT-W3
lu-zero:row/BACKEND-TENSTORRENT-KEEPQUANT-W3
1h 35m 54s
View #3028
View workflow file
perf(BACKEND-ROCM): widen sampling block to 1024 and split-phase random sample
containers
#2890:
Pull request
#3010
synchronize by
localai-org-maint-bot
5h 16m 38s
ghazni101:row/SAMPLE-SPLIT-PHASE-ROCM
ghazni101:row/SAMPLE-SPLIT-PHASE-ROCM
5h 16m 38s
View #3010
View workflow file
feat(LTX25-IC-LORA-REF-VIDEO): serve the IC-LoRA reference clip and its conditioning attention mask
containers
#2889:
Pull request
#3024
synchronize by
mudler
5h 17m 40s
row/LTX25-IC-LORA-REF-VIDEO
row/LTX25-IC-LORA-REF-VIDEO
5h 17m 40s
View #3024
View workflow file
feat(KERNEL-QUANT-CIQ-GEMM-ROCM): land the W1 keep-quant providers on kROCM
containers
#2888:
Pull request
#2782
synchronize by
ghazni101
6h 23m 12s
ghazni101:row/GFX1100-TG200-F1
ghazni101:row/GFX1100-TG200-F1
6h 23m 12s
View #2782
View workflow file
perf(GFX1100-TG200): T16 YTILE=4 default for wvSplitK decode-skinny GEMV
containers
#2887:
Pull request
#2787
synchronize by
ghazni101
6h 26m 36s
ghazni101:row/GFX1100-TG200-T16
ghazni101:row/GFX1100-TG200-T16
6h 26m 36s
View #2787
View workflow file
perf(GFX1100-TG200): T6a cooperative GDN scan arm
containers
#2886:
Pull request
#2866
synchronize by
ghazni101
6h 30m 53s
ghazni101:row/GFX1100-TG200-T6a
ghazni101:row/GFX1100-TG200-T6a
6h 30m 53s
View #2866
View workflow file
feat(GFX1100-TG200): lever-C fused norm-quant epilogue
containers
#2885:
Pull request
#2792
synchronize by
ghazni101
6h 31m 28s
ghazni101:row/GFX1100-TG200-LEVERC
ghazni101:row/GFX1100-TG200-LEVERC
6h 31m 28s
View #2792
View workflow file
perf(GFX1100-TG200): T9 cooperative gated norm arm
containers
#2884:
Pull request
#2875
synchronize by
ghazni101
6h 29m 32s
ghazni101:row/GFX1100-TG200-T9
ghazni101:row/GFX1100-TG200-T9
6h 29m 32s
View #2875
View workflow file
perf(GFX1100-TG200): T27 warp-cooperative QuantizeQ8KK for decode
containers
#2883:
Pull request
#2796
synchronize by
ghazni101
6h 28m 29s
ghazni101:row/GFX1100-TG200-T27
ghazni101:row/GFX1100-TG200-T27
6h 28m 29s
View #2796
View workflow file
feat(GFX1100-TG200): T21 keep-quant for V-head row-permuted GDN projections
containers
#2882:
Pull request
#2804
synchronize by
ghazni101
6h 19m 54s
ghazni101:row/GFX1100-TG200-T21
ghazni101:row/GFX1100-TG200-T21
6h 19m 54s
View #2804
View workflow file
feat(GFX1100-TG200): T25 keep ssm_out as Q5_K with runtime input permutation
containers
#2881:
Pull request
#2807
synchronize by
ghazni101
6h 20m 43s
ghazni101:row/GFX1100-TG200-T25
ghazni101:row/GFX1100-TG200-T25
6h 20m 43s
View #2807
View workflow file
perf(GFX1100-TG200): T16 YTILE=4 default for wvSplitK decode-skinny GEMV
containers
#2880:
Pull request
#2787
synchronize by
ghazni101
11m 58s
ghazni101:row/GFX1100-TG200-T16
ghazni101:row/GFX1100-TG200-T16
11m 58s
View #2787
View workflow file
record(GFX1100-TG200): GDN b/a GEMV merge closed negative (VT_GDN_MERGED_BA_ROCM)
containers
#2879:
Pull request
#2893
synchronize by
ghazni101
6h 17m 47s
ghazni101:row/GFX1100-TG200-T35R3
ghazni101:row/GFX1100-TG200-T35R3
6h 17m 47s
View #2893
View workflow file
perf(GFX1100-TG200): T14 row-split greedy argmax arm
containers
#2878:
Pull request
#2876
synchronize by
ghazni101
6h 14m 27s
ghazni101:row/GFX1100-TG200-T14
ghazni101:row/GFX1100-TG200-T14
6h 14m 27s
View #2876
View workflow file
feat(GFX1100-TG200): fuse silu-mul with Q8_K quant epilogue (VT_SILU_QUANT_FUSED)
containers
#2877:
Pull request
#2890
synchronize by
ghazni101
6h 6m 3s
ghazni101:row/GFX1100-TG200-SILUQUANT
ghazni101:row/GFX1100-TG200-SILUQUANT
6h 6m 3s
View #2890
View workflow file
feat(GFX1100-TG200): T24 LDS-buffered quant epilogue in RmsNormRowCoopKernel
containers
#2876:
Pull request
#2800
synchronize by
ghazni101
6h 5m 43s
ghazni101:row/GFX1100-TG200-T24
ghazni101:row/GFX1100-TG200-T24
6h 5m 43s
View #2800
View workflow file
fix(GFX1100-TG200): skinny_gemm OOB write + MoE silu gate rounding
containers
#2875:
Pull request
#2894
synchronize by
ghazni101
6h 4m 28s
ghazni101:row/GFX1100-TG200-BUGFIX
ghazni101:row/GFX1100-TG200-BUGFIX
6h 4m 28s
View #2894
View workflow file
perf(GFX1100-TG200): T8 cooperative single-row rmsnorm arm
containers
#2874:
Pull request
#2874
synchronize by
ghazni101
6h 16m 59s
ghazni101:row/GFX1100-TG200-T8
ghazni101:row/GFX1100-TG200-T8
6h 16m 59s
View #2874
View workflow file
perf(GFX1100-TG200): T5a vectorizes shared Q8_K quant superblock body
containers
#2873:
Pull request
#2822
synchronize by
ghazni101
6h 4m 14s
ghazni101:row/GFX1100-TG200-T5a
ghazni101:row/GFX1100-TG200-T5a
6h 4m 14s
View #2822
View workflow file
perf(GFX1100-TG200): T6b cooperative attn preamble arm
containers
#2872:
Pull request
#2868
synchronize by
ghazni101
5h 55m 36s
ghazni101:row/GFX1100-TG200-T6b
ghazni101:row/GFX1100-TG200-T6b
5h 55m 36s
View #2868
View workflow file
Port async device-mirror combine/scatter kernels to ROCm
containers
#2871:
Pull request
#2779
synchronize by
ghazni101
5h 58m 45s
ghazni101:row/GFX1100-TG200-COMBINE
ghazni101:row/GFX1100-TG200-COMBINE
5h 58m 45s
View #2779
View workflow file
Previous
1
2
3
4
5
…
35
36
Next
You can’t perform that action at this time.