You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Now the hpc-ops only support num_dim_qk == 128, which limits compatibility with models like DeepSeek V3/V3.2.
Are there any plan to support more head dimensions ?
Now the hpc-ops only support
num_dim_qk == 128, which limits compatibility with models like DeepSeek V3/V3.2.Are there any plan to support more head dimensions ?