Repository navigation
Conversation
|
Azure Pipelines: There may be pipelines that require an authorized user to comment /azp run to run. |
There was a problem hiding this comment.
Copilot wasn't able to review any files in this pull request. Check if the Files changed in this pull request are included in default exclusions.
|
The main cause is the subgroup size. Alchemist supports Tuning the kernel (subgroup size 16, elements per thread Y = 2 or 4) makes it faster than the packed MatMul on |
|
/run failed bots |
|
The request was received. Failed workflow jobs were queued for rerun. Thanks. |
|
Jiajia Qin (@qjia7) I had tuned the subgroup kernel on A770, which could get good performance than matmul_packed kernel. So I think it does not need to disable the path on gen-12hp. #34074 |
Description
Disable automatic selection of the Intel subgroup GEMM/MatMul kernel on
gen-12hp(Alchemist) GPUs. Both theMatMul planner (MatMul and pointwise Conv) and the Gemm path now fall back to the generic packed MatMul there.
Other Intel architectures are unchanged.
Motivation and Context
Fixes #33856. #32304 routed pointwise Conv through the shared
ComputeMatMul, so on Intel GPUs it now usesMatMulSubgroup. On Alchemist this kernel is much slower than the packed MatMul. MatMul was already affected.