Skip to content

sparse decode attention: CUDA graphs, P/D, asynchronous decode, token pipelines and preemption - #164

Open
0z5a wants to merge 39 commits into
InferMatrixLab:mainfrom
0z5a:pr157-stack-on-head
Open

0z5a wants to merge 39 commits into
InferMatrixLab:mainfrom
0z5a:pr157-stack-on-head

Merge main and retire sparse references using final draft acceptance

6636336
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
lint and CPU unit tests
succeeded Nov 17, 2026 in 2m 7s