Skip to content

Support Opt-in FP8 KV Cache quantization with FA2-4 backend. - #129

Merged
bjf-frz merged 20 commits into
InferMatrixLab:mainfrom
0z5a:kv/fp8-kv-cache
Nov 18, 2026
Merged

bjf-frz merged 20 commits into
InferMatrixLab:mainfrom
0z5a:kv/fp8-kv-cache

Commits

  1. Commits on Oct 15, 2026

  2. Commits on Oct 16, 2026

  3. Commits on Oct 21, 2026

  4. Commits on Nov 1, 2026

  5. Commits on Nov 6, 2026

  6. Commits on Nov 13, 2026

  7. Commits on Nov 16, 2026

  8. Commits on Nov 17, 2026

  9. Commits on Nov 18, 2026