Skip to content

[Feature] Support fp8 e5m2 kv cache with flashinfer#1204

Merged
merrymercy merged 7 commits intosgl-project:mainfrom ispobock:fp8_kv_cacheAug 26, 2024
+116-16

Commits

Commits on Aug 25, 2024