Skip to content
Back to pull request #7985

[Core][Kernels] Enable FP8 KV Cache with Flashinfer backend. + BugFix for kv_cache_dtype=auto #13980

Sign in to view logs

[Core][Kernels] Enable FP8 KV Cache with Flashinfer backend. + BugFix for kv_cache_dtype=auto

[Core][Kernels] Enable FP8 KV Cache with Flashinfer backend. + BugFix for kv_cache_dtype=auto #13980

Run time

Learn about OS pricing on GitHub Actions
Job Run time
ruff (3.8)
29s
ruff (3.9)
27s
ruff (3.10)
26s
ruff (3.11)
25s
ruff (3.12)
29s
2m 16s