Skip to content

[Bugfix] Only add Attention.kv_scale if kv cache quantization is enabled #13267

[Bugfix] Only add Attention.kv_scale if kv cache quantization is enabled

[Bugfix] Only add Attention.kv_scale if kv cache quantization is enabled #13267

Annotations

2 warnings

The logs for this run have expired and are no longer available.