Skip to content

Enables GQA support in the prefix prefill kernels#3007

Merged
WoosukKwon merged 1 commit intovllm-project:mainfrom sighingnow:ht/prefix-gqaFeb 27, 2024

Commits

Commits on Feb 27, 2024