Skip to content

[SpecDec] Fix inputs for speculation and revise past KV trimming#5449

Merged
yuanheng-zhao merged 1 commit intohpcaitech:feat/speculative-decodingfrom yuanheng-zhao:feat/spec-dec/fixMar 12, 2024

Commits

Commits on Mar 12, 2024