Skip to content

v0.6.5

Latest
Compare
Choose a tag to compare
@github-actions github-actions released this 17 Dec 23:10
· 70 commits to main since this release
2d1b9ba

Highlights

Model Support

Hardware Support

Performance & Scheduling

  • Prefix-cache aware scheduling (#10128), sliding window support (#10462), disaggregated prefill enhancements (#10502, #10884), evictor optimization (#7209).

Benchmark & Frontend

Documentation & Plugins

Bugfixes & Misc

What's Changed

New Contributors

Full Changelog: v0.6.4...v0.6.5