Generate: New Cache abstraction and Attention Sinks support#26681
Merged
ydshieh merged 35 commits intohuggingface:mainfrom tomaarsen:feat/kv_cache_classDec 8, 2023
+962-195
Commits
Commits on Dec 7, 2023
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
