FEAT: Xavier: Share KV cache between VLLM replicas#2732
Merged
ChengjieLi28 merged 18 commits intoxorbitsai:mainfrom ChengjieLi28:feat/share_kv_cache_vllmJan 10, 2025
+1,877-24
Commits
Commits on Jan 3, 2025
- committed
- committed
Commits on Jan 6, 2025
Commits on Jan 7, 2025
- committed
- committed
- committed
- committed
Commits on Jan 8, 2025
Commits on Jan 9, 2025
- committed
- committed
- committed
- committed
Commits on Jan 10, 2025
- committed
- committed
- committed
- committed