Add throughput benchmarking script (vllm-project#133)

casys-kaist-internal · May 28, 2023 · aac2f48 · aac2f48
1 parent d1aa706
commit aac2f48
Show file tree

Hide file tree

Showing 10 changed files with 33 additions and 703 deletions.
diff --git a/benchmark/benchmark_attention.py b/benchmark/benchmark_attention.py
diff --git a/benchmark/benchmark_cache.py b/benchmark/benchmark_cache.py
diff --git a/benchmark/benchmark_latency.py b/benchmark/benchmark_latency.py