[Kernel] Enhance MoE benchmarking & tuning script (vllm-project#4921)

Temirulan · Jun 4, 2024 · 0b5547b · 0b5547b
1 parent fecec18
commit 0b5547b
Show file tree

Hide file tree

Showing 3 changed files with 346 additions and 253 deletions.
diff --git a/benchmarks/kernels/benchmark_mixtral_moe.py b/benchmarks/kernels/benchmark_mixtral_moe.py