[Kernel] Enhance MoE benchmarking & tuning script (vllm-project#4921)

joerunde · Jun 4, 2024 · d74f5fb · d74f5fb
1 parent ee15107
commit d74f5fb
Show file tree

Hide file tree

Showing 3 changed files with 346 additions and 253 deletions.
diff --git a/benchmarks/kernels/benchmark_mixtral_moe.py b/benchmarks/kernels/benchmark_mixtral_moe.py