[Bug]: Lack of reproducibility across multiple runs of prefix cache benchmark #9080
Closed
1 task done
Labels
bug
Something isn't working
Your current environment
The output of `python collect_env.py`
Model Input Dumps
No response
🐛 Describe the bug
Lack of random seed for reproducibility in prefix cache benchmark.
Before submitting a new issue...
The text was updated successfully, but these errors were encountered: