Skip to content

[Bugfix] Miscalculated latency lead to time_to_first_token_seconds inaccurate.#6686

Merged
simon-mo merged 4 commits intovllm-project:mainfrom AllenDou:metrics_bugfixJul 24, 2024
+3-2

Commits

Commits on Jul 24, 2024