Skip to content

Commit

Permalink
ping 2
Browse files Browse the repository at this point in the history
  • Loading branch information
alexm-neuralmagic committed Aug 24, 2024
1 parent 7b5564b commit 3c4dcfc
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/engine/llm_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -1666,7 +1666,7 @@ def _get_stats(self,
finished_reason_requests: List[str] = []

# NOTE: This loop assumes prefill seq_groups are before
# decode seq_groups in scheduled_seq_groups.
# decode seq_groups in scheduled_seq_groups
if scheduler_outputs is not None:
# For async postprocessor, already finished sequences need to be
# not counted. (to avoid double counting)
Expand Down

0 comments on commit 3c4dcfc

Please sign in to comment.