Skip to content

Commit

Permalink
modified comment
Browse files Browse the repository at this point in the history
  • Loading branch information
bong-furiosa committed Aug 2, 2024
1 parent b5b76a3 commit a7d579a
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion vllm/spec_decode/draft_model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -332,7 +332,6 @@ def execute_model(
self.flashinfer_decode_wrapper
model_input.attn_metadata.begin_forward()


# Detect exec mode
assert model_input.attn_metadata is not None
use_cuda_graph = False
Expand Down

0 comments on commit a7d579a

Please sign in to comment.