[WIP] Disaggregated prefilling support X prefill + Y decode #18642
Annotations
5 errors
|
|
|
Mypy:
vllm/entrypoints/openai/api_server.py#L202
Incompatible types in assignment (expression has type "MQLLMEngineClient", variable has type "Optional[PDMQLLMEngineClient]") [assignment]
|
|
Mypy:
vllm/entrypoints/openai/api_server.py#L207
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "setup" [union-attr]
|
|
Mypy:
vllm/entrypoints/openai/api_server.py#L220
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "close" [union-attr]
|
|
Mypy
Process completed with exit code 1.
|
Loading