Skip to content
Back to pull request #9537

[WIP] Disaggregated prefilling support X prefill + Y decode #18642

Sign in to view logs

[WIP] Disaggregated prefilling support X prefill + Y decode

[WIP] Disaggregated prefilling support X prefill + Y decode #18642

Triggered via pull request October 21, 2024 02:41
@zeroorherozeroorhero
opened #9537
zeroorhero:disagg-refactor-dev
Status Failure
Total duration 30s
Artifacts –

mypy.yaml

on: pull_request
Matrix: mypy
Fit to window
Zoom out
Zoom in

Annotations

24 errors
mypy (3.9): vllm/entrypoints/openai/api_server.py#L202
Incompatible types in assignment (expression has type "MQLLMEngineClient", variable has type "Optional[PDMQLLMEngineClient]") [assignment]
mypy (3.9): vllm/entrypoints/openai/api_server.py#L207
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "setup" [union-attr]
mypy (3.9): vllm/entrypoints/openai/api_server.py#L220
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "close" [union-attr]
mypy (3.9)
Process completed with exit code 1.
mypy (3.11)
The job was canceled because "_3_9" failed.
mypy (3.11): vllm/entrypoints/openai/api_server.py#L202
Incompatible types in assignment (expression has type "MQLLMEngineClient", variable has type "Optional[PDMQLLMEngineClient]") [assignment]
mypy (3.11): vllm/entrypoints/openai/api_server.py#L207
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "setup" [union-attr]
mypy (3.11): vllm/entrypoints/openai/api_server.py#L220
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "close" [union-attr]
mypy (3.11)
Process completed with exit code 1.
mypy (3.10)
The job was canceled because "_3_9" failed.
mypy (3.10): vllm/entrypoints/openai/api_server.py#L202
Incompatible types in assignment (expression has type "MQLLMEngineClient", variable has type "Optional[PDMQLLMEngineClient]") [assignment]
mypy (3.10): vllm/entrypoints/openai/api_server.py#L207
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "setup" [union-attr]
mypy (3.10): vllm/entrypoints/openai/api_server.py#L220
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "close" [union-attr]
mypy (3.10)
Process completed with exit code 1.
mypy (3.8)
The job was canceled because "_3_9" failed.
mypy (3.8): vllm/entrypoints/openai/api_server.py#L202
Incompatible types in assignment (expression has type "MQLLMEngineClient", variable has type "Optional[PDMQLLMEngineClient]") [assignment]
mypy (3.8): vllm/entrypoints/openai/api_server.py#L207
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "setup" [union-attr]
mypy (3.8): vllm/entrypoints/openai/api_server.py#L220
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "close" [union-attr]
mypy (3.8)
Process completed with exit code 1.
mypy (3.12)
The job was canceled because "_3_9" failed.
mypy (3.12): vllm/entrypoints/openai/api_server.py#L202
Incompatible types in assignment (expression has type "MQLLMEngineClient", variable has type "Optional[PDMQLLMEngineClient]") [assignment]
mypy (3.12): vllm/entrypoints/openai/api_server.py#L207
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "setup" [union-attr]
mypy (3.12): vllm/entrypoints/openai/api_server.py#L220
Item "None" of "Optional[PDMQLLMEngineClient]" has no attribute "close" [union-attr]
mypy (3.12)
Process completed with exit code 1.