livez and readyz are missing from the api_server

[petrosbaltzis]

Hello,

I am trying to deploy an LLM model using vLLM on Kubernetes. However, for K8, the readinessProbe and livenessProbe are needed to indicate the health of the api-server and these endpoints are missing from the api_server.py

For that reason I have raised a simple PR to include the needed endpoints: #1244

Regards,
Petros Baltzis

[jc-louis]

one health endpoint was added #1540

[petrosbaltzis]

Thanks for that! We already started using it!