runtimes: remove distributed executor backend option from vllm (#257)

it's the default Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
opendatahub-io · Sep 5, 2024 · bcc19fa · bcc19fa
1 parent 09790de
commit bcc19fa
Showing 1 changed file with 0 additions and 1 deletion.
diff --git a/config/runtimes/vllm-template.yaml b/config/runtimes/vllm-template.yaml
@@ -43,7 +43,6 @@ objects:
             - "--port=8080"
             - "--model=/mnt/models"
             - "--served-model-name={{.Name}}"
-            - "--distributed-executor-backend=mp"
           env:
             - name: HF_HOME
               value: /tmp/hf_home