Skip to content

Commit

Permalink
⚗️ test build for caikit prompts
Browse files Browse the repository at this point in the history
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
  • Loading branch information
joerunde committed Oct 11, 2024
1 parent c2090bf commit 37128cb
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions Dockerfile.ubi
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
# Start from released image
FROM quay.io/opendatahub/vllm:cuda-pr-191 as vllm-grpc-adapter
FROM quay.io/opendatahub/vllm:fast-ibm-6308d91 as vllm-grpc-adapter

USER root

# Copy source code changes into the installed location to overwrite the installed python code
COPY vllm /opt/vllm/lib64/python3.12/site-packages/vllm
# COPY vllm /opt/vllm/lib64/python3.12/site-packages/vllm

# RUN --mount=type=cache,target=/root/.cache/pip \
# pip install vllm-tgis-adapter==0.5.1
RUN --mount=type=cache,target=/root/.cache/pip \
pip install git+https://github.com/opendatahub-io/vllm-tgis-adapter@main
pip install git+https://github.com/opendatahub-io/vllm-tgis-adapter@load-caikit-prompts

ENV GRPC_PORT=8033 \
PORT=8000 \
Expand Down

0 comments on commit 37128cb

Please sign in to comment.