Skip to content

Commit

Permalink
[CI/Build] Add examples folder into Docker image so that we can lever…
Browse files Browse the repository at this point in the history
…age the templates*.jinja when serving models (vllm-project#8758)

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Sumit Dubey <sumit.dubey2@ibm.com>
  • Loading branch information
panpan0000 authored and sumitd2 committed Nov 14, 2024
1 parent 54985ae commit c7136b0
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -182,6 +182,7 @@ RUN --mount=type=bind,from=build,src=/workspace/dist,target=/vllm-workspace/dist
RUN --mount=type=cache,target=/root/.cache/pip \
. /etc/environment && \
python3 -m pip install https://github.com/flashinfer-ai/flashinfer/releases/download/v0.1.6/flashinfer-0.1.6+cu121torch2.4-cp${PYTHON_VERSION_STR}-cp${PYTHON_VERSION_STR}-linux_x86_64.whl
COPY examples examples
#################### vLLM installation IMAGE ####################


Expand Down

0 comments on commit c7136b0

Please sign in to comment.