Skip to content

Latest commit

 

History

History
27 lines (19 loc) · 784 Bytes

nightly-annotation.md

File metadata and controls

27 lines (19 loc) · 784 Bytes

Description

This file contains the downloading link for benchmarking results.

  • benchmarking pipeline
  • benchmarking results
  • benchmarking code

Please download the visualization scripts in the post

Results reproduction

  • Find the docker we use in benchmarking pipeline

  • Deploy the docker, and inside the docker:

    • Download nightly-benchmarks.zip.
    • In the same folder, run the following code:
    export HF_TOKEN=<your HF token>
apt update
apt install -y git
unzip nightly-benchmarks.zip
VLLM_SOURCE_CODE_LOC=./ bash .buildkite/nightly-benchmarks/scripts/run-nightly-benchmarks.sh

And the results will be inside ./benchmarks/results.