Skip to content

Commit

Permalink
Add async pipeline version
Browse files Browse the repository at this point in the history
  • Loading branch information
allegroai committed Feb 27, 2024
1 parent 8f6feef commit 9488ead
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions examples/pipeline/readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,15 @@ Training a scikit-learn model (see example/sklearn)
`clearml-serving --id <service_id> model add --engine sklearn --endpoint "test_model_sklearn_b" --preprocess "examples/sklearn/preprocess.py" --name "train sklearn model" --project "serving examples"`

3. Create pipeline model endpoint:

Threaded version

`clearml-serving --id <service_id> model add --engine custom --endpoint "test_model_pipeline" --preprocess "examples/pipeline/preprocess.py"`

AsyncIO version

`clearml-serving --id <service_id> model add --engine custom_async --endpoint "test_model_pipeline" --preprocess "examples/pipeline/async_preprocess.py"`

4. If you already have the `clearml-serving` docker-compose running, it might take it a minute or two to sync with the new endpoint.

Or you can run the clearml-serving container independently `docker run -v ~/clearml.conf:/root/clearml.conf -p 8080:8080 -e CLEARML_SERVING_TASK_ID=<service_id> clearml-serving:latest`
Expand Down

0 comments on commit 9488ead

Please sign in to comment.