feat(dev): 1.3 (#4849)

* feat: support adding response background tasks via bentoml.Context (#4754) * feat: add secret management commands (#4764) * fix: add secrets management command * chore: add file type secret * chore: update command help text * chore: add deployment option secret * fix: add delete command * chore: add secret Apply command * chore: update mountAs * chore: update import * chore: update secret api route * feat: impl client async endpoints and results (#4768) * feat: support adding response background tasks via bentoml.Context Signed-off-by: Frost Ming <me@frostming.com> * fix: remove init Signed-off-by: Frost Ming <me@frostming.com> * fix: reorganize Signed-off-by: Frost Ming <me@frostming.com> * fix: cancel the timeout check at the first send Signed-off-by: Frost Ming <me@frostming.com> * feat: async task and result Signed-off-by: Frost Ming <me@frostming.com> * feat: new route and openapi schema Signed-off-by: Frost Ming <me@frostming.com> * feat: retry endpoint Signed-off-by: Frost Ming <me@frostming.com> * feat: impl client async endpoints and results Signed-off-by: Frost Ming <me@frostming.com> * fix: test client Signed-off-by: Frost Ming <me@frostming.com> * fix: rename is_async to is_task Signed-off-by: Frost Ming <me@frostming.com> * fix: add timestamp Signed-off-by: Frost Ming <me@frostming.com> --------- Signed-off-by: Frost Ming <me@frostming.com> * feat: external_queue default to 1 when using tasks Signed-off-by: Frost Ming <me@frostming.com> * feat: get_service api for selected frameworks (#4782) * feat: support adding response background tasks via bentoml.Context (#4754) * feat: add secret management commands (#4764) * fix: add secrets management command * chore: add file type secret * chore: update command help text * chore: add deployment option secret * fix: add delete command * chore: add secret Apply command * chore: update mountAs * chore: update import * chore: update secret api route * feat: get_service api for selected frameworks Signed-off-by: Frost Ming <me@frostming.com> * fix: framework importer Signed-off-by: Frost Ming <me@frostming.com> * fix: typing import Signed-off-by: Frost Ming <me@frostming.com> * fix: deduplicate finder Signed-off-by: Frost Ming <me@frostming.com> * doc: update docs Signed-off-by: Frost Ming <me@frostming.com> * fix tests Signed-off-by: Frost Ming <me@frostming.com> * fix tests Signed-off-by: Frost Ming <me@frostming.com> * fix tests Signed-off-by: Frost Ming <me@frostming.com> * fix: tests for get_service Signed-off-by: Frost Ming <me@frostming.com> * fix: install dependencies Signed-off-by: Frost Ming <me@frostming.com> * fix: show dependency tree Signed-off-by: Frost Ming <me@frostming.com> * fix: upgrade tensorflow Signed-off-by: Frost Ming <me@frostming.com> * fix: dependencies Signed-off-by: Frost Ming <me@frostming.com> * fix: catboost test Signed-off-by: Frost Ming <me@frostming.com> * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Signed-off-by: Frost Ming <me@frostming.com> Co-authored-by: xianxian.zhang <141706136+xianml@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * feat: cli auto login (#4817) * chore: support cli auto login * feat: add auth server * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: fix by comments * chore: encode uri * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: add cors * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: clean unused code * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: clean unused code --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * feat: use rich.print to replace click.echo (#4827) * chore: update print and fix cors error (#4829) * feat: login to current context instead of default context if --context is not passed (#4828) * feat: switch to uv as the resolver and installer (#4822) * feat: switch to uv Signed-off-by: Frost Ming <me@frostming.com> * feat: Officially support Python 3.12 (#4830) * Docs: Add auto cli login docs (#4844) Add auto cli login docs Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * doc: Fix typo and format (#4821) Fix typo and format Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * fix(cli): hanging issue when deployment ready (#4825) * fix(cli): hanging issue when deployment ready Signed-off-by: Frost Ming <me@frostming.com> * fix(deployment-client): add build process and extend url (#4790) * fix(deployement-client): add build process and extend url * chore: mute if not using cli * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Frost Ming <me@frostming.com> Signed-off-by: Frost Ming <me@frostming.com> * doc: Update vllm.rst (#4824) Update vllm.rst * docs: Add custom models use case doc (#4819) * Add custom models use case doc Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * Update examples/xgboost/save_model.py Co-authored-by: Frost Ming <mianghong@gmail.com> * Update examples/mlflow/save_model.py --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Frost Ming <mianghong@gmail.com> Signed-off-by: Frost Ming <me@frostming.com> * docs: Reorg blip doc to multimodality section (#4826) Reorg blip doc to multimodality section Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * fix: inject prometheus multiproc_dir into env var when worker starts (#4820) * fix: inject prometheus multiproc_dir into env var when worker starts Signed-off-by: Frost Ming <me@frostming.com> * fix: remove unneeded tests Signed-off-by: Frost Ming <me@frostming.com> * fix: tests Signed-off-by: Frost Ming <me@frostming.com> * fix: replace bentoml.metrics with prometheus_client Signed-off-by: Frost Ming <me@frostming.com> --------- Signed-off-by: Frost Ming <me@frostming.com> * docs: Add logging and tracing docs (#4725) * Add logging and tracing docs Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * Fix format * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * feat: --label option for bentoml build (#4832) * feat: --label option for bentoml build Signed-off-by: Frost Ming <me@frostming.com> * docs: Update the concurrency doc (#4834) * Update the concurrency doc Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * Update descriptions Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * docs: Update services.rst (#4837) Update services.rst In the Python classes I changed the reference to the class to `self` from `this`. `this` is not a keyword in Python * docs: Update concurrency links (#4840) Update concurrency links Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * docs: Fix broken link (#4841) Fix broken link Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * ci: pre-commit autoupdate [skip ci] (#4838) updates: - [github.com/astral-sh/ruff-pre-commit: v0.4.7 → v0.5.0](astral-sh/ruff-pre-commit@v0.4.7...v0.5.0) - [github.com/pdm-project/pdm: 2.15.4 → 2.16.1](pdm-project/pdm@2.15.4...2.16.1) - [github.com/bufbuild/buf: v1.32.2 → v1.34.0](bufbuild/buf@v1.32.2...v1.34.0) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * doc: Fix typo and format (#4821) Fix typo and format Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Signed-off-by: Frost Ming <me@frostming.com> * fix: stop spinner before starting to stream logs (#4846) Signed-off-by: Frost Ming <me@frostming.com> * docs: Add azure byoc setup doc (#4847) * Add azure byoc step doc Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * Fix space Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * Update azure.rst * docs: Update the BYOC architecture image (#4848) Update the BYOC architecture image Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * update lock file Signed-off-by: Frost Ming <me@frostming.com> * feat: retry and cancel task (#4852) * fix: options are not required (#4861) * fix: options are not required * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * fix: don't fail when image pod is not found (#4862) * fix: async task response deserialization crash (#4865) * fix: raise deploy timeout to 1hr Signed-off-by: Frost Ming <me@frostming.com> * fix: remove references to yatai from cli help Signed-off-by: Frost Ming <me@frostming.com> * feat: change spinner text on status change and show spinner after image build done (#4867) Signed-off-by: Frost Ming <me@frostming.com> * fix: do not raise deployment pods not found error (#4868) * fix: console print Signed-off-by: Frost Ming <me@frostming.com> --------- Signed-off-by: Frost Ming <me@frostming.com> Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Co-authored-by: xianxian.zhang <141706136+xianml@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Sherlock Xu <65327072+Sherlock113@users.noreply.github.com> Co-authored-by: Steve Guo <44340365+Haivilo@users.noreply.github.com> Co-authored-by: Vikramjit Sidhu <vikram.sidhu.007@gmail.com> Co-authored-by: yetone <yetoneful@gmail.com>
bentoml · Jul 18, 2024 · b11cdbf · b11cdbf
1 parent 5c77bc3
commit b11cdbf
Show file tree

Hide file tree

Showing 128 changed files with 7,995 additions and 2,427 deletions.
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
@@ -28,7 +28,7 @@ jobs:
       fail-fast: false
       matrix:
         os: [ubuntu-latest, macos-latest, windows-latest]
-        python-version: ['3.8', '3.11']
+        python-version: [3.8, 3.11, 3.12]
     name: unit-tests (python${{ matrix.python-version }}.${{ matrix.os }})
     runs-on: ${{ matrix.os }}
     steps:
@@ -104,7 +104,7 @@ jobs:
       fail-fast: false
       matrix:
         os: [ubuntu-latest, macos-latest, windows-latest]
-        python-version: ['3.8', '3.11']
+        python-version: [3.8, 3.11, 3.12]
     name: monitoring-e2e-tests (python${{ matrix.python-version }}.${{ matrix.os }})
     runs-on: ${{ matrix.os }}
     timeout-minutes: 90
@@ -142,7 +142,7 @@ jobs:
       fail-fast: false
       matrix:
         os: [ubuntu-latest, macos-latest]
-        python-version: ['3.8', '3.11']
+        python-version: [3.8, 3.11, 3.12]
         suite: ['bento_server_http', 'bento_new_sdk']
     name: ${{ matrix.suite }}-e2e-tests (python${{ matrix.python-version }}.${{ matrix.os }})
     runs-on: ${{ matrix.os }}

diff --git a/.github/workflows/release.yml b/.github/workflows/release.yml
@@ -11,7 +11,7 @@ jobs:
       - name: Setup Python
         uses: actions/setup-python@v5
         with:
-          python-version: '3.10'
+          python-version: '3.11'
       - name: Build
         run: pipx run build
       - name: Archive

diff --git a/docs/source/bentocloud/get-started.rst b/docs/source/bentocloud/get-started.rst
@@ -12,16 +12,20 @@ Specifically, BentoCloud features:
 - Flexible APIs for continuous integration and deployments (CI/CD).
 - Built-in observability tools for monitoring model performance and troubleshooting.
 
-Access BentoCloud
------------------
+Log in to BentoCloud
+--------------------
 
-To gain access to BentoCloud, visit the `BentoML website <https://www.bentoml.com/>`_ to sign up.
+1. Visit the `BentoML website <https://www.bentoml.com/>`_ to sign up.
+2. After your BentoCloud account is approved, install BentoML by running ``pip install bentoml``. See :doc:`/get-started/installation` for details.
+3. Log in to BentoCloud with the ``bentoml cloud login`` command. Follow the on-screen instructions to create a new API token.
 
-Once you have your BentoCloud account, do the following to get started:
+   .. code-block:: bash
+
+      $ bentoml cloud login
 
-1. Install BentoML by running ``pip install bentoml``. See :doc:`/get-started/installation` for details.
-2. Create an :doc:`API token with Developer Operations Access </bentocloud/how-tos/manage-access-token>`.
-3. Log in to BentoCloud with the ``bentoml cloud login`` command, which will be displayed on the BentoCloud console after you create the API token.
+      ? How would you like to authenticate BentoML CLI? [Use arrows to move]
+      > Create a new API token with a web browser
+        Paste an existing API token
 
 Deploy your first model
 -----------------------

diff --git a/docs/source/bentocloud/how-tos/manage-access-token.rst b/docs/source/bentocloud/how-tos/manage-access-token.rst
@@ -36,28 +36,43 @@ To create an API token, perform the following steps:
 Log in to BentoCloud using the BentoML CLI
 ==========================================
 
-After you create an token with Developer Operations Access, you can interact with BentoCloud programmatically via the BentoML Command Line
-Interface (CLI). Log in using the following command.
+CLI login requires an API token with Developer Operations Access.
 
-.. code-block:: bash
+1. Run the ``bentoml cloud login`` command.
 
-   bentoml cloud login --api-token <your-api-token> --endpoint <your-bentocloud-endpoint>
+   .. code-block:: bash
 
-.. note::
+      bentoml cloud login
 
-   The above command is displayed automatically after you create a token.
+2. Follow the on-screen instructions to log in.
 
-Expected output:
+   .. code-block:: bash
 
-.. code-block:: bash
+      ? How would you like to authenticate BentoML CLI? [Use arrows to move]
+      > Create a new API token with a web browser
+        Paste an existing API token
 
-   Successfully logged in as user "user" in organization "mybentocloud".
+3. Alternatively, you can log in by setting the ``api-token`` parameter if you already have an available token.
 
-To retrieve the current endpoint and API token locally, make sure you have installed ``jq``, and then run:
+   .. code-block:: bash
 
-.. code-block:: bash
+      bentoml cloud login --api-token <your-api-token>
 
-   bentoml cloud current-context | jq '("endpoint:" + .endpoint + ", api_token:" + .api_token)'
+   .. note::
+
+      The above command is displayed automatically after you create a token.
+
+   Expected output:
+
+   .. code-block:: bash
+
+      Successfully logged in as user "user" in organization "mybentocloud".
+
+4. To retrieve the current endpoint and API token locally, make sure you have installed ``jq``, and then run:
+
+   .. code-block:: bash
+
+      bentoml cloud current-context | jq '("endpoint:" + .endpoint + ", api_token:" + .api_token)'
 
 After you log in, you should be able to manage BentoCloud resources. For more information on the CLI, see :doc:`Reference - CLI </reference/cli>`.
 

diff --git a/docs/source/guides/deployment.rst b/docs/source/guides/deployment.rst
@@ -8,10 +8,9 @@ If you want to deploy your BentoML project in environments other than BentoCloud
 
 To deploy a BentoML project on BentoCloud, do the following:
 
-1. `Sign up here <https://www.bentoml.com/cloud>`_ for BentoCloud. You will receive $10 free credits once you have your account.
-2. Create an :doc:`API token with Developer Operations Access </bentocloud/how-tos/manage-access-token>` on the BentoCloud console.
-3. Log in to BentoCloud. The login command will be displayed on the BentoCloud console after you create the token.
-4. Deploy a project on BentoCloud. You can deploy the example project in :doc:`/get-started/quickstart` by running the following commands:
+1. `Sign up here <https://www.bentoml.com/cloud>`_ for BentoCloud. You will receive $10 free credits once you have your account approved.
+2. Run the ``bentoml cloud login`` command and follow the on-screen instructions to log in.
+3. Deploy a project on BentoCloud. You can deploy the example project in :doc:`/get-started/quickstart` by running the following commands:
 
    .. code-block:: bash
 
@@ -20,7 +19,7 @@ To deploy a BentoML project on BentoCloud, do the following:
       pip install -r requirements.txt
       bentoml deploy .
 
-5. You can then interact with the Deployment on the console.
+4. You can then interact with the Deployment on the console.
 
    .. image:: ../../_static/img/guides/deployment/deployment-replica.png
 

diff --git a/docs/source/reference/frameworks/catboost.rst b/docs/source/reference/frameworks/catboost.rst
@@ -5,7 +5,7 @@ CatBoost
 .. admonition:: About this page
 
    This is an API reference for CatBoost in BentoML. Please refer to
-   :ref:`CatBoost guides <frameworks/catboost:CatBoost>` for more information about how to use CatBoost
+   :ref:`CatBoost guides </reference/frameworks/catboost:CatBoost>` for more information about how to use CatBoost
    in BentoML.
 
 
@@ -16,3 +16,5 @@ CatBoost
 .. autofunction:: bentoml.catboost.load_model
 
 .. autofunction:: bentoml.catboost.get
+
+.. autofunction:: bentoml.catboost.get_service
diff --git a/docs/source/reference/frameworks/detectron.rst b/docs/source/reference/frameworks/detectron.rst
@@ -5,7 +5,7 @@ Detectron
 .. admonition:: About this page
 
    This is an API reference for Detectron in BentoML. Please refer to
-   :doc:`Detectron guide </frameworks/detectron>` for more information about how to use
+   :doc:`Detectron guide </reference/frameworks/detectron>` for more information about how to use
    Detectron in BentoML.
 
 .. currentmodule:: bentoml.detectron

diff --git a/docs/source/reference/frameworks/index.rst b/docs/source/reference/frameworks/index.rst
@@ -5,7 +5,7 @@ Framework APIs
 .. note::
 
     This page contains the API reference for all frameworks. For more information on a specific
-    framework, please see :doc:`/frameworks/index`
+    framework, please see :doc:`/reference/frameworks/index`
 
 .. grid:: 1 2 2 2
     :gutter: 3

diff --git a/docs/source/reference/frameworks/lightgbm.rst b/docs/source/reference/frameworks/lightgbm.rst
@@ -16,3 +16,5 @@ LightGBM
 .. autofunction:: bentoml.lightgbm.load_model
 
 .. autofunction:: bentoml.lightgbm.get
+
+.. autofunction:: bentoml.lightgbm.get_service
diff --git a/docs/source/reference/frameworks/mlflow.rst b/docs/source/reference/frameworks/mlflow.rst
@@ -23,4 +23,4 @@ MLflow
 
 .. autofunction:: bentoml.mlflow.get
 
-.. autofunction:: bentoml.mlflow.get_mlflow_model
+.. autofunction:: bentoml.mlflow.get_service
diff --git a/docs/source/reference/frameworks/transformers.rst b/docs/source/reference/frameworks/transformers.rst
@@ -5,7 +5,7 @@ Transformers
 .. admonition:: About this page
 
    This is an API reference for 🤗 Transformers in BentoML. Please refer to
-   :doc:`Transformers guide </frameworks/transformers>` for more information about how to use
+   :doc:`Transformers guide </reference/frameworks/transformers>` for more information about how to use
    Hugging Face Transformers in BentoML.
 
 .. currentmodule:: bentoml.transformers

diff --git a/docs/source/reference/frameworks/xgboost.rst b/docs/source/reference/frameworks/xgboost.rst
@@ -5,7 +5,7 @@ XGBoost
 .. admonition:: About this page
 
    This is an API reference for XGBoost in BentoML. Please refer to the
-   :doc:`XGBoost guide </frameworks/xgboost>` for more information about how to use XGBoost
+   :doc:`XGBoost guide </reference/frameworks/xgboost>` for more information about how to use XGBoost
    in BentoML.
 
 
@@ -22,3 +22,5 @@ XGBoost
 .. autofunction:: bentoml.xgboost.load_model
 
 .. autofunction:: bentoml.xgboost.get
+
+.. autofunction:: bentoml.xgboost.get_service
diff --git a/docs/source/use-cases/audio/whisperx.rst b/docs/source/use-cases/audio/whisperx.rst
@@ -163,7 +163,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
         - ffmpeg
         - git
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/audio/xtts.rst b/docs/source/use-cases/audio/xtts.rst
@@ -162,7 +162,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
       - name: "COQUI_TOS_AGREED"
         value: 1
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/custom-models/mlflow.rst b/docs/source/use-cases/custom-models/mlflow.rst
@@ -181,7 +181,7 @@ Specify a configuration YAML file (``bentofile.yaml``) to define the build optio
         - mlflow
         - scikit-learn
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/custom-models/xgboost.rst b/docs/source/use-cases/custom-models/xgboost.rst
@@ -217,7 +217,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
         - xgboost
         - scikit-learn
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/diffusion-models/controlnet.rst b/docs/source/use-cases/diffusion-models/controlnet.rst
@@ -209,7 +209,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
         system_packages:
           - ffmpeg
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/diffusion-models/sdxl-lcm-lora.rst b/docs/source/use-cases/diffusion-models/sdxl-lcm-lora.rst
@@ -171,7 +171,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
     python:
       requirements_txt: "./requirements.txt"
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/diffusion-models/sdxl-turbo.rst b/docs/source/use-cases/diffusion-models/sdxl-turbo.rst
@@ -160,7 +160,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
     python:
       requirements_txt: "./requirements.txt"
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/diffusion-models/svd.rst b/docs/source/use-cases/diffusion-models/svd.rst
@@ -181,7 +181,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
         - ffmpeg
         - git
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/embeddings/clip-embeddings.rst b/docs/source/use-cases/embeddings/clip-embeddings.rst
@@ -207,7 +207,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
     python:
       requirements_txt: "./requirements.txt"
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/embeddings/sentence-transformer.rst b/docs/source/use-cases/embeddings/sentence-transformer.rst
@@ -181,7 +181,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
       env:
         NORMALIZE : "True"
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/index.rst b/docs/source/use-cases/index.rst
@@ -45,6 +45,12 @@ This section provides a variety of example projects for you to learn how BentoML
 
         Deploy custom models with BentoML.
 
+    .. grid-item-card:: :doc:`/use-cases/custom-models/index`
+        :link: /use-cases/custom-models/index
+        :link-type: doc
+
+        Deploy custom models with BentoML.
+
 .. toctree::
     :maxdepth: 1
     :titlesonly:

diff --git a/docs/source/use-cases/large-language-models/vllm.rst b/docs/source/use-cases/large-language-models/vllm.rst
@@ -264,7 +264,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
     envs:
       - name: HF_TOKEN
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, set the environment variable for your Hugging Face token, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, set the environment variable for your Hugging Face token, then run the following command to deploy the project.
 
 .. code-block:: bash
 

diff --git a/docs/source/use-cases/multimodality/blip.rst b/docs/source/use-cases/multimodality/blip.rst
@@ -140,7 +140,7 @@ First, specify a configuration YAML file (``bentofile.yaml``) to define the buil
     python:
       requirements_txt: "./requirements.txt"
 
-:ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+:ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
 
 .. code-block:: bash
Original file line number	Diff line number	Diff line change
Expand Up		@@ -16,3 +16,5 @@ LightGBM
		.. autofunction:: bentoml.lightgbm.load_model

		.. autofunction:: bentoml.lightgbm.get

		.. autofunction:: bentoml.lightgbm.get_service
Original file line number	Diff line number	Diff line change
Expand Up		@@ -23,4 +23,4 @@ MLflow

		.. autofunction:: bentoml.mlflow.get

		.. autofunction:: bentoml.mlflow.get_mlflow_model
		.. autofunction:: bentoml.mlflow.get_service
-Original file line number
+Diff line change
@@ Expand Up @@
             - ffmpeg
             - git
-    :ref:`Create an API token with Developer Operations Access to log in to BentoCloud <bentocloud/how-tos/manage-access-token:create an api token>`, then run the following command to deploy the project.
+    :ref:`Log in to BentoCloud <bentocloud/how-tos/manage-access-token:Log in to BentoCloud using the BentoML CLI>` by running ``bentoml cloud login``, then run the following command to deploy the project.
     .. code-block:: bash
@@ Expand Down @@