-
Notifications
You must be signed in to change notification settings - Fork 18
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #229 from jbyrne-redhat/DS-4618
DS-4618 Modify note about using self-signed certs with KServe
- Loading branch information
Showing
1 changed file
with
11 additions
and
5 deletions.
There are no files selected for viewing
16 changes: 11 additions & 5 deletions
16
modules/deploying-models-using-the-single-model-serving-platform.adoc
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,15 +1,21 @@ | ||
:_module-type: CONCEPT | ||
:self-managed: | ||
|
||
[id="deploying-models-using-the-single-model-serving-platform_{context}"] | ||
= Deploying models by using the single model serving platform | ||
|
||
[role='_abstract'] | ||
On the single model serving platform, each model is deployed from its own model server. This helps you to deploy, monitor, scale, and maintain LLMs that require increased resources. | ||
On the single model serving platform, each model is deployed on its own model server. This helps you to deploy, monitor, scale, and maintain large models that require increased resources. | ||
|
||
[IMPORTANT] | ||
==== | ||
If you want to use a self-signed certificate to deploy a model from S3-compatible storage, the single model serving platform (which uses KServe) requires additional configuration. For more information, see the Red Hat Knowledgebase solution article link:https://access.redhat.com/solutions/7053013[How to use self-signed certificates with KServe^]. | ||
Alternatively, you can disable SSL authentication for KServe. For more information, see the Red Hat Knowledgebase solution article link:https://access.redhat.com/solutions/7047512[How to skip the validation of SSL for KServe^]. | ||
==== | ||
ifdef::self-managed[] | ||
If you want to use a self-signed certificate with the single-model serving platform, you must install a certificate authority (CA) bundle on your {openshift-platform} cluster. For more information, see link:{rhoaidocshome}{default-format-url}/installing_and_uninstalling_{url-productname-short}/working-with-certificates_certs#adding-a-ca-bundle_certs[Adding a CA bundle] ({productname-short} Self-Managed) or link:{rhoaidocshome}{default-format-url}/installing_and_uninstalling_{url-productname-short}_in_a_disconnected_environment/working-with-certificates_certs#adding-a-ca-bundle_certs[Adding a CA bundle] ({productname-short} Self-Managed in a disconnected environment). | ||
endif::[] | ||
ifdef::cloud-service[] | ||
If you want to use a self-signed certificate with the single-model serving platform, you must install a certificate authority (CA) bundle on your OpenShift cluster. For more information, see link:{rhoaidocshome}{default-format-url}/installing_and_uninstalling_{url-productname-short}/working-with-certificates_certs#adding-a-ca-bundle_certs[Adding a CA bundle]. | ||
endif::[] | ||
Alternatively, you can disable SSL authentication for KServe. For more information, see the Red Hat Knowledgebase solution article link:https://access.redhat.com/solutions/7047512[How to skip the validation of SSL for KServe^]. | ||
==== |