Skip to content

Commit

Permalink
Merge pull request #229 from jbyrne-redhat/DS-4618
Browse files Browse the repository at this point in the history
DS-4618 Modify note about using self-signed certs with KServe
  • Loading branch information
jbyrne-redhat authored Mar 19, 2024
2 parents 215c018 + 6e50645 commit 5f7c533
Showing 1 changed file with 11 additions and 5 deletions.
Original file line number Diff line number Diff line change
@@ -1,15 +1,21 @@
:_module-type: CONCEPT
:self-managed:

[id="deploying-models-using-the-single-model-serving-platform_{context}"]
= Deploying models by using the single model serving platform

[role='_abstract']
On the single model serving platform, each model is deployed from its own model server. This helps you to deploy, monitor, scale, and maintain LLMs that require increased resources.
On the single model serving platform, each model is deployed on its own model server. This helps you to deploy, monitor, scale, and maintain large models that require increased resources.

[IMPORTANT]
====
If you want to use a self-signed certificate to deploy a model from S3-compatible storage, the single model serving platform (which uses KServe) requires additional configuration. For more information, see the Red Hat Knowledgebase solution article link:https://access.redhat.com/solutions/7053013[How to use self-signed certificates with KServe^].
Alternatively, you can disable SSL authentication for KServe. For more information, see the Red Hat Knowledgebase solution article link:https://access.redhat.com/solutions/7047512[How to skip the validation of SSL for KServe^].
====
ifdef::self-managed[]
If you want to use a self-signed certificate with the single-model serving platform, you must install a certificate authority (CA) bundle on your {openshift-platform} cluster. For more information, see link:{rhoaidocshome}{default-format-url}/installing_and_uninstalling_{url-productname-short}/working-with-certificates_certs#adding-a-ca-bundle_certs[Adding a CA bundle] ({productname-short} Self-Managed) or link:{rhoaidocshome}{default-format-url}/installing_and_uninstalling_{url-productname-short}_in_a_disconnected_environment/working-with-certificates_certs#adding-a-ca-bundle_certs[Adding a CA bundle] ({productname-short} Self-Managed in a disconnected environment).
endif::[]
ifdef::cloud-service[]
If you want to use a self-signed certificate with the single-model serving platform, you must install a certificate authority (CA) bundle on your OpenShift cluster. For more information, see link:{rhoaidocshome}{default-format-url}/installing_and_uninstalling_{url-productname-short}/working-with-certificates_certs#adding-a-ca-bundle_certs[Adding a CA bundle].
endif::[]
Alternatively, you can disable SSL authentication for KServe. For more information, see the Red Hat Knowledgebase solution article link:https://access.redhat.com/solutions/7047512[How to skip the validation of SSL for KServe^].
====

0 comments on commit 5f7c533

Please sign in to comment.