-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
RHOAIENG-3761: adding monitoring config and metrics viewing section for multi model #209
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a couple of comments, @syaseen-rh.
:_module-type: PROCEDURE | ||
|
||
[id="configuring-monitoring-for-the-multi-model-serving-platform_{context}"] | ||
= Configuring monitoring for the multi model serving platform |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ensure that we're hyphenating "multi-model" for all occurrences of "multi-model serving platform".
The single model serving platform includes metrics for Caikit and TGIS. You can also configure monitoring for OpenShift Service Mesh. The service mesh metrics helps you to understand dependencies and traffic flow between components in the mesh. When you have configured monitoring, you can grant Prometheus access to scrape the available metrics. | ||
|
||
ifdef::self-managed,cloud-service[] | ||
The single model serving platform includes metrics for link:{rhoaidocshome}{default-format-url}/serving_models/serving-large-models_serving-large-models#about-the-single-model-serving-platform_serving-large-models[supported runtimes]. You can also configure monitoring for OpenShift Service Mesh. The service mesh metrics helps you to understand dependencies and traffic flow between components in the mesh. When you have configured monitoring, you can grant Prometheus access to scrape the available metrics. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We need to do an overall sweep of the docs to replace "single model serving platform" with "single-model serving platform" because it was renamed to add the hyphen in 2.7. But can you update this occurrence?
The single model serving platform includes metrics for link:{rhoaidocshome}{default-format-url}/serving_models/serving-large-models_serving-large-models#about-the-single-model-serving-platform_serving-large-models[supported runtimes]. You can also configure monitoring for OpenShift Service Mesh. The service mesh metrics helps you to understand dependencies and traffic flow between components in the mesh. When you have configured monitoring, you can grant Prometheus access to scrape the available metrics. | ||
endif::[] | ||
ifdef::upstream[] | ||
The single model serving platform includes metrics for link:{odhdocshome}/serving_models/serving-large-models_serving-large-models#about-the-single-model-serving-platform_serving-large-models[supported runtimes]. You can also configure monitoring for OpenShift Service Mesh. The service mesh metrics helps you to understand dependencies and traffic flow between components in the mesh. When you have configured monitoring, you can grant Prometheus access to scrape the available metrics. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same as previous comment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great, @syaseen-rh :)
https://issues.redhat.com/browse/RHOAIENG-3761
Description
RHOAIENG-3761: Add procedure for configuring monitoring and viewing metrics on multi-model serving platform
How Has This Been Tested?
Local upstream and downstream builds
#Previews
Serving models self-managed preview.pdf