Skip to content

Commit

Permalink
additional updates
Browse files Browse the repository at this point in the history
  • Loading branch information
syaseen-rh committed Apr 17, 2024
1 parent 3066372 commit 327c03a
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ The single-model serving platform includes serving runtime metrics for link:{rho

For example, the OpenVINO model serving runtime exposes metrics related to inference execution queues, model runtime parameters and model usage. These metrics can be queried using the `ovms_*` expression. For more information, see link:https://docs.openvino.ai/2024/ovms_docs_metrics.html#available-metrics-families[OVMS metrics].

Similarly, metrics for the TGIS Standalone model serving runtime can be queried with the `tgis_*` expression. For more information, see link:https://github.com/IBM/text-generation-inference?tab=readme-ov-file#metrics[TGIS metrics]
Similarly, metrics for the TGIS Standalone model serving runtime can be queried with the `tgis_*` expression. For more information, see link:https://github.com/IBM/text-generation-inference?tab=readme-ov-file#metrics[TGIS metrics].

When you have configured monitoring, you can also view serving runtime metrics for the KServe component. You can also view metrics for OpenShift Service Mesh, which helps you to understand dependencies and traffic flow between components in the mesh.
endif::[]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ endif::[]
. Switch to the *Developer* perspective.
. In the left menu, click *Observe*.
ifdef::upstream,self-managed[]
. As described in link:https://access.redhat.com/documentation/en-us/openshift_container_platform/{ocp-latest-version}/html/building_applications/odc-monitoring-project-and-application-metrics-using-developer-perspective#odc-monitoring-your-project-metrics_monitoring-project-and-application-metrics-using-developer-perspective[monitoring project metrics^], use the web console to run queries for `caikit_*`, `tgi_*`, `ovms_*` or `istio_*` metrics.
. As described in link:https://access.redhat.com/documentation/en-us/openshift_container_platform/{ocp-latest-version}/html/building_applications/odc-monitoring-project-and-application-metrics-using-developer-perspective#odc-monitoring-your-project-metrics_monitoring-project-and-application-metrics-using-developer-perspective[monitoring project metrics^], use the web console to run queries for `caikit_*`, `tgi_*` and `ovms_*` serving runtime metrics. You can also run queries for OpenShift Service Mesh or `istio_*` metrics.
endif::[]
ifdef::cloud-service[]
. As described in link:https://docs.openshift.com/dedicated/monitoring/managing-metrics.html#querying-metrics-for-user-defined-projects-as-a-developer_managing-metrics[Querying metrics for user-defined projects as a developer^] (Red Hat OpenShift Dedicated) or link:https://docs.openshift.com/rosa/monitoring/managing-metrics.html#querying-metrics-for-user-defined-projects-as-a-developer_managing-metrics[Querying metrics for user-defined projects as a developer^] (Red Hat OpenShift Service on AWS), use the web console to run queries for `caikit_*`, `tgi_*` and `ovms_*` serving runtime metrics. You can also run queries for OpenShift Service Mesh or `istio_*` metrics.
Expand Down

0 comments on commit 327c03a

Please sign in to comment.