Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Global metrics show N/A in Seldon Analytics Grafana #371

Closed
oshev opened this issue Jan 7, 2019 · 1 comment · Fixed by #372
Closed

Global metrics show N/A in Seldon Analytics Grafana #371

oshev opened this issue Jan 7, 2019 · 1 comment · Fixed by #372

Comments

@oshev
Copy link

oshev commented Jan 7, 2019 •
edited
Loading

After this change

seldon-core/engine/src/main/resources/application.properties

Line 4 in 05c33d9

management.metrics.web.server.auto-time-requests=false
the metric seldon_api_engine_server_requests_seconds_count which is used to calculate Global Request Rate, Success, 4xxs, and 5xxs doesn't return any results, so all these panes show N/A.

Two possible solutions from Clive:

  • Update the dashboard to remove these panes.
  • Switch the metrics back on in a more focused way where just predict and feedback calls are tracked.
@ukclivecox ukclivecox mentioned this issue Jan 8, 2019
Merged
@oshev
Copy link
Author

oshev commented Jan 8, 2019

Thank you!

agrski pushed a commit that referenced this issue Dec 2, 2022
@ukclivecox
Refactor metrics and add separate pipeline and model metrics (#371)
5f458b9 
* refactor metrics and add separate pipeline and model metrics

* update dashboards and add memory to some models

* Add missing metrics for rpoxy and grpc proxy for 404 status codes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add @Timed to 2 main REST endpoint to readd prometheus metrics
1 participant
@oshev