Grafana dashboard for trace quality

[pavolloffay]

Resolves #16

@annanay25 could you please have a look?

Signed-off-by: Pavol Loffay ploffay@redhat.com

[annanay25]

LGTM :)

[annanay25]

Small nit: A config file and the dashboard.json can be mounted on the container directly!

Ref - https://grafana.com/docs/grafana/latest/administration/provisioning/#dashboards

[pavolloffay]

I have added a config file for datasource and dashboards. In the tracequality dashboard I hardcoded datasource Prometheus. We can change this once we introduce mixins.

[annanay25]

Dashboard creation can be templated through the mixin (we can use it for future releases if dashboards get bigger)
Ref- jaegertracing/jaeger#1668

[pavolloffay]

+1 I think we could have more dashboards.

A dashboard I am thinking about would show other derived metrics from traces per service. We could also define alerts for these metrics.

[annanay25]

I'm not sure if users would need alerts on these metrics, but definitely +1 for dashboards.

[pavolloffay]

@annanay25 the dashboard has one configurable variable - service. Do you know if grafana can be configured to search possible values of this variable based on the Prometheus metric label?

[annanay25]

Do you know if grafana can be configured to search possible values of this variable based on the Prometheus metric label?

@pavolloffay - Yes, this is definitely possible.
Something like $service = label_name("trace_quality_server_tag_total", "service") should do the trick.

References -
https://grafana.com/docs/grafana/latest/features/datasources/prometheus/#query-variable
https://banzaicloud.com/blog/grafana-templating/

[pavolloffay]

Am I doing something wrong? label_values("trace_quality_server_tag_total", "service") - I am interested to get values of the service label

[pavolloffay]

label_values("service") didn't work for me either

[pavolloffay]

I will merge this and create issue to populate label values to service dropdown.

[annanay25]

Strange, I'll try getting it working on my local machine and get back