Merge pull request #45 from sanjaysrikakulam/esg_influxdb

Add esg influxdb queries and measurement details
usegalaxy-eu · May 23, 2024 · 9570f7e · 9570f7e
2 parents b37c75b + 48a8a8b
commit 9570f7e
Show file tree

Hide file tree

Showing 3 changed files with 23 additions and 0 deletions.
diff --git a/esg_influxdb.md b/esg_influxdb.md
@@ -0,0 +1,23 @@
+The following measurements are available for ESG use cases (TPV-metascheduler and pulsar job visualizations):
+
+Measurement name: `queue-overview`
+Example influx query
+
+```
+SELECT "job_runner_name", last("count") as "job_count" FROM "queue-overview" WHERE ("job_runner_name" =~ /^pulsar_.*/ AND "job_runner_name" != 'condor' AND "job_runner_name" != 'pulsar_embedded') AND ("state" = 'running' OR "state" = 'queued') GROUP BY "state"
+```
+
+![queue-overview](images/queue_overview_grafana.png)
+
+Alternatively, if you want to get the number for each remote compute cluster and not based on the job runners (like above)
+
+Measurement name: `queue_by_destination`
+Example influx query
+
+```
+SELECT last("count") FROM "queue_by_destination" WHERE ("destination_id" =~ /^pulsar_.*/) GROUP BY "destination_id", "state"
+```
+
+![queue_by_destination](images/queue_by_destination_grafana.png)
+
+_Access to influxdb: Ask the EU admins for ESG influxdb credentials and URLs_
diff --git a/images/queue_by_destination_grafana.png b/images/queue_by_destination_grafana.png
diff --git a/images/queue_overview_grafana.png b/images/queue_overview_grafana.png