Not able to use Generic Scraper with PostgreSQL

[cnadolny]

Expected Behavior

When using the Generic Metrics Config, I should be able to view metrics from PostgreSQL. As far as I can tell I'm using the correct settings, but please let me know if this is a user error :)

Actual Behavior

I get back a response on localhost:8080/metrics, but the actual value of my metric is 0, even though there is data under the Azure Metrics Portal for the resource.

# HELP generic_postgresql_scraper Amount of active messages of the 'generic_postgresql_scraper'
# TYPE generic_postgresql_scraper gauge
generic_postgresql_scraper{resource_uri="subscriptions/<sub-id>/resourceGroups/RG/providers/Microsoft.DBforPostgreSQL/servers/claudia-postgresql"} 0 1560552019824
# HELP promitor_ratelimit_arm Indication how many calls are still available before Azure Resource Manager is going to throttle us.
# TYPE promitor_ratelimit_arm gauge
promitor_ratelimit_arm{tenant_id="<tenant-id>",subscription_id="<sub-id>",app_id="<app-id>"} 11959 1560552019771

Steps to Reproduce the Problem

1. Create Azure PostgreSQL db
2. Create metrics config
3. Deploy Promitor

Configuration

Provide insights in the configuration that you are using:
Used default scraping schedule

I used this as a reference for what metrics to scrape:
https://docs.microsoft.com/en-us/azure/azure-monitor/platform/metrics-supported#microsoftdbforpostgresqlservers

and here is my YAML:

metrics:
  - name: "generic_postgresql_scraper"
    description: "test"
    resourceType: "Generic"
    resourceUri: "Microsoft.DBforPostgreSQL/servers/claudia-postgresql"
    azureMetricConfiguration:
      metricName: "cpu_percent"
      aggregation:
        Type: "Average"

Specifications

• Version: Latest helm chart
• Platform: Windows
• Subsystem: WSL

[tomkerkhove]

That's interesting, thanks for reporting, the config looks good.

Can you provide the following please:

• Screenshot of what the Azure portal is reporting
• Verify that you are using Helm chart 0.3.0 with app version 1.0.0-preview-7
• Logs from promitor

That should give some idea what is going on. If that is not clear we can have a look at the Azure Portal HTTP trace for getting the data.

Thank you!

[cnadolny]

Confirmed that I'm using Helm chart 0.3.0 with app version 1.0.0-preview-7!

I also confirmed that I'm able to see the metric data using the Azure Monitor API, using the same parameters I'm giving Promitor (resourceUri, metric cpu_percent, aggregate Average):
https://docs.microsoft.com/en-us/rest/api/monitor/metricdefinitions/list

[tomkerkhove]

Hm that's odd. So calling Azure Monitor API with same config works on your end, but not with Promitor?

Will see if I can spin one up and give it a try.

[tomkerkhove]

I took the liberty to use your config for my instance.

When I checked the loaded configuration via http://localhost:32775/api/v1/configuration/metric-declaration, I've received the following:

[
  {
    "resourceType": "Generic",
    "resourceUri": "Microsoft.DBforPostgreSQL/servers/promitor",
    "azureMetricConfiguration": {
      "metricName": "cpu_percent",
      "aggregation": {
        "type": "None",
        "interval": "00:05:00"
      }
    },
    "description": "test",
    "name": "generic_postgresql_scraper",
    "resourceGroupName": "promitor",
    "scraping": {
      "schedule": "0 * * ? * *"
    }
  }
]

Note that aggregation.type is none rather than average because of azureMetricConfiguration.aggregation.Type rather than azureMetricConfiguration.aggregation.type.

Once that is changed, it should work fine:

# HELP generic_postgresql_scraper test
# TYPE generic_postgresql_scraper gauge
generic_postgresql_scraper{resource_uri="subscriptions/<subscription id>/resourceGroups/promitor-sources/providers/Microsoft.DBforPostgreSQL/servers/promitor"} 0.7525 1560789602044

Can you please try fixing the config please?

I'll open an issue to streamline this so that it should be logged and blocked, sorry for that!

[cnadolny]

Changing it from Type to type worked - thanks Tom!

[tomkerkhove]

Good to hear and sorry for this hickup!