Release Promitor Scraper v2.0.0-rc · tomkerkhove/promitor

Highlights

Support for Atlassian Statupage

We've introduced a new metric sink that allows you to push metrics to Atlassian Statuspage
(docs)!

Learn more how to Promitor in our documentation

Introducing Resource Discovery

With Promitor 2.0 we are introducing resource discovery by introducing a new agent, Promitor Resource Discovery!

You can now reference resource discovery groups in your metrics declaration which will be used to discover resources by using Azure Resource Graph:

Learn more on how:

To configure Promitor Scraper to use resource discovery
To declare resource discovery groups and what the supported resources are
To deploy Promitor Resource Discovery agent
Promitor works in our documentation.

Getting started

Running Promitor Scraper is super easy:

docker run -d -p 8999:80 --name promitor-agent-scraper
                  --env PROMITOR_AUTH_APPID='<azure-ad-app-id>'   \
                  --env-file C:/Promitor/az-mon-auth.creds \
                  --volume C:/Promitor/metrics-declaration.yaml:/config/metrics-declaration.yaml \
                  tomkerkhove/promitor-agent-scraper:2.0.0-rc

Docker Image information

New Docker image tags are available:

2.0.0-rc, 2.0.0-rc-linux, 2.0.0-rc-windows
2.0, 2.0-linux, 2.0-windows

Docker image is available on Docker Hub.

For more information about our tagging strategy, feel free to read our documentation.

What's new?

Here are some important things you should know, for a full list see changelog.promitor.io.

New

Here are a list of new features:

Support for resource discovery (docs | configuration | deployment)
Support for scraping Azure Event Hubs (docs | #372)
Support for scraping Azure Logic Apps (docs | #314).
Support for scraping Azure Express Route circuits (docs | #1251 | Contributed by @bluepixbe 🎉).
Support for scraping Azure Application Gateway (docs | #1251 | Contributed by @bluepixbe 🎉).
Support for scraping Azure Network Gateway (docs | #1264 | Contributed by @bluepixbe 🎉).
Support for scraping Azure Kubernetes Service (docs | #333 | Contributed by @jkataja 🎉).
Support for using dimensions with Azure Service Bus (#808)
New System API endpoint giving runtime information (docs
| #1208)
Provide X-Version response header for API endpoints (#1209)
Provide capability to tweak liveness/readines probes in Helm charts (#1350)
New validation rule to ensure at least one resource or resource collection is configured to scrape
Provide suggestions when unknown fields are found in the metrics config. (#1105 | Contributed by @adamconnelly 🎉).
Add validation to ensure the scraping schedule is a valid Cron expression. (#1103 | Contributed by @adamconnelly 🎉).
Provide support for pushing metrics to Atlassian Statuspage
(docs | #1152)
Provide suggestions when unknown fields are found in the metrics config. (#1105 | Contributed by @adamconnelly 🎉).
New validation rule to ensure the scraping schedule is a valid Cron expression. (#1103).
New validation rule to ensure declarative or dynamic discovery for metrics to scrape are configured
New System API endpoint giving runtime information (docs
| #1208)

Fixes

Here are a list of fixes:

Resource discovery is not configured, but still blocked by scraper validation #1202
Ensure Prometheus metric sink does write timestamps #1217
Dimensions with / in name are now supported by replacing it with _ for Prometheus metric sink #1248
Filtering by dimensions which include / in name does not work in generic scraper #1266

Changed

Here are a list of changes:

Provide capability to scrape all queues in Azure Service Bus, instead of having to declare the queue name. #529.
Handle validation failures on startup more gracefully. #1113.
Improve time series handling to ensure finalized time series are reported
Show Promitor version during startup

Deprecations

None.

Breaking Changes

Here are a list of breaking changes and how to mitigate them:

Support for Prometheus legacy configuration is removed (deprecation notice | migration guide)
Support for Swagger UI 2.0 is removed (deprecation notice | migration guide)
Support for Swagger 2.0 is removed (deprecation notice | migration guide)

Learn how to migrate to 2.0 with our migration guide.

Detailed Changes:

Bugs:

#1217: Metric sink does not write timestamps for Prometheus

Others:

#1381: chore: Verify if scrape definition is created correctly
#1382: docs: Only use changelog for stable versions
#808: Allow EntityPath as a dimension for Service Bus metrics
#1378: feat: Allow EntityPath as a dimension for Service Bus metrics #808
#1377: chore(deps): update dependency lint-staged to v10.5.2
#1376: chore: Remove support for Helm 2
#1369: fix: Metrics without a timeseries are not reported

See More

#1364: docs: Thank you Semantic Pull Requests
#1359: Include namespace name in Helm charts
#1360: Align test outcome with Azure subscription
#1356: Provide integration tests for other operations
#1355: Provide X-Version response header for API endpoints
#1354: Cleanup Helm chart
#1352: Provide capability to tweak liveness/readines probes
#1353: Update expected test results with reality
#1351: Update dependency markdownlint-cli to v0.25.0
#1343: Provide documentation on required permissions for resource discovery
#1348: Update README.md
#1344: Update .NET Core Docker containers Docker tags
#1345: Update dependency JustEat.StatsD to v4.2.0
#1347: Update dependency Microsoft.ApplicationInsights to v2.16.0
#1346: Update dependency Moq to v4.15.1
#1342: General documentation improvements for resource discovery
#1341: Provide samples to all scrapers that support Resource Discovery
#1333: Update dependency Microsoft.NET.Test.Sdk to v16.8.0
#1338: Update arcus observability monorepo to v1
#1330: Update dependency Flurl to v3
#1331: Provide automated release pipeline for Resource Discovery agent
#1329: Update dependency lint-staged to v10.5.1
#1328: Provide documentation for installing Resource Discovery chart
#1327: Update dependency lint-staged to v10.5.0
#1326: Rename promitor-agent-discovery image to promitor-agent-resource-discovery
#1315: Provide functional Helm chart for Resource Discovery
#1322: Provide scraper for Azure Kubernetes Service
#1324: Update dependency Prometheus.Client.AspNetCore to v4.1.1
#1325: Update azure azure-libraries-for-net monorepo to v1.35.0
#1323: Update dependency Prometheus.Client to v4.2.0
#1321: Provide updated dev guide to include build arg
#1319: Thanks @RichiCoder1 for your support!
#1318: Update dependency lint-staged to v10.4.2
#1317: Update dependency AutoMapper to v10.1.1
#1316: Update dependency lint-staged to v10.4.1
#1314: .NET Version Update - Build & run new versions
#1313: Update dependency Swashbuckle.AspNetCore.Filters to v6.0.1
#1310: Update dependency AutoMapper.Extensions.Microsoft.DependencyInjection to v8.1.0
#1309: Update dependency AutoMapper to v10.1.0
#1311: Update dependency Microsoft.VisualStudio.Azure.Containers.Tools.Targets to v1.10.10
#1306: Update dependency Microsoft.AspNetCore.Mvc.NewtonsoftJson to v3.1.9
#1308: Update dependency Moq to v4.14.7
#1307: Update .NET Core Docker containers Docker tags
#1305: Update aspnet Extensions monorepo to v3.1.9
#1303: Push CI Helm chart with CI Helm chart name
#1302: Fix broken link to deployment guidance
#1299: Update dependency Bogus to v31.0.3
#1298: Update dependency markdownlint-cli to v0.24.0
#1297: Update dependency Moq to v4.14.6
#1295: Update Arcus Observability to v0.4.0
#1296: Update dependency Microsoft.Azure.Services.AppAuthentication to v1.6.0
#1294: Provide boilerplate for Resource Discovery Helm chart
#1293: Update dependency Swashbuckle.AspNetCore.Filters to v6
#1292: Update Swashbuckle monorepo to v5.6.3
#1291: Update Swashbuckle monorepo to v5.6.2
#1289: Give attribution to @bluepixbe
#1265: Provide support for scraping Azure Network Gateway
#1288: Use new test amounts for discovery to reflect Azure landscape
#1286: Use Alpine
#1285: Update dependency Prometheus.Client.DependencyInjection to v0.2.0
#1282: Update dependency lint-staged to v10.4.0
#1281: Update Swashbuckle monorepo to v5.6.1
#1280: Update dependency Microsoft.ApplicationInsights to v2.15.0
#1278: Update Swashbuckle monorepo to v5.6.0
#1276: Update dependency Bogus to v31
#1277: Provide changelog for v2.0.0-preview-3
#1273: Filtering by dimensions which include / in name does not work in generic scraper
#1275: Show Promitor version during startup
#1274: Update dependency Serilog to v2.10.0
#1272: Update .NET Core Docker containers Docker tags
#1270: Update aspnet Extensions monorepo to v3.1.8
#1271: Thank you everybody for your contributions!
#1260: Improve Helm chart - Use metric sink approach for Prometheus & general refresh
#1268: Update dependency husky to v4.3.0
#1267: Update dependency Microsoft.VisualStudio.Azure.Containers.Tools.Targets to v1.10.9
#1261: Provide support for scraping Azure Application Gateway
#1262: Update dependency lint-staged to v10.3.0
#1254: Provide support for scraping metrics for Azure ExpressRoute circuits
#1259: Dimensions with / in name are now supported by replacing it with _ for Prometheus metric sink
#1258: Provide changelog for 2.0.0-preview-1 & 2.0.0-preview-2
#1199: Helm chart should always use the correct image tag
#1253: Sanitize label names to comply with Prometheus requirements
#1252: Introduce custom asserts for validation outcome
#1249: Provide validation rules for resource discovery agent
#1246: [ImgBot] Optimize images
#1245: Welcom Vsoft, a Promitor user!
#1242: Update dependency lint-staged to v10.2.13
#1240: Update dependency lint-staged to v10.2.12
#1235: Improve resource discovery & Prometheus setup
#1232: Update dependency Microsoft.NET.Test.Sdk to v16.7.1
#1233: Provide better docs on contributing
#1224: Update dependency Prometheus.Client to v4
#1231: Update dependency Microsoft.Azure.Storage.Queue to v11.2.2
#1228: Use build/install-sdk.yml for all templates
#1222: Update .NET Core Docker containers Docker tags
#1227: Migrate to "Use .NET Core 2.*" task and introduce parameters with validation
#1226: Update dependency Microsoft.Azure.Storage.Queue to v11.2.1
#1225: Update dependency Prometheus.Client.AspNetCore to v4
#1223: Restructure templates for pipelines
#1219: Assign version when building Docker image and introduce system endpoint
#1221: Stamp version for release
#1220: Update dependency Bogus to v30.0.4
#1218: Ensure Prometheus metric sink does write timestamps (#1217)
#1216: Update dependency Bogus to v30.0.3
#1215: Fix typo
#1211: Update .NET Core Docker containers Docker tags
#1210: Update aspnet Extensions monorepo to v3.1.7
#1212: Fix integration tests due to new Azure resources
#1207: Preview releases should not push {major}.{minor} tag
#1206: Upgrade doc depenencies and patch CVE-2020-14001
#1205: Provide capability to scrape all queues in Azure Service Bus
#1204: Add Azure Event Hubs metric to local config
#1203: Provide Azure Event hubs scraper
#1202: Resource discovery is not configured, but still blocked by scraper validation
#1201: Update dependency Microsoft.NET.Test.Sdk to v16.7.0
#1198: Update dependency Bogus to v30
#1193: Update dependency xunit.runner.visualstudio to v2.4.3
#1191: [ImgBot] Optimize images
#1192: Provide documentation on how to configure integration with Promitor Resource Discovery agent
#1190: Provide an overview of how Promitor works
#1189: [ImgBot] Optimize images
#1188: Provide schematics on how Promitor works
#1187: Update dependency Microsoft.Azure.Storage.Queue to v11.2.0
#1175: Provide documentation about resource discovery
#1184: Provide support for resource discovery in all Azure Clouds
#1179: Update dependency Serilog.AspNetCore to v3.4.0
#1174: Provide documentation about resource discovery health check in scraper health endpoint
#1173: Provide versioning in resource discovery group configuration & explicitly mention inclusion criteria
#1172: Provide discovery for network interface, SQL DB/Managed instance storage account and PostgreSQL
#1169: Request OSS org for Netlify
#1168: [Docs] Security upgrade github-pages from 204 to 206
#1165: Provide resource discovery support for more scrapers
#1164: Simplify resource discovery query building to reduce duplication, but still be open
#1163: Update dependency AutoMapper.Extensions.Microsoft.DependencyInjection to v8.0.1
#1162: Provide resource discovery support for VMs & Virtual Machine Scale Set (VMSS)
#1161: Update dependency Microsoft.Extensions.Http to v3.1.6
#1098: Improve time series handling to ensure finalized time series are reported
#1154: Provide support for Atlassian Statuspage as sink
#1160: Container Scanning
#1159: Configure code scanning
#1158: Update .NET Core Docker containers Docker tags
#1157: Update aspnet Extensions monorepo to v3.1.6
#1156: Provide scraper for Azure Logic Apps
#1155: Update dependency AutoMapper.Extensions.Microsoft.DependencyInjection to v8
#1153: Update arcus observability monorepo to v0.3.0
#1151: Document possibility to use code tour for adding new scrapers
#1150: Add a few code tours
#1148: Simplify how we use validation
#1144: Update discovery agent startup to match scraper
#1142: Provide validation rule to verify if resource discovery is configured when metric discovery is used
#1141: Rename resource collections to resource discovery groups
#1140: Remove deprecated Prometheus configuration
#1139: Document how to add support for resource discovery
#1136: Update dependency Moq to v4.14.5
#1137: Update dependency AutoMapper to v10
#1138: Align integration tests with new Azure landscape
#1081: Provide integration between scraper & resource discovery agents
#1117: Update dependency markdownlint-cli to v0.23.2
#1114: Exit gracefully if a validation error occurs
#1112: Update Swashbuckle monorepo to v5.5.1
#1109: Update dependency Swashbuckle.AspNetCore.Filters to v5.1.2
#1108: Update dependency Moq to v4.14.4
#1104: Ensure that schedule is a valid Cron expression
#1107: Report validation error if resources not specified
#806: Provide validation to ensure resources are defined
#1106: Provide possible suggestions for unknown fields
#1105: Provide suggestions for unknown fields
#1101: Update Swashbuckle monorepo to v5.5.0
#1100: Update dependency Moq to v4.14.3
#1096: Update all the resource type deserializers
#1091: Use new fluent mapping for all deserializers
#1095: Update dependency lint-staged to v10.2.11
#1093: Update all the core deserializers
#1094: Update dependency Moq to v4.14.2
#1092: Update tests to use new mapping syntax
#1089: Improve fluent mapping
#1088: Update dependency lint-staged to v10.2.10
#1087: Update azure azure-libraries-for-net monorepo to v1.34.0
#1085: Update .NET Core Docker containers Docker tags
#1083: Update aspnet Extensions monorepo to v3.1.5
#1082: Remove Swagger (UI) 2.0 support
#1080: Fix bad collection name
#1078: Schedule job per resource collection and discover resources for the collection name
#1075: Update dependency lint-staged to v10.2.9
#1072: Improve deprecation dates on changelog.promitor.io
#1071: Provide configuration & validation for using resource collection
#1070: Update dependency lint-staged to v10.2.8
#1068: Update dependency Microsoft.Azure.Storage.Queue to v11.1.7
#1067: Preview releases should not push latest tag
#1066: Update dependency xunit.runner.visualstudio to v2.4.2
#1064: Provide capability to configure resource discovery with Helm chart
#1062: Dependency tracking graph
#1061: Provide changelog for v1.6.1

This list of changes was auto generated.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Promitor Scraper v2.0.0-rc