Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mimir query engine: report estimated peak memory consumption as a metric and in traces #8270

Merged
merged 3 commits into from
Jun 6, 2024

Conversation

charleskorn
Copy link
Contributor

@charleskorn charleskorn commented Jun 4, 2024

What this PR does

This PR builds upon #8230 to add reporting of the per-query estimated peak memory consumption.

The estimate is reported as a metric and in a query stats event added to the query's trace span.

Note that for consistency with the metrics added in #7898, I've used the prefix cortex_streaming_promql_engine... for the metric name. I'll change the name to reflect the new name for the engine in a separate PR.

Which issue(s) this PR fixes or relates to

(none)

Checklist

  • Tests updated.
  • [n/a] Documentation added.
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX].
  • [n/a] about-versioning.md updated with experimental features.

@charleskorn charleskorn marked this pull request as ready for review June 4, 2024 09:54
@charleskorn charleskorn requested a review from a team as a code owner June 4, 2024 09:54
Copy link
Contributor

@jhesketh jhesketh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, metrics! LGTM, thanks.

@charleskorn charleskorn force-pushed the charleskorn/report-estimated-memory-utilisation branch from c731381 to db15467 Compare June 6, 2024 04:05
@charleskorn charleskorn enabled auto-merge (squash) June 6, 2024 04:06
@charleskorn charleskorn merged commit 9f477e4 into main Jun 6, 2024
29 checks passed
@charleskorn charleskorn deleted the charleskorn/report-estimated-memory-utilisation branch June 6, 2024 04:26
narqo pushed a commit to narqo/grafana-mimir that referenced this pull request Jun 6, 2024
…ric and in traces (grafana#8270)

* Add histogram with estimated peak memory consumption of each query

* Include estimated peak memory consumption in traces.

* Add changelog entry
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants