Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

store-gateway: add series filtering metrics #4797

Merged
merged 6 commits into from
Apr 21, 2023

Conversation

dimitarvdimitrov
Copy link
Contributor

@dimitarvdimitrov dimitarvdimitrov commented Apr 20, 2023

Background

Around the work in #4593 we added the possibility to fetch series that don't necessarily match the request.
However, we aren't really measuring the proportion of series that are discarded because they don't match the request.

What this PR does

Ideally we'd want to measure the volume of data that is discarded, but this is more difficult. I believe that measuring
the number of series will be a good proxy for the volume of data too. This PR does that.

This PR adds the stage label on cortex_bucket_store_series_data_touched{data_type="series"} metrics. It can take
the value returned or processed (same as the chunks equivalent).

This PR also fixes a type in the mixin and clarifies the help texts of cortex_bucket_store_series_result_series.

Which issue(s) this PR fixes or relates to

n/a

Checklist

  • [n/a] Tests updated
  • [n/a] Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Around the work of issue 4593 we added the possibility to fetch series that don't necessarily match the request.
However, we aren't really measuring the proportion of series that are discarded because they don't match the request.

Ideally we'd want to measure the volume of data that is discarded, but this is more difficult. I believe that measuring
the number of series will be a good proxy for the volume of data too. This PR does that.

This PR adds the `stage` label on `cortex_bucket_store_series_data_touched{data_type="series"}` metrics. It can take
the value `returned` or `processed` (same as the `chunks` equivalent).

This PR also fixes a type in the mixin and clarifies the help texts of `cortex_bucket_store_series_result_series`.

Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
@dimitarvdimitrov dimitarvdimitrov changed the title store-gateway: improve series filtering metrics store-gateway: add series filtering metrics Apr 20, 2023
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
@pracucci pracucci self-requested a review April 21, 2023 12:44
@dimitarvdimitrov dimitarvdimitrov enabled auto-merge (squash) April 21, 2023 13:33
@dimitarvdimitrov dimitarvdimitrov merged commit 1181ab1 into main Apr 21, 2023
@dimitarvdimitrov dimitarvdimitrov deleted the dimitar/st-gw/series-filtering-metrics branch April 21, 2023 13:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants