Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

new receiver prometheusremotewritereceiver #14752

Conversation

adamkubon
Copy link

@adamkubon adamkubon commented Oct 6, 2022

Description: New prometheusremotewrite receiver.

Link to tracking Issue: #10358

Testing: New receiver can consume the prometheus remote write protocol

Documentation: Markdown README with config description added

@@ -178,6 +178,7 @@ receiver/otlpjsonfilereceiver/ @open-telemetry/collector-c
receiver/postgresqlreceiver/ @open-telemetry/collector-contrib-approvers @djaglowski
receiver/prometheusexecreceiver/ @open-telemetry/collector-contrib-approvers @dmitryax
receiver/prometheusreceiver/ @open-telemetry/collector-contrib-approvers @Aneurysm9 @dashpole
receiver/prometheusremotewritereceiver/ @open-telemetry/collector-contrib-approvers @Norbertwnuk @adamkubon
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @norbertwnuk 👋🏽, nice to see you here!

@jpkrohling jpkrohling requested review from kovrus and a team October 6, 2022 12:47
@adamkubon adamkubon force-pushed the feature/prometheusremotewritereceiver branch from a688e2d to 6a9ddec Compare October 7, 2022 13:32
@adamkubon adamkubon force-pushed the feature/prometheusremotewritereceiver branch from 6a9ddec to 1b25f8e Compare October 10, 2022 12:46
@jpkrohling
Copy link
Member

@norbertwnuk, could you also please review this one? This cannot be merged until we have at least one sponsor for this component. Besides that, I would like to ask what would be your availability in the future to maintain this component.

Copy link
Member

@jpkrohling jpkrohling left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Blocking this from being merged until it has a sponsor.

@github-actions
Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@github-actions github-actions bot added the Stale label Oct 27, 2022
@adamkubon adamkubon force-pushed the feature/prometheusremotewritereceiver branch 4 times, most recently from d33b9dd to 5e4ba23 Compare November 7, 2022 16:05
@github-actions github-actions bot removed the Stale label Nov 8, 2022
@jpkrohling
Copy link
Member

@adamkubon, @norbertwnuk, are you still interested in this one?

@adamkubon
Copy link
Author

Yes definitely We are, sorry for late response due to PTO

@kovrus
Copy link
Member

kovrus commented Nov 15, 2022

Hi @adamkubon @norbertwnuk, I would like to join you with the work on the remote-write receiver since I have some time allocated for this work and further share the code ownership for this component. I am also fine with taking it over if you do not have enough resources.

I have no comments regarding the component itself, but we would have to develop some strategy for Prometheus -> OTLP metrics mapping. We might probably have to think about using metadata that is pushed via rw or maybe querying Prometheus API for metadata to correctly determine metrics types since it is not always possible to infer it from the metric name?
Also, If you look at the prometheusreceiver receiver component, it already contains the mapping logic that we need and uses metadata storage. Maybe we can take a look at it and think about whether it makes to move some parts of it to pkg/translate and revise this prometheus-metric-to-opentelemetry-metric-proto-mapping documentation, etc. Also, we can think of introducing roundtrip tests for the metrics mapping. I am happy to discuss it further asynchronously or jump on a call.

@felix
Copy link

felix commented Nov 16, 2022

Hi, what is involved in becoming a sponsor?

We at MYOB use remotewrite -> OTLP heavily with our own custom receiver (amongst several others) and may consider sponsorship.

@kovrus
Copy link
Member

kovrus commented Nov 17, 2022

Hi, what is involved in becoming a sponsor?

We at MYOB use remotewrite -> OTLP heavily with our own custom receiver (amongst several others) and may consider sponsorship.

Sponsorship is about finding a maintainer or approver who will act as official reviewer and one of code owners for this component, see https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/CONTRIBUTING.md#adding-new-components

@aunshc
Copy link
Contributor

aunshc commented Nov 30, 2022

@kovrus any luck with finding a sponsor so far?

@kovrus
Copy link
Member

kovrus commented Nov 30, 2022

@kovrus any luck with finding a sponsor so far?

Yes, see #14751. I've been doing some research and now working on the design doc for this component.

@github-actions
Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@futurist
Copy link

Is there any update of this PR? We need this feature. +1

And seems it's lots of changes in main, and this PR cannot run with the latest main branch, can you update to latest version so we can build a custom binary?

@kovrus
Copy link
Member

kovrus commented Mar 24, 2023

Is there any update of this PR? We need this feature. +1

And seems it's lots of changes in main, and this PR cannot run with the latest main branch, can you update to latest version so we can build a custom binary?

I think that @atoulme mentioned that there was someone who wanted to contribute probably something close to the "best effort" implementation from this design doc.

@hughesjj
Copy link
Contributor

I have a branch on my end I'm testing which will impl it via best effort. Sorry I should have started from this PR but I more or less wrote an independent one with an aim of replacing some functionality on our end. I was going to merge it into our "splunk" distribution of the collector to vet it before merging upstream, but if you think it worthy I could try to directly target -contrib

@hughesjj
Copy link
Contributor

.... Looking over your code vs mine, I think we'll (my team) put it in our (splunk's) distro and be guinnea pigs for testing the conversion, and then take only the translation+cache stuff from mine and either have you or I migrate it + include it in this PR. Feel free to ping me on the otel slack if you want to followup

@hughesjj
Copy link
Contributor

Oh also, I'm putting this on the prometheus working group agenda for April 26th @ 8AM PDT

Anyone interested in this PR is free to join. Sorry I'll be deploying it in our distro first, but PRW like functionality is in the critical path for us to sunset our pre-otel client and thus needed to be expedited.

@hughesjj
Copy link
Contributor

Hey, brought this up in today's prometheus working group, more updates to follow

@atoulme atoulme added the Sponsor Needed New component seeking sponsor label May 19, 2023
@github-actions github-actions bot removed the Stale label May 26, 2023
@kelseyma
Copy link

Hi all! Was wondering if there are any updates on this?

@github-actions
Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@github-actions github-actions bot added the Stale label Jun 14, 2023
@kovrus kovrus removed the Stale label Jun 14, 2023
@futurist
Copy link

futurist commented Jun 15, 2023

We need it, please don't close it. Is there any update?

@github-actions
Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@github-actions
Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@github-actions github-actions bot added the Stale label Jul 25, 2023
@jpkrohling
Copy link
Member

Is anyone interested in picking up this one? I'm closing for now, but if you want to continue working on this, I'll reopen it.

@ernado
Copy link

ernado commented Jan 8, 2024

Hey @jpkrohling, what is the process and requirements for becoming a sponsor?

@atoulme
Copy link
Contributor

atoulme commented Jan 9, 2024

Approvers and maintainers are sponsors on this repository: https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/CONTRIBUTING.md#adding-new-components

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.