Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New component: Azure Blob Receiver #8834

Closed
eedorenko opened this issue Mar 24, 2022 · 6 comments · Fixed by #11872 or #12418
Closed

New component: Azure Blob Receiver #8834

eedorenko opened this issue Mar 24, 2022 · 6 comments · Fixed by #11872 or #12418
Labels
Accepted Component New component has been sponsored

Comments

@eedorenko
Copy link
Contributor

eedorenko commented Mar 24, 2022

The purpose and use-cases of the new component

This receiver reads logs and traces from Azure Blob Storage.

Correlates with #8823

Example configuration for the component

The following settings are required:

  • connection_string (no default): Azure Blob Storage connection key, which can be found in the Azure Blob Storage resource on the Azure Portal.
  • event_hub_end_point (no default): Azure Event Hub endpoint triggering on the Blob Create event

The following settings can be optionally configured:

  • logs_container_name (default = "logs"): Name of the blob container with the logs
  • traces_container_name (default = "traces"): Name of the blob container with the traces

Example:

receivers:
  azureblob:
    connection_string: DefaultEndpointsProtocol=https;AccountName=accountName;AccountKey=+idLkHYcL0MUWIKYHm2j4Q==;EndpointSuffix=core.windows.net
    event_hub_end_point: Endpoint=sb://oteldata.servicebus.windows.net/;SharedAccessKeyName=otelhubbpollicy;SharedAccessKey=mPJVubIK5dJ6mLfZo1ucsdkLysLSQ6N7kddvsIcmoEs=;EntityPath=otellhub    

The receiver subscribes on the events published by Azure Blob Storage and handled by Azure Event Hub. When it receives Blob Create event, it reads the logs or traces from a corresponding blob and deletes it after processing.

Telemetry data types supported

Logs, Traces

Sponsor

Sponsor is needed

@codeboten codeboten added the Sponsor Needed New component seeking sponsor label Mar 29, 2022
@codeboten
Copy link
Contributor

@reyang @lzchen any chance someone over at Microsoft is available to sponsor this component?

@reyang
Copy link
Member

reyang commented Apr 6, 2022

@reyang @lzchen any chance someone over at Microsoft is available to sponsor this component?

Not that I'm aware of.

@jpkrohling
Copy link
Member

I scheduled some time to talk about this during the next SIG call, given that we don't seem to have volunteers for this. Could you please confirm you are affiliated with Azure and that this is a component backed by a vendor (Microsoft)?

@pmm-sumo
Copy link
Contributor

I will be happy to help with the initiative as the sponsor

@jpkrohling jpkrohling added Accepted Component New component has been sponsored and removed Sponsor Needed New component seeking sponsor labels Apr 27, 2022
@eedorenko
Copy link
Contributor Author

@pmm-sumo Thanks a lot!

@tkellogg
Copy link

tkellogg commented Oct 4, 2023

Hi, this issues is the top hit on google for "otel collector to blob storage". Is there documentation somewhere?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment