Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[receiver/azureeventhub] Better handling of timestamp parsing #27589

Open
tesharp opened this issue Oct 10, 2023 · 8 comments
Open

[receiver/azureeventhub] Better handling of timestamp parsing #27589

tesharp opened this issue Oct 10, 2023 · 8 comments
Labels

Comments

@tesharp
Copy link

tesharp commented Oct 10, 2023

Component(s)

receiver/azureeventhub

What happened?

Description

Trying to use the azureventhub receiver to read diagnostic logs from Azure but its receiving a lot of timestamp parsing errors. It seems like the diagnostic records in event hub are either missing timestamp or have a different format in some cases. Would be good with some better handling, for instance option to ignore and set current time.

Steps to Reproduce

Set up diagnostic logs and send to event hub

Expected Result

Able to parse all logs

Actual Result

Many many error message with Invalid timestamp

Collector version

v0.85.0

Environment information

Environment

OS: Ubuntu 20.04

OpenTelemetry Collector configuration

receivers:
  azureeventhub:
    connection: $CONNECTION_STRING
    format: "azure"
    storage: file_storage/logs

Log output

azureeventhubreceiver@v0.85.0/azureresourcelogs_unmarshaler.go:106      Invalid Timestamp       {"kind": "receiver", "name": "azureeventhub", "data_type": "logs", "time": ""}
azureeventhubreceiver@v0.85.0/azureresourcelogs_unmarshaler.go:106      Invalid Timestamp       {"kind": "receiver", "name": "azureeventhub", "data_type": "logs", "time": "10/10/2023 13:26:34"}

Additional context

No response

@tesharp tesharp added bug Something isn't working needs triage New item requiring triage labels Oct 10, 2023
@tesharp tesharp changed the title Better handling of timestamp parsing [receiver/azureeventhub] Better handling of timestamp parsing Oct 10, 2023
@github-actions
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@nslaughter
Copy link
Contributor

I just noticed this, because I needed to use this receiver. I will look it up and see if we should copy the parser used in Azure's SDK or import it. Our code currently uses ISO8601, whereas they use RFC3339 and explicitly allow for a further variation with the T or Z.

@github-actions github-actions bot removed the Stale label Feb 14, 2024
Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label Apr 15, 2024
Copy link
Contributor

This issue has been closed as inactive because it has been stale for 120 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jun 14, 2024
@atoulme atoulme reopened this Jun 14, 2024
@atoulme
Copy link
Contributor

atoulme commented Jun 14, 2024

@nslaughter are you interested in fixing this issue?

Copy link
Contributor

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label Aug 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants