[exporter/elasticsearchexporter] Fix bulk indexer to capture indexing errors for collector events metrics #33585
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description:
Return Elasticsearch bulk indexer errors if any so OTEL Collector would count them properly in its internal metrics.
For address this, added error channel in bulk indexer so that it can send error to the channel.
Link to tracking Issue: #32302
Testing:
In Progress
This approach has some issues. When failed events are received
otelcol_exporter_sent_log_records
otelcol_exporter_send_failed_log_records
both are incrementing incorrectly.From debugging, found that documents are periodically flushed for a given flushInterval. Before the flush triggers, if we add some documents they are marked as sucess. Need an alternate approach or suggestions for fixing error metrics
Documentation: No added documentation