You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Problem
I tried using an ingest pipeline to write to a data stream, but the client writing to the pipeline is using the bulk API without create as op_type. This would require a code change to the writing client.
Proposed solution
It would be nice to have roughly the following processor in my ingest pipeline:
org.opensearch.dataprepper.plugins.sink.opensearch.BulkRetryStrategy - operation = Index, status = 400, error = only write ops with an op_type of create are allowed in data streams
Problem
I tried using an ingest pipeline to write to a data stream, but the client writing to the pipeline is using the bulk API without
create
asop_type
. This would require a code change to the writing client.Proposed solution
It would be nice to have roughly the following processor in my ingest pipeline:
Alternative
Alternatively I could not use a data stream or change the client (which I don't want to do in this case)
I hope the case I present is clear. I would love some feedback on this strange case I have.
Thanks in advance!
The text was updated successfully, but these errors were encountered: