You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The EVENT mask is intended to be a signal to the logger to mask only Data Prepper Event objects. However, it currently operates like a SENSITIVE marker which should mask all fields (except exceptions see #3375).
Error adding entry to record [******] with key [******], metadataKey [******], value_expression [******] format [******], value [******] java.lang.ClassCastException: null
Also, we should audit our usages of EVENT. For each usage, we should consider 1) Can we keep it as EVENT as is? 2) Do we need to remove some fields to keep as EVENT; or 3) Do we need to make it SENSITIVE?
Tasks
Fix the SensitiveArgumentMaskingConverter
Audit and update usages of the DataPrepperMarkers.EVENT marker
The text was updated successfully, but these errors were encountered:
The
EVENT
mask is intended to be a signal to the logger to mask only Data Prepper Event objects. However, it currently operates like aSENSITIVE
marker which should mask all fields (except exceptions see #3375).For example,
add_entries
has this exception.data-prepper/data-prepper-plugins/mutate-event-processors/src/main/java/org/opensearch/dataprepper/plugins/processor/mutateevent/AddEntryProcessor.java
Lines 95 to 96 in aa1c5c5
It results in logs like the following:
Solution:
Fix the SensitiveArgumentMaskingConverter to only mask
Event
objects when the marker isEVENT
rather thanSENSITIVE
.Also, we should audit our usages of
EVENT
. For each usage, we should consider 1) Can we keep it asEVENT
as is? 2) Do we need to remove some fields to keep asEVENT
; or 3) Do we need to make itSENSITIVE
?Tasks
DataPrepperMarkers.EVENT
markerThe text was updated successfully, but these errors were encountered: