-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Teach elasticsearch/slowlog fileset to parse more fields #11939
Teach elasticsearch/slowlog fileset to parse more fields #11939
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
EDIT: I didn't see this was a WIP so I re-requested the review of myself.
@@ -87,6 +87,27 @@ | |||
"ignore_missing": true | |||
} | |||
}, | |||
{ | |||
"rename": { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this going to work if we remove that field in 8? (I have remove that so possibly there this probably will be empty/missing). I forgot about that in my PR, fixing now
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, it should be okay because of the ignore_missing
flag set on this processor (see a couple lines below). In 9 we can completely remove this processor from the pipeline as, by then we won't expect to see any log lines with doc_type
in them.
This PR teaches the
elasticsearch/slowlog
fileset to parse additional fields. These additional fields are introduced in elastic/elasticsearch#41354.