Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Dissect processor #6925

Merged
merged 1 commit into from
May 29, 2018
Merged

Commits on May 29, 2018

  1. Feature: Dissect processor

    Implement the Dissect Tokenizer from `logstash-input-dissect`[1]
    
    This tokenizer allows you to define patterns of strings and extract the
    relevant informations. It also permet to do some string manipulations
    when extracting the keys.
    
    Example tokenizer:
    
    ```yaml
    tokenizer: "%{at} - [%{machine}] %{code} - %{message}"
    message: "10/10/2017 - [wopr] 1 - oh fire fire!"
    result:
      at: "10/10/2017"
      machine: "wopr"
      code: "1"
      message: "of fire fire!"
    ```
    
    ```yaml
    tokenizer: "%{?key} %{&key}"
    message: "hello world"
    result:
      hello: "world"
    ```
    
    Example of configuration:
    
    ```yaml
    processors:
     - dissect:
        tokenizer: "%{key1} - %{key2}"
        field: "message"
        target_field: "extracted"
    ```
    
    Dissect support a few more features:
    
    - Indirect field
    - Append
    - skip field
    - Greedy padding for CSV file
    
    [1]: https://github.com/logstash-plugins/logstash-filter-dissect
    ph committed May 29, 2018
    Configuration menu
    Copy the full SHA
    8dedd14 View commit details
    Browse the repository at this point in the history