-
Notifications
You must be signed in to change notification settings - Fork 24
CSV Processor
Refael Mizrahi edited this page May 16, 2022
·
11 revisions
This processor allows you to extract fields from a string that is in a CSV format. The CSV can have any separator and works only if the columns are in the same order. This processor also allows you to convert the fields after they are extracted to different formats.
- field - required
- targetField (optional)
- separator (optional)
- quoteChar (optional)
- columns [array] (optional) - if you don;t it will show the fields as numbers
- autoGenerateColumnNames [boolean - default = true]
- skipEmptyColumns required [boolean - default = false]
- convert [this is a json object with key:values where the key is the field and the value is the type as specified in the Convert processor] (optional) EG
{
"steps": [{
"csv": {
"config": {
"field": "message",
"separator": "/t",
"columns": [
"Shipment",
"OrderDT",
"PrintDT",
"ShipDT",
"Commitment",
"DelvDate"
],
"skipEmptyColumns": "false",
"autoGenerateColumnNames": "false"
}
}
}]
}
- Home
-
Pipelines
-
Processors
- Add Field Processor
- Add Tag Processor
- AhoCorasick Processor
- Anonymize Processor
- Append List Processor
- Arrays Intersect Processor
- Base64 Decode Processor
- Convert Processor
- CSV Processor
- Date Processor
- Drop Processor
- External Mapping Source Processor
- GeoIP Processor
- Grok Processor
- JSON Processor
- Key Value Processor
- LowerCase Processor
- Math Processor
- Remove Field Processor
- Remove Tag Processor
- Rename Field Processor
- Split Processor
- Strip Processor
- Substitue Processor
- Substring Processor
- Translate Processor
- UpperCase Processor
- User Agent Processor
- URL Decode Processor
- XML Processor
- DeDot Processor
- Doc Size Processor
- If statement
- Additional Commands
-
Processors