humane-pipeline is a tool for managing pipeline of data source to transformations to destination(s). You can use it to read data from various sources, modify and enhance data through various transformations, add additional data through external data mapper, and finally write data to various destinations (one or many). Pipeline can also be forked into branches for multiple type of transformations and destinations.
It is fully free and open source. The license is LGPL 3.0, meaning you are pretty much free to use it in most ways.
It is part of a bigger ecosystem of humane-discovery platform, but is installable, runnable independent of that.
npm install -g humane-pipeline
filedirectory watchfile pattern watchfile tail watchsqlsql incremental watch
filterpickpickByomitomitByreducegroupBykeysvaluesmapextMap
logjsonjsonArraycsvToJson
jsonToCsv
file- text file or json file
All contributions are welcome: ideas, patches, documentation, bug reports, complaints, and even something you drew up on a napkin.