Home

Kiba is a lightweight ETL framework, making it easy to write reliable, concise, well-tested & maintainable data-processing code in Ruby. Read for more info:

Kiba

• How do you define ETL jobs with Kiba?
• Running Kiba jobs from the command line.
• Considerations for running Kiba jobs programmatically (from Sidekiq, Faktory, Rake, ...).
• Implementing ETL sources.
• Implementing ETL transforms.
• How to yield more than one output row per input row in a transform?
• Implementing ETL destinations.
• Implementing pre and post-processors.
• Can Kiba handle multiple sources and destinations?
• Can Kiba handle an "all-or-nothing" ETL operation?
• How to extend the Kiba DSL?

Kiba Common

Kiba Common is an OSS companion gem to Kiba, bringing commonly used features to Kiba:

• Enumerable Source (turn any enumerable into a stream of rows)
• Enumerable Exploder (explodes an enumerable row into a sequence of output rows)
• Source Transform Adapter (dynamical sources using input rows as instantiation parameters)
• CSV Destination
• How to add logging to Kiba?
• How to pretty-color-print rows in Kiba?

Kiba Pro

See Commercial FAQ for license, pricing and how to purchase.

Kiba Pro provides commercially supported extensions to Kiba:

• SQL Source
• SQL Upsert Destination
• SQL Bulk Insert Destination
• SQL Bulk Upsert (soon)
• Generic Paginating HTTP source (soon)
• Parallel Transform (soon)
• Data profiling tools (soon)
• S3 components (soon)
• CPU & memory profiler (soon)
• Sources & destinations for CRM such as BMC Remedy AR System (custom work)

Please see:

• How to install Kiba Pro

See Changelog.

Subscribing to Kiba Pro also helps me developing Kiba and Kiba Common!