luigi-extensions

Install

pip install git+git://github.com/zh012/luigi-extensions.git

Modules

• luigi_extensions.s3

  • open the files contained in one manifest as one file

  • s3 workspace

  • auto detect s3 file type (only gz supported by far)

• luigi_extensions.postgres

  • pure sql task

• luigi_extensions.redshift

  • unloade to s3

  • copy from s3

To be continued ...