Airgoodies is a project that contains various APIs to interact with external services inside Apache Airflow using
minimum configuration (see airgoodies.{module}.variables.json
for each module).
Current version matrix:
Airgoodies Version | Apache Airflow Version | Python Version | Project tag |
---|---|---|---|
0.0.4 | 2.7.2 | 3.11 | v0.0.4 |
0.0.3 | 2.7.2 | 3.11 | v0.0.3 |
0.0.2 | 2.7.2 | 3.11 | v0.0.2 |
0.0.1-alpha | 2.7.2 | 3.11 | v0.0.1-alpha |
Provided goodies for version 0.0.4:
Module | Description | Dependency Versions |
---|---|---|
airgoodies.command | API for dynamic task configuration through YAML | pyyaml==6.0.1 |
airgoodies.aws | API for easy interaction with AWS | pandas==2.1.1 apache-airflow-providers-amazon===8.7.1 |
airgoodies.mongo | API for easy interaction with MongoDB | pymongo==4.5.0 |
airgoodies.xcom | API for managing variables through XCom | None |
Add the following requirement in your requirements.txt
# requirements.txt
airgoodies=0.0.4
For the official documentation, see here
For an example of how to use this project, see here
To build the project:
$ python3 setup.py sdist bdist_wheel
This project is available under the MIT License.
Stavros Grigoriou (stav121)