Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)
-
Updated
Feb 27, 2024 - Python
#
airflow-docker
Here are 107 public repositories matching this topic...
Airflow Pipeline for Machine Learning
nlp data-science machine-learning airflow pipeline docker-compose transformers airflow-docker mlops huggingface zero-shot-classification
-
Updated
May 25, 2023 - Python
🎵 LyricWave – AI Music Composer (Proof of Concept) 🎶 A personal project exploring automatic generation of unique MP4 songs. LyricWave blends lyrics with AI-generated melodies and synthetic vocals to experiment with new forms of musical expression. A creative testbed to push your ideas into sound. 🚀🎧
docker flask airflow mongodb docker-compose pytorch celery music-generation flask-api airflow-docker apache-airflow airflow-dags huggingface airflow-operators huggingface-transformers music-processing stable-diffusion suno-ai musicgen audiocraft
-
Updated
Jun 21, 2025 - Python
An open-source project dedicated to constructing robust data pipelines and scalable software infrastructure. We leverage industry-standard tools favored by developers to enhance efficiency and reliability. Uniquely, these pipelines are field-tested on farms across Sumatra, Indonesia, ensuring real-world applicability and resilience.
portfolio computer-vision django-application software-engineering traefik stem airflow-docker dataengineering django-docker ultralytics
-
Updated
May 27, 2024 - Python
My self-learning about Apache Airflow
-
Updated
Jul 13, 2022 - Python
This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and workflows.
python docker yaml airflow sql superset data-engineering workflows airflow-docker treasuredata apache-superset airflow-dags wsl2 airflow-testing sample-dags airflow-community
-
Updated
Feb 9, 2024 - Python
Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/
docker redis distributed-systems airflow aws-s3 scheduler celery docker-airflow airflow-docker gcp-container-builder work-manager
-
Updated
Jun 2, 2019 - Python
Apache Airflow Guide
python airflow awesome big-data distributed data-engineering business-intelligence awesome-list airflow-plugin airflow-docker awesome-resources business-analytics airflow-dags airflow-operators
-
Updated
May 7, 2024 - Python
An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS application using Apache Airflow as an orchestration tool and various data warehouse technologies and finally using Apache Superset to connect to DWH for generating BI dashboards for weekly reports
airflow pyspark datawarehouse airflow-docker dataengineering amazon-s3 posgresql azure-blob-storage etl-pipeline apache-superset bi-dashboards
-
Updated
Dec 7, 2022 - Python
From data gathering to model deployment. Complete ML pipeline using Docker, Airflow and Python.
python docker machine-learning airflow tutorial sklearn regression tutorials airflow-docker ml-pipeline
-
Updated
Oct 10, 2023 - Python
Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator
docker bigquery airflow etl docker-compose google-cloud-storage data-warehouse airflow-docker etl-pipeline
-
Updated
May 23, 2021 - Python
An airflow deployment configuration with sane defaults
-
Updated
Jun 6, 2019 - Python
In this project, you will be building a Twitter Scheduler using Apache Airflow on Docker.
-
Updated
Aug 29, 2020 - Python
A starting point for a data stack using Python, Apache Airflow and Metabase.
python docker template data-science airflow stack sphinx metabase data-engineering airflow-docker data-stack airflow-dags doccano
-
Updated
Dec 8, 2022 - Python
Run Apache Airflow using Docker containers
-
Updated
Sep 5, 2018 - Python
Tools to streamline Jupyter Notebook Prototypes into robust Data Products
-
Updated
Dec 26, 2022 - Python
Automated Indeed Job Offer Scraper: Airflow Orchestrated and Scheduled, Data Loaded into PostgreSQL Database
-
Updated
Jan 12, 2024 - Python
Shares ETL to scrape historical data of one shares and import in metabase
-
Updated
Oct 18, 2022 - Python
This documentation provides an overview of the tasks completed in this project. The project comprises three key tasks: ETL (Extract, Transform, Load), API development, and Data Orchestration using Airflow. Each task is detailed below along with explanations of design choices and considerations.
-
Updated
Oct 4, 2023 - Python
Airflow docker boiler plate with LocalExecutor, CeleryExecutor. #TODO Kubernetes
-
Updated
Oct 20, 2019 - Python
Improve this page
Add a description, image, and links to the airflow-docker topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the airflow-docker topic, visit your repo's landing page and select "manage topics."