a lightweight, comprehensive solution for managing delta tables built on polars and deltalake
-
Updated
Jan 1, 2025 - Python
#
delta-tables
Here are 9 public repositories matching this topic...
🍺 A data engineering project showcasing an ELT pipeline using modern technologies such as Delta-rs, and Apache Airflow.
python docker pandas data-engineering data-pipeline apache-airflow delta-lake delta-tables elt-pipeline
-
Updated
Aug 11, 2023 - Python
A comprehensive ETL pipeline and sales analysis project leveraging Microsoft Azure and PySpark, designed to optimize e-commerce sales by providing actionable insights through detailed data analysis.
data-science etl azure pyspark delta parquet spark-sql azure-data-factory sales-analysis business-analytics azure-blob-storage etl-pipeline azure-databricks azure-pipelines etl-automation azure-sql delta-tables azure-data-lake-gen2
-
Updated
Mar 22, 2024 - Jupyter Notebook
An open-source Python library for simplifying local testing of Databricks workflows that use PySpark and Delta tables.
-
Updated
Dec 19, 2024 - Python
Implementing Change Data Capture for Seamless Fintech Data Migration
-
Updated
Sep 21, 2024 - Jupyter Notebook
Databricks & Blueprint Hackathon - using databricks, spark structured streaming, delta, and azure devops to build automated deployment of notebooks and jobs.
-
Updated
Aug 20, 2020 - Python
This project builds a cloud-based pipeline to extract NYC taxi data from an API and store it in Azure Data Lake Storage (ADLS). Databricks and PySpark are used to transform the data through the medallion architecture (Bronze → Silver → Gold). Delta Lake ensures reliable storage, and Power BI provides visual insights for data-driven decision-making.
api sql azure pyspark databricks datalake datafactory dataingestion delta-lake delta-tables adlsgen2 medallion-architecture powerbi-connection
-
Updated
Dec 3, 2024 - Jupyter Notebook
On-premise data lake architecture with Trino, Delta Tables and Hive Metastore
-
Updated
Dec 29, 2024 - Dockerfile
Improve this page
Add a description, image, and links to the delta-tables topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the delta-tables topic, visit your repo's landing page and select "manage topics."