Python SQL Parser and Transpiler

Case Santander

🧙 Build, run, and manage data pipelines for integrating and transforming data.

The system will process financial data in the form of real-time streaming data.

Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.

Server for the ListenBrainz project, including the front-end (javascript/react) code that it serves and all of the data processing components that LB uses.

Prometheus-monitoring-exporter

some personal code snippet to learn new programming skill

SageWorks: An easy to use Python API for creating and deploying AWS SageMaker Models

SparkConnect Server plugin and protobuf messages for the Amazon Deequ Data Quality Engine.

Data engineering demo projects

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Case web-server-logs-analytics built using stack MinIO, Iceberg, Nessie, Dremio, Spark Airflow and Python and my library rand-engine as data generator.

Gateway into the John Snow Labs Ecosystem

Example of local pyspark setup including DeltaLake for unit-testing

Apache Paimon Python The Python implementation of Apache Paimon.

One ETL tool to rule them all

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

‘리그 오브 레전드’를 벤치마킹해서 플레이어의 행동 이벤트를 발생하는 API를 통해 실시간으로 데이터가 잘 흐를 수 있도록 데이터 솔루션을 제공합니다.

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends