A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure Synapse Analytics.

Set of plugins helping to work with imaging data in Airflow.

The project aims to process Formula 1 racing data, create an automated data pipeline, and make the data available for presentation and analysis purposes.

This project contains scripts to extract metadata from DICOM files, NIFTI files and spreadsheets, and import them into a database.

DAGs adapting the MRI preprocessing pipeline to Airflow

Cloud native data pipeline built with Azure and Spark.

Utlised Azure services to orchestrate earthquake daily data pipeline from USGS, consisting of last 7 days of data. Data was transformed and loaded into Azure SQL database and finally Tableau dashboard was made.

This library provides functions to import data into an I2B2 DB schema

Data Engineering Pipeline in Microsoft Azure

An ETL pipeline for an ecommerce website using Azure SQL, Data Factory and Snowflake

Merge individual MIP formatted output from the NMM pipeline into one single CSV file.

Set of plugins helping to work with imaging data in Airflow.

This project contains scripts to extract metadata from DICOM files, NIFTI files and spreadsheets, and import them into a database.

This project aims to predict customer booking behaviors by classifying them into three categories: Booked, Canceled booking, Checked out, and Did not show up.

Migration scripts for the Data Catalog database used to capture provenance information on all files

Reorganize DICOM files following a hierarchy based on meta-data fields

Generate a flat CSV file from an I2B2 data (containing brain features, demographic data, etc).

Generate a flat CSV file from an I2B2 data (containing brain features, demographic data, etc).

ETL process applied on covid-19 dataset of European countries using Azure services such as databricks, keyvault, sql database, data factory etc. Finally power bi dashbaord was also made.