- I'm currently working on the data analytics side, but I've been intrigued by Data Engineering lately. I'm always excited to learn cool new stuff, so this is where I keep my personal projects.
-
๐จโโ๏ธ FDA-Adverse-Events-Pipeline ๐
- ๐ฅ Fun project looking at Adverse Events as reported to the FDA, specifically focusing on statin drugs (and potentially associated effects).
- Tech used: dbt, Airflow, Snowflake, AWS S3, Astronomer Cosmos, Python, SQL
- ๐ฅ Fun project looking at Adverse Events as reported to the FDA, specifically focusing on statin drugs (and potentially associated effects).
-
๐ฎ Video-Game-PySpark ๐ฎ
- Project to practice PySpark and Athena skills, specifically looking at video game data using the RAWG API.
- Tech used: PySpark, Amazon Athena, AWS S3, Jupyter Notebooks
- Project to practice PySpark and Athena skills, specifically looking at video game data using the RAWG API.
-
๐ Planning-Center-Data-Pipeline ๐
- This one actually gets used every month to support a data analytics project in my own personal community. This project started with automating some repetitive monthly tasks with Python and quickly evolved into a mini-DE project.
- Tech used: Airflow, Docker, AWS S3, Python, Beautiful Soup (web scraping), and Google Apps API
- This one actually gets used every month to support a data analytics project in my own personal community. This project started with automating some repetitive monthly tasks with Python and quickly evolved into a mini-DE project.
-
๐งโ
โ๏ธ OpenSky-Flight-Data-Pipeline (In Progress...) ๐- Planning a trip to Japan ๐พ, so I wanted to do a near-real time analysis of flights from US <--> Japan using the OpenSky API. I am thinking of experimenting with Kafka / streaming on this one (more to come.)
-
๐ฑ I'm currently learning:
- Exploring Modern Data Tools / Platforms (dbt, Airflow, Databricks, Snowflake)
- Everything Cloud. There's always more to learn when it comes to cloud. AWS is what I know best, but I'm always wanting to explore Azure and GCP more as well
- Evolving Data Architecture best practices
Always looking to connect with folks who enjoy similar stuff - to discuss new opportunities, challenges, or whatever! ๐
Email: jarrod.wadej@gmail.com