ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipeline ― Cloud Storage, Dataproc, PySpark, Cloud Spanner and Tableau

Monte Carlo stock simulation using Apache Spark.

Project for Cloud Computing course (A.Y. 2018/2019)

Apache spark sandbox on GCP and Amazon EMR.

Implements a work queue for Dataproc Worflow Template executions

Car Insurance Cold Calls Data Analysis using Apache Hive

Data is fetched from StackExchange, transformed using Pig, queried and stored in Hive. Additionally, the TF-IDF of the top 10 users is calculated using Hive.

Movie Rating Analysis using Apache Spark (pyspark)

Project for Scalable and Cloud Programming Course - 2018/19 UNIBO.

Marketing Campaign Data Analysis Using Apache Spark (PySpark)

First project for Big Data course held at Roma Tre University

Hadoop Google DataProc DIO study

Process large amount of data and implement complex data analyses using Spark. The dataset has been made available by Google. It includes data about a cluster of 12500 machines, and the activity on this cluster during 29 days.