For the Introduction to Big Data Management and Analytics Course, I used software such as Hadoop and Spark to complete 5 different assignments. The topics for these assignments include:
- Map Reduce Programming—Basic & Hands on HDFS setup & Advanced Map Reduce Programming using Hadoop
- Advanced Map Reduce Programming using Spark
- Structured Data Processing using Spark-SQL, Data Frame
- Large Scale Recommendation Using Spark and Mlib
- Large Language Model: BERT for Text Processing