-
Notifications
You must be signed in to change notification settings - Fork 4
Future Works
Chia Yong Jian edited this page May 30, 2017
·
5 revisions
The first iteration of this guide reflects the effort and time used in linking the various technologies together, using web tutorials published.
For future iterations, I am looking into the following areas for further exploration:
- Explore more into the capabilities of Apache Spark Streaming, particular in the pyspark Python library
- Build dashboard visualisations from Apache Spark Streaming's processing
- Explore other useful information from Twitter's jsons
- Investigate Apache Spark Streaming capabilities to read from beginning of a Kafka topic - currently it only reads fresh incoming messages
- Explore the use of alternative cloud platforms - e.g. Google Cloud Platform, Microsoft Azure