Skip to content

Kafka streaming application to stream bitcoin prices using the Coincap API

Notifications You must be signed in to change notification settings

derak-isaack/Bitcoin-Kafka-Streaming

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Bitcoin kafka

Bitcoin

Project Overview

Stream Real-time prices of bitcoin prices with a higher ranking on a one-minute interval using Apache Kafka.Streaming is enabled by use of the CoinCap API which displays real-time data of bitcoin prices.

Filter and transform the streaming data to only include the top ten ranked Bitcoins and order their prices in descending order.

Producer

The producer uses the CoinCap API to extract bitcoin prices on a one minute interval then later publishes the data to a Kafka topic for subscription by the consumer. The producer can be found here

Before data is ingeted into the kafka-topics, it is essential to change the data types from string to their respective data types for easier process of analysis and filtering of streaming data.

Consumer

The consumer subcribes to the producer topic and can be found here.

Transformer

The transformer filters the streaming data to only include the top ten bitcoin as well as filter the column names to have the neceesary columns for further analysis. It can be found here.

The following snippet shows how data moves downstream. transfomed

About

Kafka streaming application to stream bitcoin prices using the Coincap API

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages