Skip to content

Consume Kafka Messages in flink and sink them into ElasticSearch

Notifications You must be signed in to change notification settings

blatoo/flink-streamer

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

flink-streamer

A demo application which receives the real time message from kafka and do some data processing job on them and sink them into ElasticSearch finally.

Why custom sinker?

Flink ElasticSearch Connector supports ElasticSearch only up to version 5.x, but I use 6.2.x. I implemented a custom sinker by using the official ElasticSearch Java API.

Visualization

After/ During the data are written into ElasticSearch, they can be visualized in Kibana in real time. es_bitcoin

About

Consume Kafka Messages in flink and sink them into ElasticSearch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 100.0%