大数据入门指南 ⭐

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Azkaban workflow manager.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

Schedulis is a high performance workflow task scheduling system that supports high availability and multi-tenant financial level features, Linkis computing middleware, and has been integrated into data application development portal DataSphere Studio

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步

Define and schedule workflow, support Flink Jar/SQL, ClickHouse/Hive/Mysql SQL, Shell, etc.

自定义Azkaban插件

监控azkaban project，跑成功失败发送自定义模板邮件

springboot-azkaban job地址https://github.com/poemp/azkaban-data-push-job