mvn compile exec:java \
-Dexec.mainClass=fr.groupbees.application.WorldCupStatsApp \
-Dexec.args=" \
--project=gb-poc-373711 \
--runner=DataflowRunner \
--jobName=world-cup-team-stats-kotlin-midgard-job-$(date +'%Y-%m-%d-%H-%M-%S') \
--dataflowServiceOptions=enable_prime \
--region=europe-west1 \
--zone=europe-west1-d \
--tempLocation=gs://mazlum_dev/dataflow/temp \
--gcpTempLocation=gs://mazlum_dev/dataflow/temp \
--stagingLocation=gs://mazlum_dev/dataflow/staging \
--serviceAccount=sa-dataflow-dev@gb-poc-373711.iam.gserviceaccount.com \
--inputJsonFile=gs://mazlum_dev/world_cup_team_stats/input/world_cup_team_players_stats_raw_ndjson.json \
--inputFileTeamFifaRanking=gs://mazlum_dev/world_cup_team_stats/input/team_fifa_ranking.json \
--worldCupStatsDataset=mazlum_test \
--worldCupTeamPlayerStatsTable=world_cup_team_players_stat_demo \
" \
-Pdataflow-runner
-
Notifications
You must be signed in to change notification settings - Fork 1
This application shows a full Apache Beam pipeline with Kotlin and Midgard library. The use case works on the last Qatar FIFA world cup data and calculate players statistics per team. This application will be presented at Beam Summit 2023 in New York
tosun-si/world-cup-qatar-team-stats-kotlin-midgard
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
This application shows a full Apache Beam pipeline with Kotlin and Midgard library. The use case works on the last Qatar FIFA world cup data and calculate players statistics per team. This application will be presented at Beam Summit 2023 in New York
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published