Pre-Requisites :

• python interpreter 3.10+ install poetry for dependencies
• Docker account free single user license | Sign-In to Docker Desktop in running state
• Credentials Vault LastPass

$ make env-up

• lucidchartArchitectural Overview

• GCP

• prefect
  • workspace
  • CLI access
  • ref : instructions | setup manual
• mage.ai host details / reach out for ***.pem file

• BigQuery
• MongoDB
• PostgreSQL

• mode
• preset

• spark
• DuckDB

• dbt-core

• metaplane
• soda
• great-expectations