- Clone This Repo.
- Run
make docker-build
for x86 user, ormake docker-build-arm
for arm chip user.
## docker-build - Build Docker Images (amd64) including its inter-container network.
## docker-build-arm - Build Docker Images (arm64) including its inter-container network.
## postgres - Run a Postgres container
## spark - Run a Spark cluster, rebuild the postgres container, then create the destination tables
## jupyter - Spinup jupyter notebook for testing and validation purposes.
## airflow - Spinup airflow scheduler and webserver.
## kafka - Spinup kafka cluster (Kafka+Zookeeper).
## datahub - Spinup datahub instances.
## metabase - Spinup metabase instance.
## clean - Cleanup all running containers related to the challenge.