Hands On Materi Apache Airflow in Data Engineer Class - Basic

This repository for course Data Engineer - Basic. In this course use tech stack :

• Data Ingestion & Transformation : Python, SQL and Pandas
• Workflow Orchestration : Apache Airflow
• Data Platform : OLTP(PostgreSQL)

Prerequisite :

• Already Install Docker Desktop for Windows OS or any docker software for Linux/Mac Os
• Already install postgresql in local computer
• Have knowledge Basic Docker & Docker Compose

Step by step to run Apache Airflow with use Docker

1. Download latest docker compose airflow in here
2. Open docker-compose.yaml then add 1 parameter AIRFLOW__CORE__TEST_CONNECTION: 'Enabled' and update parameter AIRFLOW__CORE__LOAD__EXAMPLES become false
3. Run docker compose up -d