Skip to content

Latest commit

 

History

History
 
 

week_1_basics_n_setup

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

Architecture

images/architecture/

Technologies used through this course

  • Google Cloud Platform (GCP): Cloud-based auto-scaling platform by Google
    • Google Cloud Storage (GCS): Data Lake
    • BigQuery: Data Warehouse
  • Terraform: Infrastructure-as-Code (IaC), to create project infra on Google Cloud Platform
  • Docker: Containerized environment for resources such as Postgres
  • SQL: Data Analysis & Exploration
  • Airflow: Pipeline Orchestration tool
  • DBT: Data Transformation tool
  • Spark: Distributed Processing
  • Kafka: Streaming