Data Engineering Zoomcamp

Taking the course

2025 Cohort

• Start: 13 January 2025
• Registration link: https://airtable.com/shr6oVXeQvSI5HuWD
• Cohort folder with homeworks and deadlines

Self-paced mode

All the materials of the course are freely available, so that you can take the course at your own pace

• Follow the suggested syllabus (see below) week by week
• You don't need to fill in the registration form. Just start watching the videos and join Slack
• Check FAQ if you have problems

Syllabus

Module 1: Data ingestion

• Python ingestion with polars and pandas
• Rust data ingestion
• data load tool (dlt)
• Homework

Module 2: Workflow orchestration

• Workflow orchestration with Airflow
• Workflow orchestration with Mage
• Workflow orchestration with Prefect
• Homework

Module 3: Data Warehouse

• BigQuery Data Warehouse
• Lakehouse with Delta Lake
• Homework

Module 4: Analytics engineering

• BigQuery and dbt
• Redshift and dbt
• Databricks and dbt
• ClickHouse and dbt
• PostgreSQL and dbt
• DuckDB and dbt
• Data visualization with Superset/Metabase
• Homework

Module 5: Batch processing

• PySpark
• Spark + Kotlin API
• Spark (Scala)
• Homework

Module 6: Stream processing

• Stream processing with Kafka, ksqlDB and Kotlin
• Kafka Streams with ksqlDB
• RisingWave: Streaming Database
• Homework

Extras

• IaC with Terraform (Google Cloud Platform)
• LakeHouse with Delta, Iceberg, Hive
• Capstone Project