Learning paths

Read in curriculum order. Numbers show sequence; this site does not track learning completion.

Data engineering foundations

Beginner

Follow data from its source through cleaning and ETL to an analytical model.

Prerequisites

Be comfortable reading tables. For the Python exercise, have Python 3 and basic knowledge of functions.

Outcomes

Explain pipeline boundaries, clean transactions, build a small ETL job, and distinguish facts from dimensions.

Reading order

1
Follow sample transactions from their source to a table ready for analysis.
2
Normalize missing identifiers, choose a deterministic duplicate winner, and reconcile rejected transactions.
3
Read a small CSV, reject invalid amounts explicitly, and write a repeatable JSON Lines output.
4
Choose a sales fact grain before joining descriptive dimensions and aggregating revenue.

Reliable pipelines

Practitioner · Intermediate to advanced

Connect scheduling, transformation tests, and safe replay.

Prerequisites

Finish Foundations or be comfortable with SQL, Python functions, ETL, and dimensional models.

Read the Foundations path

Outcomes

Read DAG dependencies, choose model tests, and design idempotent writes for recovery.

Reading order

1
Define task dependencies and bounded retries while keeping batch publication safe to repeat.
2
Connect a model with ref, test its business key, and review incremental correctness separately.
3
Use a business key and source revision to make a destination update safe to replay.

All learning paths · Streaming introduction (standalone reading)