Reliable pipelines

Read in curriculum order. Numbers show sequence; this site does not track learning completion.

Practitioner · Intermediate to advanced

Connect scheduling, transformation tests, and safe replay.

Prerequisites

Finish Foundations or be comfortable with SQL, Python functions, ETL, and dimensional models.

Read DAG dependencies, choose model tests, and design idempotent writes for recovery.

Define task dependencies and bounded retries while keeping batch publication safe to repeat.

Connect a model with ref, test its business key, and review incremental correctness separately.

Use a business key and source revision to make a destination update safe to replay.