Designing Idempotent and Reliable Pipelines
Use a business key and source revision to make a destination update safe to replay.
Notes, examples, and design choices for this topic.
Open this topic in the archive · All topics
3 articles · SQL · All levels · Newest · Page 1/1
Use a business key and source revision to make a destination update safe to replay.
Choose a sales fact grain before joining descriptive dimensions and aggregating revenue.
Normalize missing identifiers, choose a deterministic duplicate winner, and reconcile rejected transactions.