Data Cleaning Exercises

Glossary

Idempotency

Running a step twice gives the same result as running it once.

A reproducible pipeline can be rerun after a fix without double-counting. Rebuild outputs from the raw input instead of appending to yesterday's result, and make deduplication deterministic.

Related: Lineage, Schema drift, Survivor rule