Data Cleaning Exercises

Glossary

Schema drift

A source file changing its columns or types between deliveries.

Next month's export adds a column, renames one or turns numbers into text. Check every file against the declared schema, accept declared optional columns, and reject files that miss required ones instead of producing a half-empty table.

Related: Schema, Lineage, Idempotency