Data Cleaning Exercises

Glossary

Deduplication

Keeping one row per key with a deterministic survivor rule, and recording the rest.

The survivor must be chosen by an ordering (latest instant, then priority, then id), never by file order. Removed rows go to exceptions.

Related: Row grain, Survivor rule