Data Cleaning Exercises

Reference · Visual workspace

Convert a column's type in Visual workspace

Parse text into a typed value (integer, exact decimal, date, timestamp with time zone, boolean) and decide what happens to values that don't parse.

When to use it

Every column that will be compared, summed or sorted as something other than text.

How

Add step → Types → Convert type. Choose the target type and what to do with bad values: quarantine with a reason, make missing, or stop with an error. Missing values can be kept or quarantined.

Convert amount to decimal(12,2) (bad → bad_amount)
  • Decimals with more places than the scale are rejected, never rounded.
  • Timestamps must carry an explicit offset.

Pitfalls

  • Letting a parser guess formats.
  • Silently turning bad values into missing ones.
  • Floating point for money.

Lesson: Exact decimals for money

Practise it: Flag large transactions, keep refunds