Fraud Blocker Data Cleansing: Validations » Match Data Pro

Data Cleansing: Validations

Validating Your Data

Overview

Validations check whether the values in a column meet a rule, then let you decide what to write for the values that pass and the values that fail. Use them to find bad email addresses, phone numbers with the wrong number of digits, dates outside an expected range, out-of-range numbers, or values that aren’t on an approved list.

A validation never overwrites your original column. It writes its result to a new column placed right next to the one it checked, so the original stays available for comparison. Common patterns are:

  • Keep the value where it passes and blank it where it fails, giving you a clean copy of the column.
  • Write VALID or INVALID flags so you can filter, match, or export on them.
  • Blank the passes and keep only the failures, giving you an exception list to review.

The Validation tab has two sub-tabs: Validations, covered first, and Conversions, which converts weights, lengths, and volumes between units and is covered further down.

Setting Up a Validation Rule

  1. Select Datasource – the data source to check.
  2. Select Columns – the column or columns to validate. You can pick more than one; the same rule is applied to each.
  3. New Column Name – the name of the result column. If you selected several columns, enter one name per column, separated by commas, in the same order. The name must not already exist in the data source.
  4. Choose a Validation Rule and fill in its settings (see below).
  5. Choose the Output for invalid and valid values (see below).
  6. Click Save and Add to Task List. The rule joins the module’s task list and runs with your other cleansing tasks.

Validation Rules Explained

RuleWhat passesSettings
Date RangeValues that are dates and fall between From Date and To Date, inclusive.From Date, To Date. Day First / Month First tells Match Data Pro how to read ambiguous dates such as 03/04/2025.
Is Valid DateValues that can be read as a date, in any common format.Lenient (default) accepts a value as long as a date can be found in it. Strict requires the whole value to be a date with no extra characters.
EmailValues shaped like an email address: something@domain.tld.None.
Phone NumberValues whose digits, after removing spaces, dashes, and punctuation, fall between Minimum Numbers and Maximum Numbers, with a digit count in the same range.Minimum Numbers, Maximum Numbers. For 10-digit US numbers enter 1000000000 and 9999999999.
Exist in ListValues that match an entry in a list you type, one entry per line.Contains, Equals, Begins with, Ends with decide how a value is compared to the list entries. Case Sensitive is off by default, so “Active” and “ACTIVE” both match “active”.
Number value rangeNumeric values between the minimum and maximum, inclusive. Non-numeric values fail.Minimum Numbers, Maximum Numbers.

Output Options

The Output section has two identical sets of choices, one for Invalid Values and one for Valid Values:

  • Delete value – the result cell is left blank.
  • Use Original – the result cell gets the original value unchanged. This is the default for both.
  • Change to Static Value – the result cell gets the text you enter, for example INVALID or OK.

Because the two sets are independent you can build any combination. Set Invalid to Delete value and Valid to Use Original for a cleaned copy. Set Invalid to Change to Static Value: INVALID and Valid to Change to Static Value: VALID for a flag column. Set Valid to Delete value and Invalid to Use Original to isolate the problem values.

Conversions

The Conversions sub-tab converts measurements into a different unit and writes the result to a new column.

  1. Select the data source.
  2. Choose where the numbers are: Value and Unit are in one Column (select that column) or Value and Unit are in Multiple Columns (select two or more columns; each is converted and the results are written together). The selected columns must contain numbers only. A value such as “5 kg” is rejected.
  3. Pick the Target Measurement tab, Weight, Length, or Volume, and the unit to convert to.
  4. Enter the Output Column Name and click Save and Add to Task List.

Conversions do not read a unit from your data. Every value in the column is assumed to be in one fixed unit, which depends on the target you pick:

MeasurementTarget unit you pickYour values must be in
WeightKilogramgrams
WeightGram, Milligram, Pound, Ouncekilograms
LengthKilometermeters
LengthMeter, Millimeter, Mile, Foot, Yardkilometers
VolumeLitremilliliters
VolumeMilliliter, Gallon, Ounce, Cuplitres

If your data is in a different unit, convert it in two steps, or use an Advanced mathematical rule to multiply by the factor you need.

Tips

  • Validate before you match. Running Email and Phone Number validations before Fuzzy Matching keeps junk values from being matched on.
  • Use flags for reporting. Static values such as VALID and INVALID make it easy to count problems in the Data Profiler or remove them with the Filter tab.
  • Exist in List is a quick allow-list. Paste your approved statuses, countries, or product codes one per line and choose Equals to catch anything not on the list.
  • Check the date order. If your dates are written day first, switch Day First on before validating a Date Range, or dates such as 03/04/2025 will be read as March 4.
  • Strict dates for exports. Use Is Valid Date in Strict mode when the column will feed a system that rejects anything but a clean date.

FAQs

No. The result always goes to the new column you name, inserted next to the original.

Yes. Select multiple columns and give one new column name per column, comma-separated, in the same order.

All non-digit characters are removed first, so (302) 450-1978 and 302.450.1978 are both read as 3024501978. The digits must fall within the minimum and maximum you enter and have a digit count within the same range.

Not unless you tick Case Sensitive. By default values and list entries are compared in lower case, with surrounding spaces ignored.

A blank cell fails every rule except Is Valid Date, which treats a blank as valid. Choose the Invalid output to control what is written for it.

To a new column with the name you define. The source column is not changed.

Start Your First Project

To begin, click the New Project button from the dashboard.