Supported EDM Data Set Formats

• A header row is supported.
• Enterprise DLP supports data sets in CSV and TSV formats.
  Palo Alto Networks recommends that data sets in CSV format adhere to the RFC-4180 standard.
• Palo Alto Networks recommends Atomic columns to ensure accurate matching of sensitive data.
  Atomic columns are columns containing cells that are expected to contain a discrete or unique Data Type value. For example, in your data set you have the SSN column. One of the cells in this column contains the value "123456789;098765432. In this example, Enterprise DLP inspects for all incidents of 123456789;098765432 as a singular SSN rather than inspecting for 123456789 and 098765432 as unique incidents.
• Enterprise DLP supports up to 50 individual Data Type values in a single cell.
  The Data Types are data values recognized by Enterprise DLP. If a cell has more than 50 Data Type values recognized by Enterprise DLP, Enterprise DLP processes only the first 50 values and ignores the remaining values.
  For example, Today is August 02 2020 contains three data type values; Today and is are Alphabet data types and August 02 2020 is a Date data type.
• Only English (Latin script).
• Enterprise DLP supports the following delimiters to separate values in scanned files:
  • Caret (^)
  • Pipe (|)
  • Semicolon (;)
  • Tab (\t)
  • Tilde (~)
• By default, Enterprise DLP supports a maximum of 30 columns and 130 million rows per EDM data set.
  For example, you have one EDM data set containing 30 columns and 4 million rows and a second EDM data set containing 6 columns and 20 million rows. Both EDM data sets are supported because they each have up to the maximum number of rows and columns supported.
• By default, Enterprise DLP supports up to 120 million cells per data set and up to 500 million cells for a single Enterprise DLP tenant across all EDM data sets uploaded to Enterprise DLP.
  Contact Palo Alto Networks Customer Support to increase the maximum number of cells supported for your Enterprise DLP tenant.

  By request, Enterprise DLP can support up to 1 billion cells per EDM data set and up to 2 billion cells per Enterprise DLP tenant across all EDM data sets uploaded to Enterprise DLP.
• The supported file encoding schemes are UTF-8, UTF-16, ISO-8859-1, and US-ASCII.
• The EDM CLI app removes all punctuation from data contained in the EDM data set.

• Date
  Enterprise DLP supports spaces, dashes (-), slashes (/), periods (.), and any combination of these as separators. Enterprise DLP is able to detect variations of the formats described below.

  Format	Example
  DD-MM-YYYY DD/MM/YYYY DD MM YYYY MM-DD-YYYY MM/DD/YYYY MM.DD.YYYY MM DD YYYY YYYY-MM-DD YYYY/MM/DD YYYY MM DD DD Month YYYY DD-Month-YYYY DD/Month/YYYY DD.Month.YYYY	8-Aug-2020 13-Aug-2020 13/08/2020 13.08.2020 13 Aug 2020 13 August, 2020 08 August 2020 8. August 2020 August 8 2020 Sunday 08 August 2020

  Ambiguous Dates—An ambiguous date is a date value that Enterprise DLP can't explicitly identify or interpret as a discrete and specific date. For ambiguous dates, Enterprise DLP requires an exact match to render a verdict and is unable to detect variations for ambiguous dates.
  Common examples include:
  • Dates where the YYYY component of the date value consists of 2 digits. For example, 23-08-20.
  • Dates where both the DD and MM components of the date value are any digit between 1 and 12. For example, 08-10-2020.
• USA Social Security Number
  Format:
  Enterprise DLP supports spaces, dashes (-), periods (.) as separators.

  Format	Example
  XXX-XX-XXXX XXX XX XXXX XXX.XX.XXXX XXXXXXXXX	123-45-6789 123 45 6789 123.45.6789 123456789

• Country Name

  Format	Example
  Enterprise DLP requires an exact match for country names to render a verdict. Full country name Country name abbreviation	US USA United States United States of America The United States of America

• First, Middle, Last, and Full Name

  Format	Example
  Uppercase letters Lowercase letters	Bill bill Bill’s bill’s Bill Smith bill smith Bill Smith’s bill smith’s

• Medical Record Number

  Format	Example
  Enterprise DLP requires an exact match for Medical Record Numbers to render a verdict.	N/A

• Member ID and Reward ID

  Format	Example
  Enterprise DLP requires an exact match for Member IDs and Reward IDs to render a verdict.	N/A

• Alphabet and Alphanumeric

  Format	Example
  Numbers, uppercase letters, and lowercase letters	ABCDEFG abcdefg AB123CG AB123cdab123cd

• USA Driver License

  Format	Example
  Alphanumeric	E1234567 e1234567

• Email

  Format	Example
  RFC5322—<emailprefix>@<emaildomain>	bill@business.com BILL@BUSINESS.COM BILL@business.com bill@BUSINESS.com

• Bank Routing Number and Bank Account Number

  Format	Example
  Enterprise DLP requires an exact match for a bank routing number and bank account number to render a verdict.	N/A

• IP Address (IPv4 and IPv6)

  Format	Example
  Enterprise DLP requires an exact match for IPv4 and IPv6 IP addresses to render a verdict.	N/A

• Numbers

  Format	Example
  Enterprise DLP requires an exact match for all numbers to render a verdict. Enterprise DLP removes positive signed integers (+) and treats the same as a non-signed integer. Enterprise DLP does not remove negative signed integers (-) to differentiate between positive and negative signed integers.	SI Numbers - 1234, +1234, or -1234 Formatted Numbers—9.00 Indian Number System—12, 34, 567.89

• Phone Number

  Format	Example
  Ten-digit US phone number format only. The EDM CLI app removes the Country code, parentheses (()), dash(-), space, and periods (.).	8001234567 (800)1234567 1.800.123.4567 +1 (800)123-4567 1 800 123 4567 +1 800 123 4567 +1 800 123-4567 1-800-123-4567 1 (800) 123-4567 (800)123-4567 (800) 123 4567 800-123-4567

• UUID

  Format	Example
  RFC4122—32 hexadecimal (base-16) digits. If you’re using hyphens, the total is 36 digits.	123e4567e89b12d3a45642661417400 123e4567-e89b-12d3-a456-42661417400

• Credit Card

  Format	Example
  Between 13 to 23 digits including dashes (-).	4739-5402-9061-0638 4739540290610638