Release Notes

This page documents production updates to the Cloud Data Loss Prevention (DLP) API. You can periodically check this page for announcements about new or updated features, bug fixes, known issues, and deprecated functionality.

Current version: v2

Subscribe to the DLP API release notes. Subscribe

October 25, 2018

Added an additional infoType detector:

  • NORWAY_NI_NUMBER

October 2, 2018

Added support to Cloud Storage FileSet for using regular expression filters to specify which files to include or exclude from the scan. This is useful for cases where the set of files to scan cannot be concisely expressed with a path and wildcards, such as:

  • Scan all files, but skip some specific files or folders that you are confident have no sensitive data.
  • Scan only files whose endings are in some known set of file extensions— for example, only .txt, .csv, and .json files.
  • Scan only files whose endings aren't in some known set of extensions— for example, skip .pdf files.

September 19, 2018

Added support for augmenting existing infoType detectors using exclusion rules and hotword rules.

August 24, 2018

Added an additional infoType detector:

  • DENMARK_CPR_NUMBER

August 17, 2018

Added additional infoType detectors:

  • CANADA_DRIVERS_LICENSE_NUMBER
  • DATE
  • DATE_OF_BIRTH
  • FEMALE_NAME
  • FINLAND_NATIONAL_ID_NUMBER
  • GCP_CREDENTIALS
  • GENDER
  • JAPAN_BANK_ACCOUNT
  • JAPAN_DRIVERS_LICENSE_NUMBER
  • MALE_NAME
  • NETHERLANDS_PASSPORT
  • SPAIN_DRIVERS_LICENSE_NUMBER
  • SWEDEN_NATIONAL_ID_NUMBER
  • SWEDEN_PASSPORT
  • TIME
  • US_STATE

August 10, 2018

Added support for large custom dictionaries. The DLP API can now scan for dictionaries containing up to tens of millions of entries.

Added support to CloudStorageOptions for limiting the number of bytes to scan per file by percentage.

Added support to BigQueryOptions for limiting the number of rows to scan per file by percentage.

June 1, 2018

Added support for δ-presence estimation, a risk metric used when membership in the dataset is itself a piece of sensitive information.

May 18, 2018

Added sample_method flag to BigQueryOptions and CloudStorageOptions for limiting scans to a sample of content. This is useful to more efficiently scan large datasets where the intent is to only determine whether sensitive data may be located there and the exhaustive list of findings is not necessary.

April 25, 2018

Added row_limit flag to BigQueryOptions to allow for sampling tables instead of scanning all rows.

Dictionaries can now be loaded from files stored in Cloud Storage that consist of newline-delimited lists of phrases using the cloud_storage_path parameter in CustomInfoType.Dictionary. Useful when sharing dictionaries for custom inspection across multiple requests.

For customers using Cloud Security Command Center, the summary of a DlpJob can be published to Cloud SCC using the new action PublishSummaryToCscc.

March 21, 2018

Cloud Data Loss Prevention (DLP) API General Availability (GA) Release

Launched the new V2 version of the API.

The jobs.create method has been added to replace dataSource.analyze and dataSource.inspect.

The ContentItem object has been simplified with a BytesType enum to specify the type of data to inspect.

The Finding object has been expanded with a new ContentLocation to better report findings from various data types (including images, records, and documents).

InfoTypeStatistics object has been renamed to InfoTypeStats.

The v2beta1 and v2beta2 APIs are now deprecated.

February 16, 2018

Newly added JobTriggers allow for scheduling regular scans of storage. Combined with the new TimespanConfig, scans can be limited to only re-scanning new or modified content in BigQuery and Cloud Storage.

Added support for regular expression-based custom detectors.

Added support for choosing a default likelihood for CustomInfoType detectors and for adjusting likelihood using a new DetectionRule, which looks for related content within the vicinity of a finding.

Job completion notifications for both risk analysis and inspection can now be sent to Cloud Pub/Sub.

December 14, 2017

Launched the new V2Beta2 version of the API, which includes a number of new and improved features, including templates for persisting de-identification and inspect configurations, a simplified job API for inspecting storage and risk analysis, and more.

Tips for migrating:

November 22, 2017

Added a new risk analysis metric, k-map estimation, to dataSource.analyze.

October 20, 2017

Launched support for searching for words or phrases from a custom dictionary provided by the user with the addition of CustomInfoType to InspectConfig. This feature is enabled in content.inspect, content.redact, content.deidentify, and inspect.operations.create.

September 15, 2017

Launched support to de-identify content with the addition of content.deidentify.

Launched support to conduct risk analysis on BigQuery with the addition of dataSource.analyze.

August 17, 2017

Added support to limit the number of findings per InfoType with the addition of InfoTypeLimit in InspectConfig.

Added support to limit the number of findings per file, Cloud Datastore entity, or database row with the addition of OperationConfig to inspect.operations.create.

August 10, 2017

Added support for scanning and redacting structured data in both content.redact and content.inspect by providing a Table in ContentItem.

August 3, 2017

BigQuery can now be scanned using inspect.operations.create.

Results can now be stored to BigQuery when scanning BigQuery, Cloud Datastore, and Cloud Storage using inspect.operations.create.

June 15, 2017

Added support for auto-redacting all text from images. You can now also choose custom colors when using content.redact to fill the bounding boxes during image redaction.

May 11, 2017

Launched support to filter findings by infoType and likelihood when using inspect.results.list.

May 1, 2017

You can now store results from scanning Cloud Datastore or Cloud Storage using inspect.operations.create. Results are stored in Cloud Storage.

March 23, 2017

Added support for auto-redacting findings in images. You can now use content.redact to fill the bounding box of a finding with a solid color.

March 9, 2017

Launch of DLP API to Beta. DLP API enables developers and data owners to better understand and manage sensitive data by providing a fast, scalable classification for sensitive elements. Scan small text streams and images or larger datasets in Cloud Storage and Cloud Datastore. The DLP API is currently available as a REST API.

Was this page helpful? Let us know how we did:

Send feedback about...

Data Loss Prevention API