DataQualitySpec

DataQualityScan related setting.

JSON representation
{
  "rules": [
    {
      object (DataQualityRule)
    }
  ],
  "samplingPercent": number,
  "rowFilter": string,
  "postScanActions": {
    object (PostScanActions)
  }
}
Fields
rules[]

object (DataQualityRule)

Required. The list of rules to evaluate against a data source. At least one rule is required.

samplingPercent

number

Optional. The percentage of the records to be selected from the dataset for DataScan.

  • Value can range between 0.0 and 100.0 with up to 3 significant decimal digits.
  • Sampling is not applied if samplingPercent is not specified, 0 or 100.
rowFilter

string

Optional. A filter applied to all rows in a single DataScan job. The filter needs to be a valid SQL expression for a WHERE clause in BigQuery standard SQL syntax. Example: col1 >= 0 AND col2 < 10

postScanActions

object (PostScanActions)

Optional. Actions to take upon job completion.

PostScanActions

The configuration of post scan actions of DataQualityScan.

JSON representation
{
  "bigqueryExport": {
    object (BigQueryExport)
  }
}
Fields
bigqueryExport

object (BigQueryExport)

Optional. If set, results will be exported to the provided BigQuery table.

BigQueryExport

The configuration of BigQuery export post scan action.

JSON representation
{
  "resultsTable": string
}
Fields
resultsTable

string

Optional. The BigQuery table to export DataQualityScan results to. Format: //bigquery.googleapis.com/projects/PROJECT_ID/datasets/DATASET_ID/tables/TABLE_ID