Class DataProfileSpec (2.2.0)

DataProfileSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

DataProfileScan related setting.


Name Description
sampling_percent float
Optional. The percentage of the records to be selected from the dataset for DataScan. - Value can range between 0.0 and 100.0 with up to 3 significant decimal digits. - Sampling is not applied if sampling_percent is not specified, 0 or 100.
row_filter str
Optional. A filter applied to all rows in a single DataScan job. The filter needs to be a valid SQL expression for a WHERE clause in BigQuery standard SQL syntax. Example: col1 >= 0 AND col2 < 10="">
Optional. Actions to take upon job completion..
Optional. The fields to include in data profile. If not specified, all fields at the time of profile scan job execution are included, except for ones listed in exclude_fields.
Optional. The fields to exclude from data profile. If specified, the fields will be excluded from data profile, regardless of include_fields value.



PostScanActions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The configuration of post scan actions of DataProfileScan job.


SelectedFields(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The specification for fields to include or exclude in data profile scan.