- JSON representation
- DataQualityDimensionResult
- DataQualityDimension
- DataQualityColumnResult
- DataQualityRuleResult
- PostScanActionsResult
- BigQueryExportResult
- State
The output of a DataQualityScan.
JSON representation |
---|
{ "passed": boolean, "dimensions": [ { object ( |
Fields | |
---|---|
passed |
Overall data quality result -- |
dimensions[] |
A list of results at the dimension level. A dimension will have a corresponding |
columns[] |
Output only. A list of results at the column level. A column will have a corresponding |
rules[] |
A list of all the rules in a job, and their results. |
rowCount |
The count of rows processed. |
scannedData |
The data scanned for this result. |
postScanActionsResult |
Output only. The result of post scan actions. |
score |
Output only. The overall data quality score. The score ranges between [0, 100] (up to two decimal points). |
DataQualityDimensionResult
DataQualityDimensionResult provides a more detailed, per-dimension view of the results.
JSON representation |
---|
{
"dimension": {
object ( |
Fields | |
---|---|
dimension |
Output only. The dimension config specified in the DataQualitySpec, as is. |
passed |
Whether the dimension passed or failed. |
score |
Output only. The dimension-level data quality score for this data scan job if and only if the 'dimension' field is set. The score ranges between [0, 100] (up to two decimal points). |
DataQualityDimension
A dimension captures data quality intent about a defined subset of the rules specified.
JSON representation |
---|
{ "name": string } |
Fields | |
---|---|
name |
The dimension name a rule belongs to. Supported dimensions are ["COMPLETENESS", "ACCURACY", "CONSISTENCY", "VALIDITY", "UNIQUENESS", "FRESHNESS", "VOLUME"] |
DataQualityColumnResult
DataQualityColumnResult provides a more detailed, per-column view of the results.
JSON representation |
---|
{ "column": string, "score": number } |
Fields | |
---|---|
column |
Output only. The column specified in the DataQualityRule. |
score |
Output only. The column-level data quality score for this data scan job if and only if the 'column' field is set. The score ranges between between [0, 100] (up to two decimal points). |
DataQualityRuleResult
DataQualityRuleResult provides a more detailed, per-rule view of the results.
JSON representation |
---|
{
"rule": {
object ( |
Fields | |
---|---|
rule |
The rule specified in the DataQualitySpec, as is. |
passed |
Whether the rule passed or failed. |
evaluatedCount |
The number of rows a rule was evaluated against. This field is only valid for row-level type rules. Evaluated count can be configured to either
|
passedCount |
The number of rows which passed a rule evaluation. This field is only valid for row-level type rules. |
nullCount |
The number of rows with null values in the specified column. |
passRatio |
The ratio of passedCount / evaluatedCount. This field is only valid for row-level type rules. |
failingRowsQuery |
The query to find rows that did not pass this rule. This field is only valid for row-level type rules. |
assertionRowCount |
Output only. The number of rows returned by the SQL statement in a SQL assertion rule. This field is only valid for SQL assertion rules. |
PostScanActionsResult
The result of post scan actions of DataQualityScan job.
JSON representation |
---|
{
"bigqueryExportResult": {
object ( |
Fields | |
---|---|
bigqueryExportResult |
Output only. The result of BigQuery export post scan action. |
BigQueryExportResult
The result of BigQuery export post scan action.
JSON representation |
---|
{
"state": enum ( |
Fields | |
---|---|
state |
Output only. Execution state for the BigQuery exporting. |
message |
Output only. Additional information about the BigQuery exporting. |
State
Execution state for the exporting.
Enums | |
---|---|
STATE_UNSPECIFIED |
The exporting state is unspecified. |
SUCCEEDED |
The exporting completed successfully. |
FAILED |
The exporting is no longer running due to an error. |
SKIPPED |
The exporting is skipped due to no valid scan result to export (usually caused by scan failed). |