- Resource: Asset
- ResourceSpec
- Type
- AccessMode
- ResourceStatus
- State
- SecurityStatus
- State
- DiscoverySpec
- CsvOptions
- JsonOptions
- DiscoveryStatus
- State
- Stats
- Methods
Resource: Asset
An asset represents a cloud resource that is being managed within a lake as a member of a zone.
JSON representation |
---|
{ "name": string, "displayName": string, "uid": string, "createTime": string, "updateTime": string, "labels": { string: string, ... }, "description": string, "state": enum ( |
Fields | |
---|---|
name |
Output only. The relative resource name of the asset, of the form: |
display |
Optional. User friendly display name. |
uid |
Output only. System generated globally unique ID for the asset. This ID will be different if the asset is deleted and re-created with the same name. |
create |
Output only. The time when the asset was created. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
update |
Output only. The time when the asset was last updated. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
labels |
Optional. User defined labels for the asset. An object containing a list of |
description |
Optional. Description of the asset. |
state |
Output only. Current state of the asset. |
resource |
Required. Specification of the resource that is referenced by this asset. |
resource |
Output only. Status of the resource referenced by this asset. |
security |
Output only. Status of the security policy applied to resource referenced by this asset. |
discovery |
Optional. Specification of the discovery feature applied to data referenced by this asset. When this spec is left unset, the asset will use the spec set on the parent zone. |
discovery |
Output only. Status of the discovery feature applied to data referenced by this asset. |
ResourceSpec
Identifies the cloud resource that is referenced by this asset.
JSON representation |
---|
{ "name": string, "type": enum ( |
Fields | |
---|---|
name |
Immutable. Relative name of the cloud resource that contains the data that is being managed within a lake. For example: |
type |
Required. Immutable. Type of resource. |
read |
Optional. Determines how read permissions are handled for each asset and their associated tables. Only available to storage buckets assets. |
Type
Type of resource.
Enums | |
---|---|
TYPE_UNSPECIFIED |
Type not specified. |
STORAGE_BUCKET |
Cloud Storage bucket. |
BIGQUERY_DATASET |
BigQuery dataset. |
AccessMode
Access Mode determines how data stored within the resource is read. This is only applicable to storage bucket assets.
Enums | |
---|---|
ACCESS_MODE_UNSPECIFIED |
Access mode unspecified. |
DIRECT |
Default. Data is accessed directly using storage APIs. |
MANAGED |
Data is accessed through a managed interface using BigQuery APIs. |
ResourceStatus
Status of the resource referenced by an asset.
JSON representation |
---|
{
"state": enum ( |
Fields | |
---|---|
state |
The current state of the managed resource. |
message |
Additional information about the current state. |
update |
Last update time of the status. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
managed |
Output only. Service account associated with the BigQuery Connection. |
State
The state of a resource.
Enums | |
---|---|
STATE_UNSPECIFIED |
State unspecified. |
READY |
Resource does not have any errors. |
ERROR |
Resource has errors. |
SecurityStatus
Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.
JSON representation |
---|
{
"state": enum ( |
Fields | |
---|---|
state |
The current state of the security policy applied to the attached resource. |
message |
Additional information about the current state. |
update |
Last update time of the status. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
State
The state of the security policy.
Enums | |
---|---|
STATE_UNSPECIFIED |
State unspecified. |
READY |
Security policy has been successfully applied to the attached resource. |
APPLYING |
Security policy is in the process of being applied to the attached resource. |
ERROR |
Security policy could not be applied to the attached resource due to errors. |
DiscoverySpec
Settings to manage the metadata discovery and publishing for an asset.
JSON representation |
---|
{ "enabled": boolean, "includePatterns": [ string ], "excludePatterns": [ string ], "csvOptions": { object ( |
Fields | |
---|---|
enabled |
Optional. Whether discovery is enabled. |
include |
Optional. The list of patterns to apply for selecting data to include during discovery if only a subset of the data should considered. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names. |
exclude |
Optional. The list of patterns to apply for selecting data to exclude during discovery. For Cloud Storage bucket assets, these are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these are interpreted as patterns to match table names. |
csv |
Optional. Configuration for CSV data. |
json |
Optional. Configuration for Json data. |
Union field trigger . Determines when discovery is triggered. trigger can be only one of the following: |
|
schedule |
Optional. Cron schedule (https://en.wikipedia.org/wiki/Cron) for running discovery periodically. Successive discovery runs must be scheduled at least 60 minutes apart. The default value is to run discovery every 60 minutes. To explicitly set a timezone to the cron tab, apply a prefix in the cron tab: "CRON_TZ=${IANA_TIME_ZONE}" or TZ=${IANA_TIME_ZONE}". The ${IANA_TIME_ZONE} may only be a valid string from IANA time zone database. For example, |
CsvOptions
Describe CSV and similar semi-structured data formats.
JSON representation |
---|
{ "headerRows": integer, "delimiter": string, "encoding": string, "disableTypeInference": boolean } |
Fields | |
---|---|
header |
Optional. The number of rows to interpret as header rows that should be skipped when reading data rows. |
delimiter |
Optional. The delimiter being used to separate values. This defaults to ','. |
encoding |
Optional. The character encoding of the data. The default is UTF-8. |
disable |
Optional. Whether to disable the inference of data type for CSV data. If true, all columns will be registered as strings. |
JsonOptions
Describe JSON data format.
JSON representation |
---|
{ "encoding": string, "disableTypeInference": boolean } |
Fields | |
---|---|
encoding |
Optional. The character encoding of the data. The default is UTF-8. |
disable |
Optional. Whether to disable the inference of data type for Json data. If true, all columns will be registered as their primitive types (strings, number or boolean). |
DiscoveryStatus
Status of discovery for an asset.
JSON representation |
---|
{ "state": enum ( |
Fields | |
---|---|
state |
The current status of the discovery feature. |
message |
Additional information about the current state. |
update |
Last update time of the status. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
last |
The start time of the last discovery run. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
stats |
Data Stats of the asset reported by discovery. |
last |
The duration of the last discovery run. A duration in seconds with up to nine fractional digits, ending with ' |
State
Current state of discovery.
Enums | |
---|---|
STATE_UNSPECIFIED |
State is unspecified. |
SCHEDULED |
Discovery for the asset is scheduled. |
IN_PROGRESS |
Discovery for the asset is running. |
PAUSED |
Discovery for the asset is currently paused (e.g. due to a lack of available resources). It will be automatically resumed. |
DISABLED |
Discovery for the asset is disabled. |
Stats
The aggregated data statistics for the asset reported by discovery.
JSON representation |
---|
{ "dataItems": string, "dataSize": string, "tables": string, "filesets": string } |
Fields | |
---|---|
data |
The count of data items within the referenced resource. |
data |
The number of stored data bytes within the referenced resource. |
tables |
The count of table entities within the referenced resource. |
filesets |
The count of fileset entities within the referenced resource. |
Methods |
|
---|---|
|
Creates an asset resource. |
|
Deletes an asset resource. |
|
Retrieves an asset resource. |
|
Gets the access control policy for a resource. |
|
Lists asset resources in a zone. |
|
Updates an asset resource. |
|
Sets the access control policy on the specified resource. |
|
Returns permissions that a caller has on the specified resource. |