public final class ImportDataConfig extends GeneratedMessageV3 implements ImportDataConfigOrBuilder
Describes the location from where we import data into a Dataset, together
with the labels that will be applied to the DataItems and the Annotations.
Protobuf type google.cloud.aiplatform.v1.ImportDataConfig
Fields
public static final int DATA_ITEM_LABELS_FIELD_NUMBER
Field Value
public static final int GCS_SOURCE_FIELD_NUMBER
Field Value
public static final int IMPORT_SCHEMA_URI_FIELD_NUMBER
Field Value
Methods
public boolean containsDataItemLabels(String key)
Labels that will be applied to newly imported DataItems. If an identical
DataItem as one being imported already exists in the Dataset, then these
labels will be appended to these of the already existing one, and if labels
with identical key is imported before, the old label value will be
overwritten. If two DataItems are identical in the same import data
operation, the labels will be combined and if key collision happens in this
case, one of the values will be picked randomly. Two DataItems are
considered identical if their content bytes are identical (e.g. image bytes
or pdf bytes).
These labels will be overridden by Annotation labels specified inside index
file referenced by import_schema_uri, e.g. jsonl file.
map<string, string> data_item_labels = 2;
public boolean equals(Object obj)
Parameter
Returns
Overrides
public Map<String,String> getDataItemLabels()
Returns
public int getDataItemLabelsCount()
Labels that will be applied to newly imported DataItems. If an identical
DataItem as one being imported already exists in the Dataset, then these
labels will be appended to these of the already existing one, and if labels
with identical key is imported before, the old label value will be
overwritten. If two DataItems are identical in the same import data
operation, the labels will be combined and if key collision happens in this
case, one of the values will be picked randomly. Two DataItems are
considered identical if their content bytes are identical (e.g. image bytes
or pdf bytes).
These labels will be overridden by Annotation labels specified inside index
file referenced by import_schema_uri, e.g. jsonl file.
map<string, string> data_item_labels = 2;
public Map<String,String> getDataItemLabelsMap()
Labels that will be applied to newly imported DataItems. If an identical
DataItem as one being imported already exists in the Dataset, then these
labels will be appended to these of the already existing one, and if labels
with identical key is imported before, the old label value will be
overwritten. If two DataItems are identical in the same import data
operation, the labels will be combined and if key collision happens in this
case, one of the values will be picked randomly. Two DataItems are
considered identical if their content bytes are identical (e.g. image bytes
or pdf bytes).
These labels will be overridden by Annotation labels specified inside index
file referenced by import_schema_uri, e.g. jsonl file.
map<string, string> data_item_labels = 2;
public String getDataItemLabelsOrDefault(String key, String defaultValue)
Labels that will be applied to newly imported DataItems. If an identical
DataItem as one being imported already exists in the Dataset, then these
labels will be appended to these of the already existing one, and if labels
with identical key is imported before, the old label value will be
overwritten. If two DataItems are identical in the same import data
operation, the labels will be combined and if key collision happens in this
case, one of the values will be picked randomly. Two DataItems are
considered identical if their content bytes are identical (e.g. image bytes
or pdf bytes).
These labels will be overridden by Annotation labels specified inside index
file referenced by import_schema_uri, e.g. jsonl file.
map<string, string> data_item_labels = 2;
public String getDataItemLabelsOrThrow(String key)
Labels that will be applied to newly imported DataItems. If an identical
DataItem as one being imported already exists in the Dataset, then these
labels will be appended to these of the already existing one, and if labels
with identical key is imported before, the old label value will be
overwritten. If two DataItems are identical in the same import data
operation, the labels will be combined and if key collision happens in this
case, one of the values will be picked randomly. Two DataItems are
considered identical if their content bytes are identical (e.g. image bytes
or pdf bytes).
These labels will be overridden by Annotation labels specified inside index
file referenced by import_schema_uri, e.g. jsonl file.
map<string, string> data_item_labels = 2;
public static ImportDataConfig getDefaultInstance()
Returns
public ImportDataConfig getDefaultInstanceForType()
Returns
public static final Descriptors.Descriptor getDescriptor()
Returns
public GcsSource getGcsSource()
The Google Cloud Storage location for the input content.
.google.cloud.aiplatform.v1.GcsSource gcs_source = 1;
public GcsSourceOrBuilder getGcsSourceOrBuilder()
The Google Cloud Storage location for the input content.
.google.cloud.aiplatform.v1.GcsSource gcs_source = 1;
public String getImportSchemaUri()
Required. Points to a YAML file stored on Google Cloud Storage describing the import
format. Validation will be done against the schema. The schema is defined
as an OpenAPI 3.0.2 Schema
Object.
string import_schema_uri = 4 [(.google.api.field_behavior) = REQUIRED];
| Type | Description |
| String | The importSchemaUri.
|
public ByteString getImportSchemaUriBytes()
Required. Points to a YAML file stored on Google Cloud Storage describing the import
format. Validation will be done against the schema. The schema is defined
as an OpenAPI 3.0.2 Schema
Object.
string import_schema_uri = 4 [(.google.api.field_behavior) = REQUIRED];
| Type | Description |
| ByteString | The bytes for importSchemaUri.
|
public Parser<ImportDataConfig> getParserForType()
Returns
Overrides
public int getSerializedSize()
Returns
Overrides
public ImportDataConfig.SourceCase getSourceCase()
Returns
public final UnknownFieldSet getUnknownFields()
Returns
Overrides
public boolean hasGcsSource()
The Google Cloud Storage location for the input content.
.google.cloud.aiplatform.v1.GcsSource gcs_source = 1;
| Type | Description |
| boolean | Whether the gcsSource field is set.
|
Returns
Overrides
protected GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()
Returns
Overrides
protected MapField internalGetMapField(int number)
Parameter
Returns
Overrides
public final boolean isInitialized()
Returns
Overrides
public static ImportDataConfig.Builder newBuilder()
Returns
public static ImportDataConfig.Builder newBuilder(ImportDataConfig prototype)
Parameter
Returns
public ImportDataConfig.Builder newBuilderForType()
Returns
protected ImportDataConfig.Builder newBuilderForType(GeneratedMessageV3.BuilderParent parent)
Parameter
Returns
Overrides
protected Object newInstance(GeneratedMessageV3.UnusedPrivateParameter unused)
Parameter
Returns
Overrides
public static ImportDataConfig parseDelimitedFrom(InputStream input)
Parameter
Returns
Exceptions
public static ImportDataConfig parseDelimitedFrom(InputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static ImportDataConfig parseFrom(byte[] data)
Parameter
| Name | Description |
| data | byte[]
|
Returns
Exceptions
public static ImportDataConfig parseFrom(byte[] data, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static ImportDataConfig parseFrom(ByteString data)
Parameter
Returns
Exceptions
public static ImportDataConfig parseFrom(ByteString data, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static ImportDataConfig parseFrom(CodedInputStream input)
Parameter
Returns
Exceptions
public static ImportDataConfig parseFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static ImportDataConfig parseFrom(InputStream input)
Parameter
Returns
Exceptions
public static ImportDataConfig parseFrom(InputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static ImportDataConfig parseFrom(ByteBuffer data)
Parameter
Returns
Exceptions
public static ImportDataConfig parseFrom(ByteBuffer data, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static Parser<ImportDataConfig> parser()
Returns
public ImportDataConfig.Builder toBuilder()
Returns
public void writeTo(CodedOutputStream output)
Parameter
Overrides
Exceptions
