Package google.cloud.datalabeling.v1beta1

Index

DataLabelingService

CreateAnnotationSpecSet

rpc CreateAnnotationSpecSet(CreateAnnotationSpecSetRequest) returns (AnnotationSpecSet)

Creates an annotation spec set by providing a set of labels.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

CreateDataset

rpc CreateDataset(CreateDatasetRequest) returns (Dataset)

Creates dataset. If success return a Dataset resource.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

CreateEvaluationJob

rpc CreateEvaluationJob(CreateEvaluationJobRequest) returns (EvaluationJob)

Creates an evaluation job.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

CreateFeedbackMessage

rpc CreateFeedbackMessage(CreateFeedbackMessageRequest) returns (Operation)

Create a FeedbackMessage object.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

CreateInstruction

rpc CreateInstruction(CreateInstructionRequest) returns (Operation)

Creates an instruction for how data should be labeled.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

DeleteAnnotatedDataset

rpc DeleteAnnotatedDataset(DeleteAnnotatedDatasetRequest) returns (Empty)

Deletes an annotated dataset by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

DeleteAnnotationSpecSet

rpc DeleteAnnotationSpecSet(DeleteAnnotationSpecSetRequest) returns (Empty)

Deletes an annotation spec set by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

DeleteDataset

rpc DeleteDataset(DeleteDatasetRequest) returns (Empty)

Deletes a dataset by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

DeleteEvaluationJob

rpc DeleteEvaluationJob(DeleteEvaluationJobRequest) returns (Empty)

Stops and deletes an evaluation job.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

DeleteFeedbackMessage

rpc DeleteFeedbackMessage(DeleteFeedbackMessageRequest) returns (Empty)

Delete a FeedbackMessage.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

DeleteFeedbackThread

rpc DeleteFeedbackThread(DeleteFeedbackThreadRequest) returns (Empty)

Delete a FeedbackThread.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

DeleteInstruction

rpc DeleteInstruction(DeleteInstructionRequest) returns (Empty)

Deletes an instruction object by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ExportData

rpc ExportData(ExportDataRequest) returns (Operation)

Exports data and annotations from dataset.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetAnnotatedDataset

rpc GetAnnotatedDataset(GetAnnotatedDatasetRequest) returns (AnnotatedDataset)

Gets an annotated dataset by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetAnnotationSpecSet

rpc GetAnnotationSpecSet(GetAnnotationSpecSetRequest) returns (AnnotationSpecSet)

Gets an annotation spec set by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetDataItem

rpc GetDataItem(GetDataItemRequest) returns (DataItem)

Gets a data item in a dataset by resource name. This API can be called after data are imported into dataset.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetDataset

rpc GetDataset(GetDatasetRequest) returns (Dataset)

Gets dataset by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetEvaluation

rpc GetEvaluation(GetEvaluationRequest) returns (Evaluation)

Gets an evaluation by resource name (to search, use projects.evaluations.search).

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetEvaluationJob

rpc GetEvaluationJob(GetEvaluationJobRequest) returns (EvaluationJob)

Gets an evaluation job by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetExample

rpc GetExample(GetExampleRequest) returns (Example)

Gets an example by resource name, including both data and annotation.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetFeedbackMessage

rpc GetFeedbackMessage(GetFeedbackMessageRequest) returns (FeedbackMessage)

Get a FeedbackMessage object.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetFeedbackThread

rpc GetFeedbackThread(GetFeedbackThreadRequest) returns (FeedbackThread)

Get a FeedbackThread object.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

GetInstruction

rpc GetInstruction(GetInstructionRequest) returns (Instruction)

Gets an instruction by resource name.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ImportData

rpc ImportData(ImportDataRequest) returns (Operation)

Imports data into dataset based on source locations defined in request. It can be called multiple times for the same dataset. Each dataset can only have one long running operation running on it. For example, no labeling task (also long running operation) can be started while importing is still ongoing. Vice versa.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

LabelImage

rpc LabelImage(LabelImageRequest) returns (Operation)

Starts a labeling task for image. The type of image labeling task is configured by feature in the request.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

LabelText

rpc LabelText(LabelTextRequest) returns (Operation)

Starts a labeling task for text. The type of text labeling task is configured by feature in the request.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

LabelVideo

rpc LabelVideo(LabelVideoRequest) returns (Operation)

Starts a labeling task for video. The type of video labeling task is configured by feature in the request.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListAnnotatedDatasets

rpc ListAnnotatedDatasets(ListAnnotatedDatasetsRequest) returns (ListAnnotatedDatasetsResponse)

Lists annotated datasets for a dataset. Pagination is supported.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListAnnotationSpecSets

rpc ListAnnotationSpecSets(ListAnnotationSpecSetsRequest) returns (ListAnnotationSpecSetsResponse)

Lists annotation spec sets for a project. Pagination is supported.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListDataItems

rpc ListDataItems(ListDataItemsRequest) returns (ListDataItemsResponse)

Lists data items in a dataset. This API can be called after data are imported into dataset. Pagination is supported.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListDatasets

rpc ListDatasets(ListDatasetsRequest) returns (ListDatasetsResponse)

Lists datasets under a project. Pagination is supported.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListEvaluationJobs

rpc ListEvaluationJobs(ListEvaluationJobsRequest) returns (ListEvaluationJobsResponse)

Lists all evaluation jobs within a project with possible filters. Pagination is supported.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListExamples

rpc ListExamples(ListExamplesRequest) returns (ListExamplesResponse)

Lists examples in an annotated dataset. Pagination is supported.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListFeedbackMessages

rpc ListFeedbackMessages(ListFeedbackMessagesRequest) returns (ListFeedbackMessagesResponse)

List FeedbackMessages with pagination.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListFeedbackThreads

rpc ListFeedbackThreads(ListFeedbackThreadsRequest) returns (ListFeedbackThreadsResponse)

List FeedbackThreads with pagination.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ListInstructions

rpc ListInstructions(ListInstructionsRequest) returns (ListInstructionsResponse)

Lists instructions for a project. Pagination is supported.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

PauseEvaluationJob

rpc PauseEvaluationJob(PauseEvaluationJobRequest) returns (Empty)

Pauses an evaluation job. Pausing an evaluation job that is already in a PAUSED state is a no-op.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

ResumeEvaluationJob

rpc ResumeEvaluationJob(ResumeEvaluationJobRequest) returns (Empty)

Resumes a paused evaluation job. A deleted evaluation job can't be resumed. Resuming a running or scheduled evaluation job is a no-op.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

SearchEvaluations

rpc SearchEvaluations(SearchEvaluationsRequest) returns (SearchEvaluationsResponse)

Searches evaluations within a project.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

SearchExampleComparisons

rpc SearchExampleComparisons(SearchExampleComparisonsRequest) returns (SearchExampleComparisonsResponse)

Searches example comparisons from an evaluation. The return format is a list of example comparisons that show ground truth and prediction(s) for a single input. Search by providing an evaluation ID.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

UpdateEvaluationJob

rpc UpdateEvaluationJob(UpdateEvaluationJobRequest) returns (EvaluationJob)

Updates an evaluation job. You can only update certain fields of the job's EvaluationJobConfig: humanAnnotationConfig.instruction, exampleCount, and exampleSamplePercentage.

If you want to change any other aspect of the evaluation job, you must delete the job and create a new one.

Authorization Scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

AnnotatedDataset

AnnotatedDataset is a set holding annotations for data in a Dataset. Each labeling task will generate an AnnotatedDataset under the Dataset that the task is requested for.

Fields
name

string

Output only. AnnotatedDataset resource name in format of: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}

display_name

string

Output only. The display name of the AnnotatedDataset. It is specified in HumanAnnotationConfig when user starts a labeling task. Maximum of 64 characters.

description

string

Output only. The description of the AnnotatedDataset. It is specified in HumanAnnotationConfig when user starts a labeling task. Maximum of 10000 characters.

annotation_source

AnnotationSource

Output only. Source of the annotation.

annotation_type

AnnotationType

Output only. Type of the annotation. It is specified when starting labeling task.

example_count

int64

Output only. Number of examples in the annotated dataset.

completed_example_count

int64

Output only. Number of examples that have annotation in the annotated dataset.

label_stats

LabelStats

Output only. Per label statistics.

create_time

Timestamp

Output only. Time the AnnotatedDataset was created.

metadata

AnnotatedDatasetMetadata

Output only. Additional information about AnnotatedDataset.

blocking_resources[]

string

Output only. The names of any related resources that are blocking changes to the annotated dataset.

AnnotatedDatasetMetadata

Metadata on AnnotatedDataset.

Fields
human_annotation_config

HumanAnnotationConfig

HumanAnnotationConfig used when requesting the human labeling task for this AnnotatedDataset.

Union field annotation_request_config. Specific request configuration used when requesting the labeling task. annotation_request_config can be only one of the following:
image_classification_config

ImageClassificationConfig

Configuration for image classification task.

bounding_poly_config

BoundingPolyConfig

Configuration for image bounding box and bounding poly task.

polyline_config

PolylineConfig

Configuration for image polyline task.

segmentation_config

SegmentationConfig

Configuration for image segmentation task.

video_classification_config

VideoClassificationConfig

Configuration for video classification task.

object_detection_config

ObjectDetectionConfig

Configuration for video object detection task.

object_tracking_config

ObjectTrackingConfig

Configuration for video object tracking task.

event_config

EventConfig

Configuration for video event labeling task.

text_classification_config

TextClassificationConfig

Configuration for text classification task.

text_entity_extraction_config

TextEntityExtractionConfig

Configuration for text entity extraction task.

Annotation

Annotation for Example. Each example may have one or more annotations. For example in image classification problem, each image might have one or more labels. We call labels binded with this image an Annotation.

Fields
name

string

Output only. Unique name of this annotation, format is:

projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset}/examples/{example_id}/annotations/{annotation_id}

annotation_source

AnnotationSource

Output only. The source of the annotation.

annotation_value

AnnotationValue

Output only. This is the actual annotation value, e.g classification, bounding box values are stored here.

annotation_metadata

AnnotationMetadata

Output only. Annotation metadata, including information like votes for labels.

annotation_sentiment

AnnotationSentiment

Output only. Sentiment for this annotation.

AnnotationMetadata

Additional information associated with the annotation.

Fields
operator_metadata

OperatorMetadata

Metadata related to human labeling.

AnnotationSentiment

Enums
ANNOTATION_SENTIMENT_UNSPECIFIED
NEGATIVE This annotation describes negatively about the data.
POSITIVE This label describes positively about the data.

AnnotationSource

Specifies where the annotation comes from (whether it was provided by a human labeler or a different source).

Enums
ANNOTATION_SOURCE_UNSPECIFIED
OPERATOR Answer is provided by a human contributor.

AnnotationSpec

Container of information related to one possible annotation that can be used in a labeling task. For example, an image classification task where images are labeled as dog or cat must reference an AnnotationSpec for dog and an AnnotationSpec for cat.

Fields
display_name

string

Required. The display name of the AnnotationSpec. Maximum of 64 characters.

description

string

Optional. User-provided description of the annotation specification. The description can be up to 10,000 characters long.

index

int32

Output only. This is the integer index of the AnnotationSpec. The index for the whole AnnotationSpecSet is sequential starting from 0.

For example, an AnnotationSpecSet with classes dog and cat, might contain one AnnotationSpec with { display_name: "dog", index: 0 } and one AnnotationSpec with { display_name: "cat", index: 1 }.

This is especially useful for model training as it encodes the string labels into numeric values.

AnnotationSpecSet

An AnnotationSpecSet is a collection of label definitions. For example, in image classification tasks, you define a set of possible labels for images as an AnnotationSpecSet. An AnnotationSpecSet is immutable upon creation.

Fields
name

string

Output only. The AnnotationSpecSet resource name in the following format:

"projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}"

display_name

string

Required. The display name for AnnotationSpecSet that you define when you create it. Maximum of 64 characters.

description

string

Optional. User-provided description of the annotation specification set. The description can be up to 10,000 characters long.

annotation_specs[]

AnnotationSpec

Required. The array of AnnotationSpecs that you define when you create the AnnotationSpecSet. These are the possible labels for the labeling task.

blocking_resources[]

string

Output only. The names of any related resources that are blocking changes to the annotation spec set.

AnnotationType

Enums
ANNOTATION_TYPE_UNSPECIFIED
IMAGE_CLASSIFICATION_ANNOTATION Classification annotations in an image. Allowed for continuous evaluation.
IMAGE_BOUNDING_BOX_ANNOTATION Bounding box annotations in an image. A form of image object detection. Allowed for continuous evaluation.
IMAGE_ORIENTED_BOUNDING_BOX_ANNOTATION Oriented bounding box. The box does not have to be parallel to horizontal line.
IMAGE_BOUNDING_POLY_ANNOTATION Bounding poly annotations in an image.
IMAGE_POLYLINE_ANNOTATION Polyline annotations in an image.
IMAGE_SEGMENTATION_ANNOTATION Segmentation annotations in an image.
VIDEO_SHOTS_CLASSIFICATION_ANNOTATION Classification annotations in video shots.
VIDEO_OBJECT_TRACKING_ANNOTATION Video object tracking annotation.
VIDEO_OBJECT_DETECTION_ANNOTATION Video object detection annotation.
VIDEO_EVENT_ANNOTATION Video event annotation.
TEXT_CLASSIFICATION_ANNOTATION Classification for text. Allowed for continuous evaluation.
TEXT_ENTITY_EXTRACTION_ANNOTATION Entity extraction for text.
GENERAL_CLASSIFICATION_ANNOTATION General classification. Allowed for continuous evaluation.

AnnotationValue

Annotation value for an example.

Fields

Union field value_type.

value_type can be only one of the following:

image_classification_annotation

ImageClassificationAnnotation

Annotation value for image classification case.

image_bounding_poly_annotation

ImageBoundingPolyAnnotation

Annotation value for image bounding box, oriented bounding box and polygon cases.

image_polyline_annotation

ImagePolylineAnnotation

Annotation value for image polyline cases. Polyline here is different from BoundingPoly. It is formed by line segments connected to each other but not closed form(Bounding Poly). The line segments can cross each other.

image_segmentation_annotation

ImageSegmentationAnnotation

Annotation value for image segmentation.

text_classification_annotation

TextClassificationAnnotation

Annotation value for text classification case.

text_entity_extraction_annotation

TextEntityExtractionAnnotation

Annotation value for text entity extraction case.

video_classification_annotation

VideoClassificationAnnotation

Annotation value for video classification case.

video_object_tracking_annotation

VideoObjectTrackingAnnotation

Annotation value for video object detection and tracking case.

video_event_annotation

VideoEventAnnotation

Annotation value for video event case.

Attempt

Records a failed evaluation job run.

Fields
attempt_time

Timestamp

partial_failures[]

Status

Details of errors that occurred.

BigQuerySource

The BigQuery location for input data. If used in an EvaluationJob, this is where the service saves the prediction input and output sampled from the model version.

Fields
input_uri

string

Required. BigQuery URI to a table, up to 2,000 characters long. If you specify the URI of a table that does not exist, Data Labeling Service creates a table at the URI with the correct schema when you create your EvaluationJob. If you specify the URI of a table that already exists, it must have the correct schema.

Provide the table URI in the following format:

"bq://{your_project_id}/{your_dataset_name}/{your_table_name}"

Learn more.

BoundingBoxEvaluationOptions

Options regarding evaluation between bounding boxes.

Fields
iou_threshold

float

Minimum [intersection-over-union

(IOU)](/vision/automl/object-detection/docs/evaluate#intersection-over-union) required for 2 bounding boxes to be considered a match. This must be a number between 0 and 1.

BoundingPoly

A bounding polygon in the image.

Fields
vertices[]

Vertex

The bounding polygon vertices.

BoundingPolyConfig

Config for image bounding poly (and bounding box) human labeling task.

Fields
annotation_spec_set

string

Required. Annotation spec set resource name.

instruction_message

string

Optional. Instruction message showed on contributors UI.

ClassificationMetadata

Metadata for classification annotations.

Fields
is_multi_label

bool

Whether the classification task is multi-label or not.

ClassificationMetrics

Metrics calculated for a classification model.

Fields
pr_curve

PrCurve

Precision-recall curve based on ground truth labels, predicted labels, and scores for the predicted labels.

confusion_matrix

ConfusionMatrix

Confusion matrix of predicted labels vs. ground truth labels.

ConfusionMatrix

Confusion matrix of the model running the classification. Only applicable when the metrics entry aggregates multiple labels. Not applicable when the entry is for a single label.

Fields
row[]

Row

ConfusionMatrixEntry

Fields
annotation_spec

AnnotationSpec

The annotation spec of a predicted label.

item_count

int32

Number of items predicted to have this label. (The ground truth label for these items is the Row.annotationSpec of this entry's parent.)

Row

A row in the confusion matrix. Each entry in this row has the same ground truth label.

Fields
annotation_spec

AnnotationSpec

The annotation spec of the ground truth label for this row.

entries[]

ConfusionMatrixEntry

A list of the confusion matrix entries. One entry for each possible predicted label.

CreateAnnotationSpecSetRequest

Request message for CreateAnnotationSpecSet.

Fields
parent

string

Required. AnnotationSpecSet resource parent, format: projects/{project_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.annotationspecsets.create

annotation_spec_set

AnnotationSpecSet

Required. Annotation spec set to create. Annotation specs must be included. Only one annotation spec will be accepted for annotation specs with same display_name.

CreateDatasetRequest

Request message for CreateDataset.

Fields
parent

string

Required. Dataset resource parent, format: projects/{project_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.datasets.create

dataset

Dataset

Required. The dataset to be created.

CreateEvaluationJobRequest

Request message for CreateEvaluationJob.

Fields
parent

string

Required. Evaluation job resource parent. Format: "projects/{project_id}"

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.evaluationjobs.create

job

EvaluationJob

Required. The evaluation job to create.

CreateFeedbackMessageRequest

Request message for CreateFeedbackMessage.

Fields
parent

string

Required. FeedbackMessage resource parent, format:

projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}.

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.feedbackMessages.create

feedback_message

FeedbackMessage

Required. The feedback message to create.

CreateInstructionMetadata

Metadata of a CreateInstruction operation.

Fields
instruction

string

The name of the created Instruction. projects/{project_id}/instructions/{instruction_id}

partial_failures[]

Status

Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.

create_time

Timestamp

Timestamp when create instruction request was created.

CreateInstructionRequest

Request message for CreateInstruction.

Fields
parent

string

Required. Instruction resource parent, format: projects/{project_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.instructions.create

instruction

Instruction

Required. Instruction of how to perform the labeling task.

CsvInstruction

Deprecated: this instruction format is not supported any more. Instruction from a CSV file.

Fields
gcs_file_uri

string

CSV file for the instruction. Only gcs path is allowed.

DataItem

DataItem is a piece of data, without annotation. For example, an image.

Fields
name

string

Output only. Name of the data item, in format of: projects/{project_id}/datasets/{dataset_id}/dataItems/{data_item_id}

Union field payload. Output only. payload can be only one of the following:
image_payload

ImagePayload

The image payload, a container of the image bytes/uri.

text_payload

TextPayload

The text payload, a container of text content.

video_payload

VideoPayload

The video payload, a container of the video uri.

DataType

Enums
DATA_TYPE_UNSPECIFIED
IMAGE Allowed for continuous evaluation.
VIDEO
TEXT Allowed for continuous evaluation.
GENERAL_DATA Allowed for continuous evaluation.

Dataset

Dataset is the resource to hold your data. You can request multiple labeling tasks for a dataset while each one will generate an AnnotatedDataset.

Fields
name

string

Output only. Dataset resource name, format is: projects/{project_id}/datasets/{dataset_id}

display_name

string

Required. The display name of the dataset. Maximum of 64 characters.

description

string

Optional. User-provided description of the annotation specification set. The description can be up to 10000 characters long.

create_time

Timestamp

Output only. Time the dataset is created.

input_configs[]

InputConfig

Output only. This is populated with the original input configs where ImportData is called. It is available only after the clients import data to this dataset.

blocking_resources[]

string

Output only. The names of any related resources that are blocking changes to the dataset.

data_item_count

int64

Output only. The number of data items in the dataset.

DeleteAnnotatedDatasetRequest

Request message for DeleteAnnotatedDataset.

Fields
name

string

Required. Name of the annotated dataset to delete, format: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.annotateddatasets.delete

DeleteAnnotationSpecSetRequest

Request message for DeleteAnnotationSpecSet.

Fields
name

string

Required. AnnotationSpec resource name, format: projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}.

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.annotationspecsets.delete

DeleteDatasetRequest

Request message for DeleteDataset.

Fields
name

string

Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.datasets.delete

DeleteEvaluationJobRequest

Request message DeleteEvaluationJob.

Fields
name

string

Required. Name of the evaluation job that is going to be deleted. Format:

"projects/{project_id}/evaluationJobs/{evaluation_job_id}"

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.evaluationjobs.delete

DeleteFeedbackMessageRequest

Request message DeleteFeedbackMessage.

Fields
name

string

Required. Name of the FeedbackMessage that is going to be deleted. Format:

'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}/feedbackMessages/{feedback_message_id}'.

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.feedbackMessages.delete

DeleteFeedbackThreadRequest

Request message DeleteFeedbackThread.

Fields
name

string

Required. Name of the FeedbackThread that is going to be deleted. Format:

'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}'.

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.feedbackThreads.delete

DeleteInstructionRequest

Request message for DeleteInstruction.

Fields
name

string

Required. Instruction resource name, format: projects/{project_id}/instructions/{instruction_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.instructions.delete

Evaluation

Describes an evaluation between a machine learning model's predictions and ground truth labels. Created when an EvaluationJob runs successfully.

Fields
name

string

Output only. Resource name of an evaluation. The name has the following format:

"projects/{project_id}/datasets/{dataset_id}/evaluations/{evaluation_id}'

config

EvaluationConfig

Output only. Options used in the evaluation job that created this evaluation.

evaluation_job_run_time

Timestamp

Output only. Timestamp for when the evaluation job that created this evaluation ran.

create_time

Timestamp

Output only. Timestamp for when this evaluation was created.

evaluation_metrics

EvaluationMetrics

Output only. Metrics comparing predictions to ground truth labels.

annotation_type

AnnotationType

Output only. Type of task that the model version being evaluated performs, as defined in the

evaluationJobConfig.inputConfig.annotationType field of the evaluation job that created this evaluation.

evaluated_item_count

int64

Output only. The number of items in the ground truth dataset that were used for this evaluation. Only populated when the evaulation is for certain AnnotationTypes.

EvaluationConfig

Configuration details used for calculating evaluation metrics and creating an Evaluation.

Fields
bounding_box_evaluation_options

BoundingBoxEvaluationOptions

Only specify this field if the related model performs image object detection (IMAGE_BOUNDING_BOX_ANNOTATION). Describes how to evaluate bounding boxes.

EvaluationJob

Defines an evaluation job that runs periodically to generate Evaluations. Creating an evaluation job is the starting point for using continuous evaluation.

Fields
name

string

Output only. After you create a job, Data Labeling Service assigns a name to the job with the following format:

"projects/{project_id}/evaluationJobs/{evaluation_job_id}"

description

string

Required. Description of the job. The description can be up to 25,000 characters long.

state

State

Output only. Describes the current state of the job.

schedule

string

Required. Describes the interval at which the job runs. This interval must be at least 1 day, and it is rounded to the nearest day. For example, if you specify a 50-hour interval, the job runs every 2 days.

You can provide the schedule in crontab format or in an English-like format.

Regardless of what you specify, the job will run at 10:00 AM UTC. Only the interval from this schedule is used, not the specific time of day.

model_version

string

Required. The AI Platform Prediction model version to be evaluated. Prediction input and output is sampled from this model version. When creating an evaluation job, specify the model version in the following format:

"projects/{project_id}/models/{model_name}/versions/{version_name}"

There can only be one evaluation job per model version.

evaluation_job_config

EvaluationJobConfig

Required. Configuration details for the evaluation job.

annotation_spec_set

string

Required. Name of the AnnotationSpecSet describing all the labels that your machine learning model outputs. You must create this resource before you create an evaluation job and provide its name in the following format:

"projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}"

label_missing_ground_truth

bool

Required. Whether you want Data Labeling Service to provide ground truth labels for prediction input. If you want the service to assign human labelers to annotate your data, set this to true. If you want to provide your own ground truth labels in the evaluation job's BigQuery table, set this to false.

attempts[]

Attempt

Output only. Every time the evaluation job runs and an error occurs, the failed attempt is appended to this array.

create_time

Timestamp

Output only. Timestamp of when this evaluation job was created.

State

State of the job.

Enums
STATE_UNSPECIFIED
SCHEDULED

The job is scheduled to run at the configured interval. You can pause or delete the job.

When the job is in this state, it samples prediction input and output from your model version into your BigQuery table as predictions occur.

RUNNING

The job is currently running. When the job runs, Data Labeling Service does several things:

  1. If you have configured your job to use Data Labeling Service for ground truth labeling, the service creates a Dataset and a labeling task for all data sampled since the last time the job ran. Human labelers provide ground truth labels for your data. Human labeling may take hours, or even days, depending on how much data has been sampled. The job remains in the RUNNING state during this time, and it can even be running multiple times in parallel if it gets triggered again (for example 24 hours later) before the earlier run has completed. When human labelers have finished labeling the data, the next step occurs.

    If you have configured your job to provide your own ground truth labels, Data Labeling Service still creates a Dataset for newly sampled data, but it expects that you have already added ground truth labels to the BigQuery table by this time. The next step occurs immediately.

  2. Data Labeling Service creates an Evaluation by comparing your model version's predictions with the ground truth labels.

If the job remains in this state for a long time, it continues to sample prediction data into your BigQuery table and will run again at the next interval, even if it causes the job to run multiple times in parallel.

PAUSED The job is not sampling prediction input and output into your BigQuery table and it will not run according to its schedule. You can resume the job.
STOPPED The job has this state right before it is deleted.

EvaluationJobAlertConfig

Provides details for how an evaluation job sends email alerts based on the results of a run.

Fields
email

string

Required. An email address to send alerts to.

min_acceptable_mean_average_precision

double

Required. A number between 0 and 1 that describes a minimum mean average precision threshold. When the evaluation job runs, if it calculates that your model version's predictions from the recent interval have meanAveragePrecision below this threshold, then it sends an alert to your specified email.

EvaluationJobConfig

Configures specific details of how a continuous evaluation job works. Provide this configuration when you create an EvaluationJob.

Fields
input_config

InputConfig

Rquired. Details for the sampled prediction input. Within this configuration, there are requirements for several fields:

  • dataType must be one of IMAGE, TEXT, or GENERAL_DATA.
  • annotationType must be one of IMAGE_CLASSIFICATION_ANNOTATION, TEXT_CLASSIFICATION_ANNOTATION, GENERAL_CLASSIFICATION_ANNOTATION, or IMAGE_BOUNDING_BOX_ANNOTATION (image object detection).
  • If your machine learning model performs classification, you must specify classificationMetadata.isMultiLabel.
  • You must specify bigquerySource (not gcsSource).

evaluation_config

EvaluationConfig

Required. Details for calculating evaluation metrics and creating Evaulations. If your model version performs image object detection, you must specify the boundingBoxEvaluationOptions field within this configuration. Otherwise, provide an empty object for this configuration.

human_annotation_config

HumanAnnotationConfig

Optional. Details for human annotation of your data. If you set labelMissingGroundTruth to true for this evaluation job, then you must specify this field. If you plan to provide your own ground truth labels, then omit this field.

Note that you must create an Instruction resource before you can specify this field. Provide the name of the instruction resource in the instruction field within this configuration.

bigquery_import_keys

map<string, string>

Required. Prediction keys that tell Data Labeling Service where to find the data for evaluation in your BigQuery table. When the service samples prediction input and output from your model version and saves it to BigQuery, the data gets stored as JSON strings in the BigQuery table. These keys tell Data Labeling Service how to parse the JSON.

You can provide the following entries in this field:

  • data_json_key: the data key for prediction input. You must provide either this key or reference_json_key.
  • reference_json_key: the data reference key for prediction input. You must provide either this key or data_json_key.
  • label_json_key: the label key for prediction output. Required.
  • label_score_json_key: the score key for prediction output. Required.
  • bounding_box_json_key: the bounding box key for prediction output. Required if your model version perform image object detection.

Learn how to configure prediction keys.

example_count

int32

Required. The maximum number of predictions to sample and save to BigQuery during each evaluation interval. This limit overrides example_sample_percentage: even if the service has not sampled enough predictions to fulfill example_sample_perecentage during an interval, it stops sampling predictions when it meets this limit.

example_sample_percentage

double

Required. Fraction of predictions to sample and save to BigQuery during each evaluation interval. For example, 0.1 means 10% of predictions served by your model version get saved to BigQuery.

evaluation_job_alert_config

EvaluationJobAlertConfig

Optional. Configuration details for evaluation job alerts. Specify this field if you want to receive email alerts if the evaluation job finds that your predictions have low mean average precision during a run.

Union field human_annotation_request_config. Required. Details for how you want human reviewers to provide ground truth labels. human_annotation_request_config can be only one of the following:
image_classification_config

ImageClassificationConfig

Specify this field if your model version performs image classification or general classification.

annotationSpecSet in this configuration must match EvaluationJob.annotationSpecSet. allowMultiLabel in this configuration must match classificationMetadata.isMultiLabel in input_config.

bounding_poly_config

BoundingPolyConfig

Specify this field if your model version performs image object detection (bounding box detection).

annotationSpecSet in this configuration must match EvaluationJob.annotationSpecSet.

text_classification_config

TextClassificationConfig

Specify this field if your model version performs text classification.

annotationSpecSet in this configuration must match EvaluationJob.annotationSpecSet. allowMultiLabel in this configuration must match classificationMetadata.isMultiLabel in input_config.

EvaluationMetrics

Fields
Union field metrics. Common metrics covering most general cases. metrics can be only one of the following:
classification_metrics

ClassificationMetrics

object_detection_metrics

ObjectDetectionMetrics

EventConfig

Config for video event human labeling task.

Fields
annotation_spec_sets[]

string

Required. The list of annotation spec set resource name. Similar to video classification, we support selecting event from multiple AnnotationSpecSet at the same time.

Example

An Example is a piece of data and its annotation. For example, an image with label "house".

Fields
name

string

Output only. Name of the example, in format of: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}/examples/{example_id}

annotations[]

Annotation

Output only. Annotations for the piece of data in Example. One piece of data can have multiple annotations.

Union field payload. Output only. The data part of Example. payload can be only one of the following:
image_payload

ImagePayload

The image payload, a container of the image bytes/uri.

text_payload

TextPayload

The text payload, a container of the text content.

video_payload

VideoPayload

The video payload, a container of the video uri.

ExportDataOperationMetadata

Metadata of an ExportData operation.

Fields
dataset

string

Output only. The name of dataset to be exported. "projects/*/datasets/*"

annotated_dataset

string

Output only. The name of annotated dataset in format "projects/*/datasets/*/annotatedDatasets/*".

partial_failures[]

Status

Output only. Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.

create_time

Timestamp

Output only. Timestamp when export dataset request was created.

ExportDataOperationResponse

Response used for ExportDataset longrunning operation.

Fields
dataset

string

Ouptut only. The name of dataset. "projects/*/datasets/*"

annotated_dataset

string

Output only. The name of annotated dataset in format "projects/*/datasets/*/annotatedDatasets/*".

total_count

int32

Output only. Total number of examples requested to export

export_count

int32

Output only. Number of examples exported successfully.

label_stats

LabelStats

Output only. Statistic infos of labels in the exported dataset.

output_config

OutputConfig

Output only. output_config in the ExportData request.

ExportDataRequest

Request message for ExportData API.

Fields
name

string

Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.datasets.export

annotated_dataset

string

Required. Annotated dataset resource name. DataItem in Dataset and their annotations in specified annotated dataset will be exported. It's in format of projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}

filter

string

Optional. Filter is not supported at this moment.

output_config

OutputConfig

Required. Specify the output destination.

user_email_address

string

Email of the user who started the export task and should be notified by email. If empty no notification will be sent.

FeedbackMessage

A feedback message inside a feedback thread.

Fields
name

string

Name of the feedback message in a feedback thread. Format:

'project/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}/feedbackMessage/{feedback_message_id}'

body

string

String content of the feedback. Maximum of 10000 characters.

image

bytes

The image storing this feedback if the feedback is an image representing operator's comments.

create_time

Timestamp

Create time.

Union field metadata. Metadata marking the source and additional information of this feedback. metadata can be only one of the following:
requester_feedback_metadata

RequesterFeedbackMetadata

operator_feedback_metadata

OperatorFeedbackMetadata

FeedbackThread

A feedback thread of a certain labeling task on a certain annotated dataset.

Fields
name

string

Name of the feedback thread. Format:

'project/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}'

feedback_thread_metadata

FeedbackThreadMetadata

Metadata regarding the feedback thread.

FeedbackThreadMetadata

Fields
thumbnail

bytes

An image thumbnail of this thread.

status

FeedbackThreadStatus

create_time

Timestamp

When the thread is created

last_update_time

Timestamp

When the thread is last updated.

FeedbackThreadStatus

Enums
FEEDBACK_THREAD_STATUS_UNSPECIFIED
NEW Feedback thread is created with no reply;
REPLIED Feedback thread is replied at least once;

GcsDestination

Export destination of the data.Only gcs path is allowed in output_uri.

Fields
output_uri

string

Required. The output uri of destination file.

mime_type

string

Required. The format of the gcs destination. Only "text/csv" and "application/json" are supported.

GcsFolderDestination

Export folder destination of the data.

Fields
output_folder_uri

string

Required. Cloud Storage directory to export data to.

GcsSource

Source of the Cloud Storage file to be imported.

Fields
input_uri

string

Required. The input URI of source file. This must be a Cloud Storage path (gs://...).

mime_type

string

Required. The format of the source file. Only "text/csv" is supported.

GetAnnotatedDatasetRequest

Request message for GetAnnotatedDataset.

Fields
name

string

Required. Name of the annotated dataset to get, format: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.annotateddatasets.get

GetAnnotationSpecSetRequest

Request message for GetAnnotationSpecSet.

Fields
name

string

Required. AnnotationSpecSet resource name, format: projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.annotationspecsets.get

GetDataItemRequest

Request message for GetDataItem.

Fields
name

string

Required. The name of the data item to get, format: projects/{project_id}/datasets/{dataset_id}/dataItems/{data_item_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.dataitems.get

GetDatasetRequest

Request message for GetDataSet.

Fields
name

string

Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.datasets.get

GetEvaluationJobRequest

Request message for GetEvaluationJob.

Fields
name

string

Required. Name of the evaluation job. Format:

"projects/{project_id}/evaluationJobs/{evaluation_job_id}"

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.evaluationjobs.get

GetEvaluationRequest

Request message for GetEvaluation.

Fields
name

string

Required. Name of the evaluation. Format:

"projects/{project_id}/datasets/{dataset_id}/evaluations/{evaluation_id}'

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.evaluations.get

GetExampleRequest

Request message for GetExample

Fields
name

string

Required. Name of example, format: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}/examples/{example_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.examples.get

filter

string

Optional. An expression for filtering Examples. Filter by annotation_spec.display_name is supported. Format "annotation_spec.display_name = {display_name}"

GetFeedbackMessageRequest

Request message for GetFeedbackMessage.

Fields
name

string

Required. Name of the feedback. Format:

'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}/feedbackMessages/{feedback_message_id}'.

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.feedbackMessages.get

GetFeedbackThreadRequest

Request message for GetFeedbackThread.

Fields
name

string

Required. Name of the feedback. Format:

'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}'.

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.feedbackThreads.get

GetInstructionRequest

Request message for GetInstruction.

Fields
name

string

Required. Instruction resource name, format: projects/{project_id}/instructions/{instruction_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.instructions.get

HumanAnnotationConfig

Configuration for how human labeling task should be done.

Fields
instruction

string

Required. Instruction resource name.

annotated_dataset_display_name

string

Required. A human-readable name for AnnotatedDataset defined by users. Maximum of 64 characters .

annotated_dataset_description

string

Optional. A human-readable description for AnnotatedDataset. The description can be up to 10000 characters long.

label_group

string

Optional. A human-readable label used to logically group labeling tasks. This string must match the regular expression [a-zA-Z\\d_-]{0,128}.

language_code

string

Optional. The Language of this question, as a BCP-47. Default value is en-US. Only need to set this when task is language related. For example, French text classification.

replica_count

int32

Optional. Replication of questions. Each question will be sent to up to this number of contributors to label. Aggregated answers will be returned. Default is set to 1. For image related labeling, valid values are 1, 3, 5.

question_duration

Duration

Optional. Maximum duration for contributors to answer a question. Maximum is 3600 seconds. Default is 3600 seconds.

contributor_emails[]

string

Optional. If you want your own labeling contributors to manage and work on this labeling request, you can set these contributors here. We will give them access to the question types in crowdcompute. Note that these emails must be registered in crowdcompute worker UI: https://crowd-compute.appspot.com/

user_email_address

string

Email of the user who started the labeling task and should be notified by email. If empty no notification will be sent.

ImageBoundingPolyAnnotation

Image bounding poly annotation. It represents a polygon including bounding box in the image.

Fields
annotation_spec

AnnotationSpec

Label of object in this bounding polygon.

Union field bounded_area. The region of the polygon. If it is a bounding box, it is guaranteed to be four points. bounded_area can be only one of the following:
bounding_poly

BoundingPoly

normalized_bounding_poly

NormalizedBoundingPoly

ImageClassificationAnnotation

Image classification annotation definition.

Fields
annotation_spec

AnnotationSpec

Label of image.

ImageClassificationConfig

Config for image classification human labeling task.

Fields
annotation_spec_set

string

Required. Annotation spec set resource name.

allow_multi_label

bool

Optional. If allow_multi_label is true, contributors are able to choose multiple labels for one image.

answer_aggregation_type

StringAggregationType

Optional. The type of how to aggregate answers.

ImagePayload

Container of information about an image.

Fields
mime_type

string

Image format.

image_thumbnail

bytes

A byte string of a thumbnail image.

image_uri

string

Image uri from the user bucket.

signed_uri

string

Signed uri of the image file in the service bucket.

ImagePolylineAnnotation

A polyline for the image annotation.

Fields
annotation_spec

AnnotationSpec

Label of this polyline.

Union field poly.

poly can be only one of the following:

polyline

Polyline

normalized_polyline

NormalizedPolyline

ImageSegmentationAnnotation

Image segmentation annotation.

Fields
annotation_colors

map<string, AnnotationSpec>

The mapping between rgb color and annotation spec. The key is the rgb color represented in format of rgb(0, 0, 0). The value is the AnnotationSpec.

mime_type

string

Image format.

image_bytes

bytes

A byte string of a full image's color map.

ImportDataOperationMetadata

Metadata of an ImportData operation.

Fields
dataset

string

Output only. The name of imported dataset. "projects/*/datasets/*"

partial_failures[]

Status

Output only. Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.

create_time

Timestamp

Output only. Timestamp when import dataset request was created.

ImportDataOperationResponse

Response used for ImportData longrunning operation.

Fields
dataset

string

Ouptut only. The name of imported dataset.

total_count

int32

Output only. Total number of examples requested to import

import_count

int32

Output only. Number of examples imported successfully.

ImportDataRequest

Request message for ImportData API.

Fields
name

string

Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.datasets.import

input_config

InputConfig

Required. Specify the input source of the data.

user_email_address

string

Email of the user who started the import task and should be notified by email. If empty no notification will be sent.

InputConfig

The configuration of input data, including data type, location, etc.

Fields
data_type

DataType

Required. Data type must be specifed when user tries to import data.

annotation_type

AnnotationType

Optional. The type of annotation to be performed on this data. You must specify this field if you are using this InputConfig in an EvaluationJob.

classification_metadata

ClassificationMetadata

Optional. Metadata about annotations for the input. You must specify this field if you are using this InputConfig in an EvaluationJob for a model version that performs classification.

text_metadata

TextMetadata

Required for text import, as language code must be specified.

Union field source. Required. Where the data is from. source can be only one of the following:
gcs_source

GcsSource

Source located in Cloud Storage.

bigquery_source

BigQuerySource

Source located in BigQuery. You must specify this field if you are using this InputConfig in an EvaluationJob.

Instruction

Instruction of how to perform the labeling task for human operators. Currently only PDF instruction is supported.

Fields
name

string

Output only. Instruction resource name, format: projects/{project_id}/instructions/{instruction_id}

display_name

string

Required. The display name of the instruction. Maximum of 64 characters.

description

string

Optional. User-provided description of the instruction. The description can be up to 10000 characters long.

create_time

Timestamp

Output only. Creation time of instruction.

update_time

Timestamp

Output only. Last update time of instruction.

data_type

DataType

Required. The data type of this instruction.

csv_instruction
(deprecated)

CsvInstruction

Deprecated: this instruction format is not supported any more. Instruction from a CSV file, such as for classification task. The CSV file should have exact two columns, in the following format:

  • The first column is labeled data, such as an image reference, text.
  • The second column is comma separated labels associated with data.

pdf_instruction

PdfInstruction

Instruction from a PDF document. The PDF should be in a Cloud Storage bucket.

blocking_resources[]

string

Output only. The names of any related resources that are blocking changes to the instruction.

LabelImageBoundingBoxOperationMetadata

Details of a LabelImageBoundingBox operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelImageBoundingPolyOperationMetadata

Details of LabelImageBoundingPoly operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelImageClassificationOperationMetadata

Metadata of a LabelImageClassification operation.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelImageOrientedBoundingBoxOperationMetadata

Details of a LabelImageOrientedBoundingBox operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config.

LabelImagePolylineOperationMetadata

Details of LabelImagePolyline operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelImageRequest

Request message for starting an image labeling task.

Fields
parent

string

Required. Name of the dataset to request labeling task, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.annotateddatasets.label

basic_config

HumanAnnotationConfig

Required. Basic human annotation config.

feature

Feature

Required. The type of image labeling task.

Union field request_config. Required. Config for labeling tasks. The type of request config must match the selected feature. request_config can be only one of the following:
image_classification_config

ImageClassificationConfig

Configuration for image classification task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.

bounding_poly_config

BoundingPolyConfig

Configuration for bounding box and bounding poly task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.

polyline_config

PolylineConfig

Configuration for polyline task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.

segmentation_config

SegmentationConfig

Configuration for segmentation task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.

Feature

Image labeling task feature.

Enums
FEATURE_UNSPECIFIED
CLASSIFICATION Label whole image with one or more of labels.
BOUNDING_BOX Label image with bounding boxes for labels.
ORIENTED_BOUNDING_BOX Label oriented bounding box. The box does not have to be parallel to horizontal line.
BOUNDING_POLY Label images with bounding poly. A bounding poly is a plane figure that is bounded by a finite chain of straight line segments closing in a loop.
POLYLINE Label images with polyline. Polyline is formed by connected line segments which are not in closed form.
SEGMENTATION Label images with segmentation. Segmentation is different from bounding poly since it is more fine-grained, pixel level annotation.

LabelImageSegmentationOperationMetadata

Details of a LabelImageSegmentation operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config.

LabelOperationMetadata

Metadata of a labeling operation, such as LabelImage or LabelVideo. Next tag: 20

Fields
dataset

string

Output only. The name of dataset to be labeled. "projects/*/datasets/*"

progress_percent

int32

Output only. Progress of label operation. Range: [0, 100].

partial_failures[]

Status

Output only. Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.

create_time

Timestamp

Output only. Timestamp when labeling request was created.

Union field details. Ouptut only. Details of specific label operation. details can be only one of the following:
image_classification_details

LabelImageClassificationOperationMetadata

Details of label image classification operation.

image_bounding_box_details

LabelImageBoundingBoxOperationMetadata

Details of label image bounding box operation.

image_bounding_poly_details

LabelImageBoundingPolyOperationMetadata

Details of label image bounding poly operation.

image_oriented_bounding_box_details

LabelImageOrientedBoundingBoxOperationMetadata

Details of label image oriented bounding box operation.

image_polyline_details

LabelImagePolylineOperationMetadata

Details of label image polyline operation.

image_segmentation_details

LabelImageSegmentationOperationMetadata

Details of label image segmentation operation.

video_classification_details

LabelVideoClassificationOperationMetadata

Details of label video classification operation.

video_object_detection_details

LabelVideoObjectDetectionOperationMetadata

Details of label video object detection operation.

video_object_tracking_details

LabelVideoObjectTrackingOperationMetadata

Details of label video object tracking operation.

video_event_details

LabelVideoEventOperationMetadata

Details of label video event operation.

text_classification_details

LabelTextClassificationOperationMetadata

Details of label text classification operation.

text_entity_extraction_details

LabelTextEntityExtractionOperationMetadata

Details of label text entity extraction operation.

LabelStats

Statistics about annotation specs.

Fields
example_count

map<string, int64>

Map of each annotation spec's example count. Key is the annotation spec name and value is the number of examples for that annotation spec. If the annotated dataset does not have annotation spec, the map will return a pair where the key is empty string and value is the total number of annotations.

LabelTextClassificationOperationMetadata

Details of a LabelTextClassification operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelTextEntityExtractionOperationMetadata

Details of a LabelTextEntityExtraction operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelTextRequest

Request message for LabelText.

Fields
parent

string

Required. Name of the data set to request labeling task, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.annotateddatasets.label

basic_config

HumanAnnotationConfig

Required. Basic human annotation config.

feature

Feature

Required. The type of text labeling task.

Union field request_config. Required. Config for labeling tasks. The type of request config must match the selected feature. request_config can be only one of the following:
text_classification_config

TextClassificationConfig

Configuration for text classification task. One of text_classification_config and text_entity_extraction_config is required.

text_entity_extraction_config

TextEntityExtractionConfig

Configuration for entity extraction task. One of text_classification_config and text_entity_extraction_config is required.

Feature

Text labeling task feature.

Enums
FEATURE_UNSPECIFIED
TEXT_CLASSIFICATION Label text content to one of more labels.
TEXT_ENTITY_EXTRACTION Label entities and their span in text.

LabelVideoClassificationOperationMetadata

Details of a LabelVideoClassification operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelVideoEventOperationMetadata

Details of a LabelVideoEvent operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelVideoObjectDetectionOperationMetadata

Details of a LabelVideoObjectDetection operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelVideoObjectTrackingOperationMetadata

Details of a LabelVideoObjectTracking operation metadata.

Fields
basic_config

HumanAnnotationConfig

Basic human annotation config used in labeling request.

LabelVideoRequest

Request message for LabelVideo.

Fields
parent

string

Required. Name of the dataset to request labeling task, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.annotateddatasets.label

basic_config

HumanAnnotationConfig

Required. Basic human annotation config.

feature

Feature

Required. The type of video labeling task.

Union field request_config. Required. Config for labeling tasks. The type of request config must match the selected feature. request_config can be only one of the following:
video_classification_config

VideoClassificationConfig

Configuration for video classification task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.

object_detection_config

ObjectDetectionConfig

Configuration for video object detection task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.

object_tracking_config

ObjectTrackingConfig

Configuration for video object tracking task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.

event_config

EventConfig

Configuration for video event task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.

Feature

Video labeling task feature.

Enums
FEATURE_UNSPECIFIED
CLASSIFICATION Label whole video or video segment with one or more labels.
OBJECT_DETECTION Label objects with bounding box on image frames extracted from the video.
OBJECT_TRACKING Label and track objects in video.
EVENT Label the range of video for the specified events.

ListAnnotatedDatasetsRequest

Request message for ListAnnotatedDatasets.

Fields
parent

string

Required. Name of the dataset to list annotated datasets, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.annotateddatasets.list

filter

string

Optional. Filter is not supported at this moment.

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by ListAnnotatedDatasetsResponse.next_page_token of the previous [DataLabelingService.ListAnnotatedDatasets] call. Return first page if empty.

ListAnnotatedDatasetsResponse

Results of listing annotated datasets for a dataset.

Fields
annotated_datasets[]

AnnotatedDataset

The list of annotated datasets to return.

next_page_token

string

A token to retrieve next page of results.

ListAnnotationSpecSetsRequest

Request message for ListAnnotationSpecSets.

Fields
parent

string

Required. Parent of AnnotationSpecSet resource, format: projects/{project_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.annotationspecsets.list

filter

string

Optional. Filter is not supported at this moment.

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by ListAnnotationSpecSetsResponse.next_page_token of the previous [DataLabelingService.ListAnnotationSpecSets] call. Return first page if empty.

ListAnnotationSpecSetsResponse

Results of listing annotation spec set under a project.

Fields
annotation_spec_sets[]

AnnotationSpecSet

The list of annotation spec sets.

next_page_token

string

A token to retrieve next page of results.

ListDataItemsRequest

Request message for ListDataItems.

Fields
parent

string

Required. Name of the dataset to list data items, format: projects/{project_id}/datasets/{dataset_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.dataitems.list

filter

string

Optional. Filter is not supported at this moment.

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by ListDataItemsResponse.next_page_token of the previous [DataLabelingService.ListDataItems] call. Return first page if empty.

ListDataItemsResponse

Results of listing data items in a dataset.

Fields
data_items[]

DataItem

The list of data items to return.

next_page_token

string

A token to retrieve next page of results.

ListDatasetsRequest

Request message for ListDataset.

Fields
parent

string

Required. Dataset resource parent, format: projects/{project_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.datasets.list

filter

string

Optional. Filter on dataset is not supported at this moment.

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by ListDatasetsResponse.next_page_token of the previous [DataLabelingService.ListDatasets] call. Returns the first page if empty.

ListDatasetsResponse

Results of listing datasets within a project.

Fields
datasets[]

Dataset

The list of datasets to return.

next_page_token

string

A token to retrieve next page of results.

ListEvaluationJobsRequest

Request message for ListEvaluationJobs.

Fields
parent

string

Required. Evaluation job resource parent. Format: "projects/{project_id}"

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.evaluationjobs.list

filter

string

Optional. You can filter the jobs to list by model_id (also known as model_name, as described in EvaluationJob.modelVersion) or by evaluation job state (as described in EvaluationJob.state). To filter by both criteria, use the AND operator or the OR operator. For example, you can use the following string for your filter: "evaluation_job.model_id = {model_name} AND evaluation_job.state = {evaluation_job_state}"

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by the nextPageToken in the response to the previous request. The request returns the first page if this is empty.

ListEvaluationJobsResponse

Results for listing evaluation jobs.

Fields
evaluation_jobs[]

EvaluationJob

The list of evaluation jobs to return.

next_page_token

string

A token to retrieve next page of results.

ListExamplesRequest

Request message for ListExamples.

Fields
parent

string

Required. Example resource parent.

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.examples.list

filter

string

Optional. An expression for filtering Examples. For annotated datasets that have annotation spec set, filter by annotation_spec.display_name is supported. Format "annotation_spec.display_name = {display_name}"

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by ListExamplesResponse.next_page_token of the previous [DataLabelingService.ListExamples] call. Return first page if empty.

ListExamplesResponse

Results of listing Examples in and annotated dataset.

Fields
examples[]

Example

The list of examples to return.

next_page_token

string

A token to retrieve next page of results.

ListFeedbackMessagesRequest

Request message for ListFeedbackMessages.

Fields
parent

string

Required. FeedbackMessage resource parent. Format:

"projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}"

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.feedbackMessages.list

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by [ListFeedbackMessages.next_page_token][] of the previous [DataLabelingService.ListFeedbackMessages] call. Return first page if empty.

ListFeedbackMessagesResponse

Results for listing FeedbackMessages.

Fields
feedback_messages[]

FeedbackMessage

The list of feedback messages to return.

next_page_token

string

A token to retrieve next page of results.

ListFeedbackThreadsRequest

Request message for ListFeedbackThreads.

Fields
parent

string

Required. FeedbackThread resource parent. Format:

"projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}"

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.feedbackThreads.list

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by [ListFeedbackThreads.next_page_token][] of the previous [DataLabelingService.ListFeedbackThreads] call. Return first page if empty.

ListFeedbackThreadsResponse

Results for listing FeedbackThreads.

Fields
feedback_threads[]

FeedbackThread

The list of feedback threads to return.

next_page_token

string

A token to retrieve next page of results.

ListInstructionsRequest

Request message for ListInstructions.

Fields
parent

string

Required. Instruction resource parent, format: projects/{project_id}

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.instructions.list

filter

string

Optional. Filter is not supported at this moment.

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by ListInstructionsResponse.next_page_token of the previous [DataLabelingService.ListInstructions] call. Return first page if empty.

ListInstructionsResponse

Results of listing instructions under a project.

Fields
instructions[]

Instruction

The list of Instructions to return.

next_page_token

string

A token to retrieve next page of results.

NormalizedBoundingPoly

Normalized bounding polygon.

Fields
normalized_vertices[]

NormalizedVertex

The bounding polygon normalized vertices.

NormalizedPolyline

Normalized polyline.

Fields
normalized_vertices[]

NormalizedVertex

The normalized polyline vertices.

NormalizedVertex

A vertex represents a 2D point in the image. NOTE: the normalized vertex coordinates are relative to the original image and range from 0 to 1.

Fields
x

float

X coordinate.

y

float

Y coordinate.

ObjectDetectionConfig

Config for video object detection human labeling task. Object detection will be conducted on the images extracted from the video, and those objects will be labeled with bounding boxes. User need to specify the number of images to be extracted per second as the extraction frame rate.

Fields
annotation_spec_set

string

Required. Annotation spec set resource name.

extraction_frame_rate

double

Required. Number of frames per second to be extracted from the video.

ObjectDetectionMetrics

Metrics calculated for an image object detection (bounding box) model.

Fields
pr_curve

PrCurve

Precision-recall curve.

ObjectTrackingConfig

Config for video object tracking human labeling task.

Fields
annotation_spec_set

string

Required. Annotation spec set resource name.

ObjectTrackingFrame

Video frame level annotation for object detection and tracking.

Fields
time_offset

Duration

The time offset of this frame relative to the beginning of the video.

Union field bounded_area. The bounding box location of this object track for the frame. bounded_area can be only one of the following:
bounding_poly

BoundingPoly

normalized_bounding_poly

NormalizedBoundingPoly

OperatorFeedbackMetadata

Metadata describing the feedback from the operator.

OperatorMetadata

General information useful for labels coming from contributors.

Fields
score

float

Confidence score corresponding to a label. For examle, if 3 contributors have answered the question and 2 of them agree on the final label, the confidence score will be 0.67 (2/3).

total_votes

int32

The total number of contributors that answer this question.

label_votes

int32

The total number of contributors that choose this label.

comments[]

string

Comments from contributors.

OutputConfig

The configuration of output data.

Fields
Union field destination. Required. Location to output data to. destination can be only one of the following:
gcs_destination

GcsDestination

Output to a file in Cloud Storage. Should be used for labeling output other than image segmentation.

gcs_folder_destination

GcsFolderDestination

Output to a folder in Cloud Storage. Should be used for image segmentation labeling output.

PauseEvaluationJobRequest

Request message for PauseEvaluationJob.

Fields
name

string

Required. Name of the evaluation job that is going to be paused. Format:

"projects/{project_id}/evaluationJobs/{evaluation_job_id}"

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.evaluationjobs.pause

PdfInstruction

Instruction from a PDF file.

Fields
gcs_file_uri

string

PDF file for the instruction. Only gcs path is allowed.

Polyline

A line with multiple line segments.

Fields
vertices[]

Vertex

The polyline vertices.

PolylineConfig

Config for image polyline human labeling task.

Fields
annotation_spec_set

string

Required. Annotation spec set resource name.

instruction_message

string

Optional. Instruction message showed on contributors UI.

PrCurve

Fields
annotation_spec

AnnotationSpec

The annotation spec of the label for which the precision-recall curve calculated. If this field is empty, that means the precision-recall curve is an aggregate curve for all labels.

area_under_curve

float

Area under the precision-recall curve. Not to be confused with area under a receiver operating characteristic (ROC) curve.

confidence_metrics_entries[]

ConfidenceMetricsEntry

Entries that make up the precision-recall graph. Each entry is a "point" on the graph drawn for a different confidence_threshold.

mean_average_precision

float

Mean average prcision of this curve.

ConfidenceMetricsEntry

Fields
confidence_threshold

float

Threshold used for this entry.

For classification tasks, this is a classification threshold: a predicted label is categorized as positive or negative (in the context of this point on the PR curve) based on whether the label's score meets this threshold.

For image object detection (bounding box) tasks, this is the [intersection-over-union

(IOU)](/vision/automl/object-detection/docs/evaluate#intersection-over-union) threshold for the context of this point on the PR curve.

recall

float

Recall value.

precision

float

Precision value.

f1_score

float

Harmonic mean of recall and precision.

recall_at1

float

Recall value for entries with label that has highest score.

precision_at1

float

Precision value for entries with label that has highest score.

f1_score_at1

float

The harmonic mean of recall_at1 and precision_at1.

recall_at5

float

Recall value for entries with label that has highest 5 scores.

precision_at5

float

Precision value for entries with label that has highest 5 scores.

f1_score_at5

float

The harmonic mean of recall_at5 and precision_at5.

RequesterFeedbackMetadata

Metadata describing the feedback from the labeling task requester.

ResumeEvaluationJobRequest

Request message ResumeEvaluationJob.

Fields
name

string

Required. Name of the evaluation job that is going to be resumed. Format:

"projects/{project_id}/evaluationJobs/{evaluation_job_id}"

Authorization requires the following Google IAM permission on the specified resource name:

  • datalabeling.evaluationjobs.resume

SearchEvaluationsRequest

Request message for SearchEvaluation.

Fields
parent

string

Required. Evaluation search parent (project ID). Format: "projects/{project_id}"

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.evaluations.list

filter

string

Optional. To search evaluations, you can filter by the following:

To filter by multiple critiera, use the AND operator or the OR operator. The following examples shows a string that filters by several critiera:

"evaluation_job.evaluation_job_id = {evaluation_job_id} AND evaluation_job.model_id = {model_name} AND evaluation_job.evaluation_job_run_time_start = {timestamp_1} AND evaluation_job.evaluation_job_run_time_end = {timestamp_2} AND annotation_spec.display_name = {display_name}"

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by the nextPageToken of the response to a previous search request.

If you don't specify this field, the API call requests the first page of the search.

SearchEvaluationsResponse

Results of searching evaluations.

Fields
evaluations[]

Evaluation

The list of evaluations matching the search.

next_page_token

string

A token to retrieve next page of results.

SearchExampleComparisonsRequest

Request message of SearchExampleComparisons.

Fields
parent

string

Required. Name of the Evaluation resource to search for example comparisons from. Format:

"projects/{project_id}/datasets/{dataset_id}/evaluations/{evaluation_id}"

Authorization requires the following Google IAM permission on the specified resource parent:

  • datalabeling.examplecomparisons.list

page_size

int32

Optional. Requested page size. Server may return fewer results than requested. Default value is 100.

page_token

string

Optional. A token identifying a page of results for the server to return. Typically obtained by the [nextPageToken][SearchExampleComparisons.next_page_token] of the response to a previous search rquest.

If you don't specify this field, the API call requests the first page of the search.

SearchExampleComparisonsResponse

Results of searching example comparisons.

Fields
example_comparisons[]

ExampleComparison

A list of example comparisons matching the search criteria.

next_page_token

string

A token to retrieve next page of results.

ExampleComparison

Example comparisons comparing ground truth output and predictions for a specific input.

Fields
ground_truth_example

Example

The ground truth output for the input.

model_created_examples[]

Example

Predictions by the model for the input.

SegmentationConfig

Config for image segmentation

Fields
annotation_spec_set

string

Required. Annotation spec set resource name. format: projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}

instruction_message

string

Instruction message showed on labelers UI.

SentimentConfig

Config for setting up sentiments.

Fields
enable_label_sentiment_selection

bool

If set to true, contributors will have the option to select sentiment of the label they selected, to mark it as negative or positive label. Default is false.

SequentialSegment

Start and end position in a sequence (e.g. text segment).

Fields
start

int32

Start position (inclusive).

end

int32

End position (exclusive).

StringAggregationType

Enums
STRING_AGGREGATION_TYPE_UNSPECIFIED
MAJORITY_VOTE Majority vote to aggregate answers.
UNANIMOUS_VOTE Unanimous answers will be adopted.
NO_AGGREGATION Preserve all answers by crowd compute.

TextClassificationAnnotation

Text classification annotation.

Fields
annotation_spec

AnnotationSpec

Label of the text.

TextClassificationConfig

Config for text classification human labeling task.

Fields
allow_multi_label

bool

Optional. If allow_multi_label is true, contributors are able to choose multiple labels for one text segment.

annotation_spec_set

string

Required. Annotation spec set resource name.

sentiment_config

SentimentConfig

Optional. Configs for sentiment selection.

TextEntityExtractionAnnotation

Text entity extraction annotation.

Fields
annotation_spec

AnnotationSpec

Label of the text entities.

sequential_segment

SequentialSegment

Position of the entity.

TextEntityExtractionConfig

Config for text entity extraction human labeling task.

Fields
annotation_spec_set

string

Required. Annotation spec set resource name.

TextMetadata

Metadata for the text.

Fields
language_code

string

The language of this text, as a BCP-47. Default value is en-US.

TextPayload

Container of information about a piece of text.

Fields
text_content

string

Text content.

TimeSegment

A time period inside of an example that has a time dimension (e.g. video).

Fields
start_time_offset

Duration

Start of the time segment (inclusive), represented as the duration since the example start.

end_time_offset

Duration

End of the time segment (exclusive), represented as the duration since the example start.

UpdateEvaluationJobRequest

Request message for UpdateEvaluationJob.

Fields
evaluation_job

EvaluationJob

Required. Evaluation job that is going to be updated.

Authorization requires the following Google IAM permission on the specified resource evaluationJob:

  • datalabeling.evaluationjobs.update

update_mask

FieldMask

Optional. Mask for which fields to update. You can only provide the following fields:

  • evaluationJobConfig.humanAnnotationConfig.instruction
  • evaluationJobConfig.exampleCount
  • evaluationJobConfig.exampleSamplePercentage

You can provide more than one of these fields by separating them with commas.

Vertex

A vertex represents a 2D point in the image. NOTE: the vertex coordinates are in the same scale as the original image.

Fields
x

int32

X coordinate.

y

int32

Y coordinate.

VideoClassificationAnnotation

Video classification annotation.

Fields
time_segment

TimeSegment

The time segment of the video to which the annotation applies.

annotation_spec

AnnotationSpec

Label of the segment specified by time_segment.

VideoClassificationConfig

Config for video classification human labeling task. Currently two types of video classification are supported: 1. Assign labels on the entire video. 2. Split the video into multiple video clips based on camera shot, and assign labels on each video clip.

Fields
annotation_spec_set_configs[]

AnnotationSpecSetConfig

Required. The list of annotation spec set configs. Since watching a video clip takes much longer time than an image, we support label with multiple AnnotationSpecSet at the same time. Labels in each AnnotationSpecSet will be shown in a group to contributors. Contributors can select one or more (depending on whether to allow multi label) from each group.

apply_shot_detection

bool

Optional. Option to apply shot detection on the video.

AnnotationSpecSetConfig

Annotation spec set with the setting of allowing multi labels or not.

Fields
annotation_spec_set

string

Required. Annotation spec set resource name.

allow_multi_label

bool

Optional. If allow_multi_label is true, contributors are able to choose multiple labels from one annotation spec set.

VideoEventAnnotation

Video event annotation.

Fields
annotation_spec

AnnotationSpec

Label of the event in this annotation.

time_segment

TimeSegment

The time segment of the video to which the annotation applies.

VideoObjectTrackingAnnotation

Video object tracking annotation.

Fields
annotation_spec

AnnotationSpec

Label of the object tracked in this annotation.

time_segment

TimeSegment

The time segment of the video to which object tracking applies.

object_tracking_frames[]

ObjectTrackingFrame

The list of frames where this object track appears.

VideoPayload

Container of information of a video.

Fields
mime_type

string

Video format.

video_uri

string

Video uri from the user bucket.

video_thumbnails[]

VideoThumbnail

The list of video thumbnails.

frame_rate

float

FPS of the video.

signed_uri

string

Signed uri of the video file in the service bucket.

VideoThumbnail

Container of information of a video thumbnail.

Fields
thumbnail

bytes

A byte string of the video frame.

time_offset

Duration

Time offset relative to the beginning of the video, corresponding to the video frame where the thumbnail has been extracted from.