Package google.cloud.datalabeling.v1beta1

Index

• DataLabelingService (interface)
• AnnotatedDataset (message)
• AnnotatedDatasetMetadata (message)
• Annotation (message)
• AnnotationMetadata (message)
• AnnotationSentiment (enum)
• AnnotationSource (enum)
• AnnotationSpec (message)
• AnnotationSpecSet (message)
• AnnotationType (enum)
• AnnotationValue (message)
• Attempt (message)
• BigQuerySource (message)
• BoundingBoxEvaluationOptions (message)
• BoundingPoly (message)
• BoundingPolyConfig (message)
• ClassificationMetadata (message)
• ClassificationMetrics (message)
• ConfusionMatrix (message)
• ConfusionMatrix.ConfusionMatrixEntry (message)
• ConfusionMatrix.Row (message)
• CreateAnnotationSpecSetRequest (message)
• CreateDatasetRequest (message)
• CreateEvaluationJobRequest (message)
• CreateFeedbackMessageRequest (message)
• CreateInstructionMetadata (message)
• CreateInstructionRequest (message)
• CsvInstruction (message)
• DataItem (message)
• DataType (enum)
• Dataset (message)
• DeleteAnnotatedDatasetRequest (message)
• DeleteAnnotationSpecSetRequest (message)
• DeleteDatasetRequest (message)
• DeleteEvaluationJobRequest (message)
• DeleteFeedbackMessageRequest (message)
• DeleteFeedbackThreadRequest (message)
• DeleteInstructionRequest (message)
• Evaluation (message)
• EvaluationConfig (message)
• EvaluationJob (message)
• EvaluationJob.State (enum)
• EvaluationJobAlertConfig (message)
• EvaluationJobConfig (message)
• EvaluationMetrics (message)
• EventConfig (message)
• Example (message)
• ExportDataOperationMetadata (message)
• ExportDataOperationResponse (message)
• ExportDataRequest (message)
• FeedbackMessage (message)
• FeedbackThread (message)
• FeedbackThreadMetadata (message)
• FeedbackThreadStatus (enum)
• GcsDestination (message)
• GcsFolderDestination (message)
• GcsSource (message)
• GetAnnotatedDatasetRequest (message)
• GetAnnotationSpecSetRequest (message)
• GetDataItemRequest (message)
• GetDatasetRequest (message)
• GetEvaluationJobRequest (message)
• GetEvaluationRequest (message)
• GetExampleRequest (message)
• GetFeedbackMessageRequest (message)
• GetFeedbackThreadRequest (message)
• GetInstructionRequest (message)
• HumanAnnotationConfig (message)
• ImageBoundingPolyAnnotation (message)
• ImageClassificationAnnotation (message)
• ImageClassificationConfig (message)
• ImagePayload (message)
• ImagePolylineAnnotation (message)
• ImageSegmentationAnnotation (message)
• ImportDataOperationMetadata (message)
• ImportDataOperationResponse (message)
• ImportDataRequest (message)
• InputConfig (message)
• Instruction (message)
• LabelImageBoundingBoxOperationMetadata (message)
• LabelImageBoundingPolyOperationMetadata (message)
• LabelImageClassificationOperationMetadata (message)
• LabelImageOrientedBoundingBoxOperationMetadata (message)
• LabelImagePolylineOperationMetadata (message)
• LabelImageRequest (message)
• LabelImageRequest.Feature (enum)
• LabelImageSegmentationOperationMetadata (message)
• LabelOperationMetadata (message)
• LabelStats (message)
• LabelTextClassificationOperationMetadata (message)
• LabelTextEntityExtractionOperationMetadata (message)
• LabelTextRequest (message)
• LabelTextRequest.Feature (enum)
• LabelVideoClassificationOperationMetadata (message)
• LabelVideoEventOperationMetadata (message)
• LabelVideoObjectDetectionOperationMetadata (message)
• LabelVideoObjectTrackingOperationMetadata (message)
• LabelVideoRequest (message)
• LabelVideoRequest.Feature (enum)
• ListAnnotatedDatasetsRequest (message)
• ListAnnotatedDatasetsResponse (message)
• ListAnnotationSpecSetsRequest (message)
• ListAnnotationSpecSetsResponse (message)
• ListDataItemsRequest (message)
• ListDataItemsResponse (message)
• ListDatasetsRequest (message)
• ListDatasetsResponse (message)
• ListEvaluationJobsRequest (message)
• ListEvaluationJobsResponse (message)
• ListExamplesRequest (message)
• ListExamplesResponse (message)
• ListFeedbackMessagesRequest (message)
• ListFeedbackMessagesResponse (message)
• ListFeedbackThreadsRequest (message)
• ListFeedbackThreadsResponse (message)
• ListInstructionsRequest (message)
• ListInstructionsResponse (message)
• NormalizedBoundingPoly (message)
• NormalizedPolyline (message)
• NormalizedVertex (message)
• ObjectDetectionConfig (message)
• ObjectDetectionMetrics (message)
• ObjectTrackingConfig (message)
• ObjectTrackingFrame (message)
• OperatorFeedbackMetadata (message)
• OperatorMetadata (message)
• OutputConfig (message)
• PauseEvaluationJobRequest (message)
• PdfInstruction (message)
• Polyline (message)
• PolylineConfig (message)
• PrCurve (message)
• PrCurve.ConfidenceMetricsEntry (message)
• RequesterFeedbackMetadata (message)
• ResumeEvaluationJobRequest (message)
• SearchEvaluationsRequest (message)
• SearchEvaluationsResponse (message)
• SearchExampleComparisonsRequest (message)
• SearchExampleComparisonsResponse (message)
• SearchExampleComparisonsResponse.ExampleComparison (message)
• SegmentationConfig (message)
• SentimentConfig (message)
• SequentialSegment (message)
• StringAggregationType (enum)
• TextClassificationAnnotation (message)
• TextClassificationConfig (message)
• TextEntityExtractionAnnotation (message)
• TextEntityExtractionConfig (message)
• TextMetadata (message)
• TextPayload (message)
• TimeSegment (message)
• UpdateEvaluationJobRequest (message)
• Vertex (message)
• VideoClassificationAnnotation (message)
• VideoClassificationConfig (message)
• VideoClassificationConfig.AnnotationSpecSetConfig (message)
• VideoEventAnnotation (message)
• VideoObjectTrackingAnnotation (message)
• VideoPayload (message)
• VideoThumbnail (message)

DataLabelingService

CreateAnnotationSpecSet
rpc CreateAnnotationSpecSet(CreateAnnotationSpecSetRequest) returns (AnnotationSpecSet) Creates an annotation spec set by providing a set of labels. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

CreateDataset
rpc CreateDataset(CreateDatasetRequest) returns (Dataset) Creates dataset. If success return a Dataset resource. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

CreateEvaluationJob
rpc CreateEvaluationJob(CreateEvaluationJobRequest) returns (EvaluationJob) Creates an evaluation job. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

CreateFeedbackMessage
rpc CreateFeedbackMessage(CreateFeedbackMessageRequest) returns (Operation) Create a FeedbackMessage object. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

CreateInstruction
rpc CreateInstruction(CreateInstructionRequest) returns (Operation) Creates an instruction for how data should be labeled. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

DeleteAnnotatedDataset
rpc DeleteAnnotatedDataset(DeleteAnnotatedDatasetRequest) returns (Empty) Deletes an annotated dataset by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

DeleteAnnotationSpecSet
rpc DeleteAnnotationSpecSet(DeleteAnnotationSpecSetRequest) returns (Empty) Deletes an annotation spec set by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

DeleteDataset
rpc DeleteDataset(DeleteDatasetRequest) returns (Empty) Deletes a dataset by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

DeleteEvaluationJob
rpc DeleteEvaluationJob(DeleteEvaluationJobRequest) returns (Empty) Stops and deletes an evaluation job. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

DeleteFeedbackMessage
rpc DeleteFeedbackMessage(DeleteFeedbackMessageRequest) returns (Empty) Delete a FeedbackMessage. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

DeleteFeedbackThread
rpc DeleteFeedbackThread(DeleteFeedbackThreadRequest) returns (Empty) Delete a FeedbackThread. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

DeleteInstruction
rpc DeleteInstruction(DeleteInstructionRequest) returns (Empty) Deletes an instruction object by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ExportData
rpc ExportData(ExportDataRequest) returns (Operation) Exports data and annotations from dataset. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetAnnotatedDataset
rpc GetAnnotatedDataset(GetAnnotatedDatasetRequest) returns (AnnotatedDataset) Gets an annotated dataset by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetAnnotationSpecSet
rpc GetAnnotationSpecSet(GetAnnotationSpecSetRequest) returns (AnnotationSpecSet) Gets an annotation spec set by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetDataItem
rpc GetDataItem(GetDataItemRequest) returns (DataItem) Gets a data item in a dataset by resource name. This API can be called after data are imported into dataset. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetDataset
rpc GetDataset(GetDatasetRequest) returns (Dataset) Gets dataset by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetEvaluation
rpc GetEvaluation(GetEvaluationRequest) returns (Evaluation) Gets an evaluation by resource name (to search, use projects.evaluations.search). Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetEvaluationJob
rpc GetEvaluationJob(GetEvaluationJobRequest) returns (EvaluationJob) Gets an evaluation job by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetExample
rpc GetExample(GetExampleRequest) returns (Example) Gets an example by resource name, including both data and annotation. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetFeedbackMessage
rpc GetFeedbackMessage(GetFeedbackMessageRequest) returns (FeedbackMessage) Get a FeedbackMessage object. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetFeedbackThread
rpc GetFeedbackThread(GetFeedbackThreadRequest) returns (FeedbackThread) Get a FeedbackThread object. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

GetInstruction
rpc GetInstruction(GetInstructionRequest) returns (Instruction) Gets an instruction by resource name. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ImportData

rpc ImportData(ImportDataRequest) returns (Operation) Imports data into dataset based on source locations defined in request. It can be called multiple times for the same dataset. Each dataset can only have one long running operation running on it. For example, no labeling task (also long running operation) can be started while importing is still ongoing. Vice versa. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

LabelImage
rpc LabelImage(LabelImageRequest) returns (Operation) Starts a labeling task for image. The type of image labeling task is configured by feature in the request. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

LabelText
rpc LabelText(LabelTextRequest) returns (Operation) Starts a labeling task for text. The type of text labeling task is configured by feature in the request. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

LabelVideo
rpc LabelVideo(LabelVideoRequest) returns (Operation) Starts a labeling task for video. The type of video labeling task is configured by feature in the request. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListAnnotatedDatasets
rpc ListAnnotatedDatasets(ListAnnotatedDatasetsRequest) returns (ListAnnotatedDatasetsResponse) Lists annotated datasets for a dataset. Pagination is supported. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListAnnotationSpecSets
rpc ListAnnotationSpecSets(ListAnnotationSpecSetsRequest) returns (ListAnnotationSpecSetsResponse) Lists annotation spec sets for a project. Pagination is supported. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListDataItems
rpc ListDataItems(ListDataItemsRequest) returns (ListDataItemsResponse) Lists data items in a dataset. This API can be called after data are imported into dataset. Pagination is supported. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListDatasets
rpc ListDatasets(ListDatasetsRequest) returns (ListDatasetsResponse) Lists datasets under a project. Pagination is supported. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListEvaluationJobs
rpc ListEvaluationJobs(ListEvaluationJobsRequest) returns (ListEvaluationJobsResponse) Lists all evaluation jobs within a project with possible filters. Pagination is supported. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListExamples
rpc ListExamples(ListExamplesRequest) returns (ListExamplesResponse) Lists examples in an annotated dataset. Pagination is supported. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListFeedbackMessages
rpc ListFeedbackMessages(ListFeedbackMessagesRequest) returns (ListFeedbackMessagesResponse) List FeedbackMessages with pagination. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListFeedbackThreads
rpc ListFeedbackThreads(ListFeedbackThreadsRequest) returns (ListFeedbackThreadsResponse) List FeedbackThreads with pagination. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ListInstructions
rpc ListInstructions(ListInstructionsRequest) returns (ListInstructionsResponse) Lists instructions for a project. Pagination is supported. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

PauseEvaluationJob
rpc PauseEvaluationJob(PauseEvaluationJobRequest) returns (Empty) Pauses an evaluation job. Pausing an evaluation job that is already in a PAUSED state is a no-op. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

ResumeEvaluationJob
rpc ResumeEvaluationJob(ResumeEvaluationJobRequest) returns (Empty) Resumes a paused evaluation job. A deleted evaluation job can't be resumed. Resuming a running or scheduled evaluation job is a no-op. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

SearchEvaluations
rpc SearchEvaluations(SearchEvaluationsRequest) returns (SearchEvaluationsResponse) Searches evaluations within a project. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

SearchExampleComparisons

rpc SearchExampleComparisons(SearchExampleComparisonsRequest) returns (SearchExampleComparisonsResponse) Searches example comparisons from an evaluation. The return format is a list of example comparisons that show ground truth and prediction(s) for a single input. Search by providing an evaluation ID. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

UpdateEvaluationJob

rpc UpdateEvaluationJob(UpdateEvaluationJobRequest) returns (EvaluationJob) Updates an evaluation job. You can only update certain fields of the job's EvaluationJobConfig: humanAnnotationConfig.instruction, exampleCount, and exampleSamplePercentage. If you want to change any other aspect of the evaluation job, you must delete the job and create a new one. Authorization Scopes Requires the following OAuth scope: https://www.googleapis.com/auth/cloud-platform For more information, see the Authentication Overview.

AnnotatedDataset

AnnotatedDataset is a set holding annotations for data in a Dataset. Each labeling task will generate an AnnotatedDataset under the Dataset that the task is requested for.

Fields
name	string Output only. AnnotatedDataset resource name in format of: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}
display_name	string Output only. The display name of the AnnotatedDataset. It is specified in HumanAnnotationConfig when user starts a labeling task. Maximum of 64 characters.
description	string Output only. The description of the AnnotatedDataset. It is specified in HumanAnnotationConfig when user starts a labeling task. Maximum of 10000 characters.
annotation_source	AnnotationSource Output only. Source of the annotation.
annotation_type	AnnotationType Output only. Type of the annotation. It is specified when starting labeling task.
example_count	int64 Output only. Number of examples in the annotated dataset.
completed_example_count	int64 Output only. Number of examples that have annotation in the annotated dataset.
label_stats	LabelStats Output only. Per label statistics.
create_time	Timestamp Output only. Time the AnnotatedDataset was created.
metadata	AnnotatedDatasetMetadata Output only. Additional information about AnnotatedDataset.
blocking_resources[]	string Output only. The names of any related resources that are blocking changes to the annotated dataset.

AnnotatedDatasetMetadata

Metadata on AnnotatedDataset.

Fields
human_annotation_config	HumanAnnotationConfig HumanAnnotationConfig used when requesting the human labeling task for this AnnotatedDataset.
Union field annotation_request_config. Specific request configuration used when requesting the labeling task. annotation_request_config can be only one of the following:
image_classification_config	ImageClassificationConfig Configuration for image classification task.
bounding_poly_config	BoundingPolyConfig Configuration for image bounding box and bounding poly task.
polyline_config	PolylineConfig Configuration for image polyline task.
segmentation_config	SegmentationConfig Configuration for image segmentation task.
video_classification_config	VideoClassificationConfig Configuration for video classification task.
object_detection_config	ObjectDetectionConfig Configuration for video object detection task.
object_tracking_config	ObjectTrackingConfig Configuration for video object tracking task.
event_config	EventConfig Configuration for video event labeling task.
text_classification_config	TextClassificationConfig Configuration for text classification task.
text_entity_extraction_config	TextEntityExtractionConfig Configuration for text entity extraction task.

Annotation

Annotation for Example. Each example may have one or more annotations. For example in image classification problem, each image might have one or more labels. We call labels binded with this image an Annotation.

Fields
name	string Output only. Unique name of this annotation, format is: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset}/examples/{example_id}/annotations/{annotation_id}
annotation_source	AnnotationSource Output only. The source of the annotation.
annotation_value	AnnotationValue Output only. This is the actual annotation value, e.g classification, bounding box values are stored here.
annotation_metadata	AnnotationMetadata Output only. Annotation metadata, including information like votes for labels.
annotation_sentiment	AnnotationSentiment Output only. Sentiment for this annotation.

AnnotationMetadata

Additional information associated with the annotation.

Fields
operator_metadata	OperatorMetadata Metadata related to human labeling.

AnnotationSentiment

Enums
ANNOTATION_SENTIMENT_UNSPECIFIED
NEGATIVE	This annotation describes negatively about the data.
POSITIVE	This label describes positively about the data.

AnnotationSource

Specifies where the annotation comes from (whether it was provided by a human labeler or a different source).

Enums
ANNOTATION_SOURCE_UNSPECIFIED
OPERATOR	Answer is provided by a human contributor.

AnnotationSpec

Container of information related to one possible annotation that can be used in a labeling task. For example, an image classification task where images are labeled as dog or cat must reference an AnnotationSpec for dog and an AnnotationSpec for cat.

Fields
display_name	string Required. The display name of the AnnotationSpec. Maximum of 64 characters.
description	string Optional. User-provided description of the annotation specification. The description can be up to 10,000 characters long.
index	int32 Output only. This is the integer index of the AnnotationSpec. The index for the whole AnnotationSpecSet is sequential starting from 0. For example, an AnnotationSpecSet with classes dog and cat, might contain one AnnotationSpec with { display_name: "dog", index: 0 } and one AnnotationSpec with { display_name: "cat", index: 1 }. This is especially useful for model training as it encodes the string labels into numeric values.

AnnotationSpecSet

An AnnotationSpecSet is a collection of label definitions. For example, in image classification tasks, you define a set of possible labels for images as an AnnotationSpecSet. An AnnotationSpecSet is immutable upon creation.

Fields
name	string Output only. The AnnotationSpecSet resource name in the following format: "projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}"
display_name	string Required. The display name for AnnotationSpecSet that you define when you create it. Maximum of 64 characters.
description	string Optional. User-provided description of the annotation specification set. The description can be up to 10,000 characters long.
annotation_specs[]	AnnotationSpec Required. The array of AnnotationSpecs that you define when you create the AnnotationSpecSet. These are the possible labels for the labeling task.
blocking_resources[]	string Output only. The names of any related resources that are blocking changes to the annotation spec set.

AnnotationType

Enums
ANNOTATION_TYPE_UNSPECIFIED
IMAGE_CLASSIFICATION_ANNOTATION	Classification annotations in an image. Allowed for continuous evaluation.
IMAGE_BOUNDING_BOX_ANNOTATION	Bounding box annotations in an image. A form of image object detection. Allowed for continuous evaluation.
IMAGE_ORIENTED_BOUNDING_BOX_ANNOTATION	Oriented bounding box. The box does not have to be parallel to horizontal line.
IMAGE_BOUNDING_POLY_ANNOTATION	Bounding poly annotations in an image.
IMAGE_POLYLINE_ANNOTATION	Polyline annotations in an image.
IMAGE_SEGMENTATION_ANNOTATION	Segmentation annotations in an image.
VIDEO_SHOTS_CLASSIFICATION_ANNOTATION	Classification annotations in video shots.
VIDEO_OBJECT_TRACKING_ANNOTATION	Video object tracking annotation.
VIDEO_OBJECT_DETECTION_ANNOTATION	Video object detection annotation.
VIDEO_EVENT_ANNOTATION	Video event annotation.
TEXT_CLASSIFICATION_ANNOTATION	Classification for text. Allowed for continuous evaluation.
TEXT_ENTITY_EXTRACTION_ANNOTATION	Entity extraction for text.
GENERAL_CLASSIFICATION_ANNOTATION	General classification. Allowed for continuous evaluation.

AnnotationValue

Annotation value for an example.

Fields
Union field value_type. value_type can be only one of the following:
image_classification_annotation	ImageClassificationAnnotation Annotation value for image classification case.
image_bounding_poly_annotation	ImageBoundingPolyAnnotation Annotation value for image bounding box, oriented bounding box and polygon cases.
image_polyline_annotation	ImagePolylineAnnotation Annotation value for image polyline cases. Polyline here is different from BoundingPoly. It is formed by line segments connected to each other but not closed form(Bounding Poly). The line segments can cross each other.
image_segmentation_annotation	ImageSegmentationAnnotation Annotation value for image segmentation.
text_classification_annotation	TextClassificationAnnotation Annotation value for text classification case.
text_entity_extraction_annotation	TextEntityExtractionAnnotation Annotation value for text entity extraction case.
video_classification_annotation	VideoClassificationAnnotation Annotation value for video classification case.
video_object_tracking_annotation	VideoObjectTrackingAnnotation Annotation value for video object detection and tracking case.
video_event_annotation	VideoEventAnnotation Annotation value for video event case.

Attempt

Records a failed evaluation job run.

Fields
attempt_time	Timestamp
partial_failures[]	Status Details of errors that occurred.

BigQuerySource

The BigQuery location for input data. If used in an EvaluationJob, this is where the service saves the prediction input and output sampled from the model version.

Fields

input_uri

string Required. BigQuery URI to a table, up to 2,000 characters long. If you specify the URI of a table that does not exist, Data Labeling Service creates a table at the URI with the correct schema when you create your EvaluationJob. If you specify the URI of a table that already exists, it must have the correct schema. Provide the table URI in the following format: "bq://{your_project_id}/{your_dataset_name}/{your_table_name}" Learn more.

BoundingBoxEvaluationOptions

Options regarding evaluation between bounding boxes.

Fields
iou_threshold	float Minimum [intersection-over-union (IOU)](/vision/automl/object-detection/docs/evaluate#intersection-over-union) required for 2 bounding boxes to be considered a match. This must be a number between 0 and 1.

BoundingPoly

A bounding polygon in the image.

Fields
vertices[]	Vertex The bounding polygon vertices.

BoundingPolyConfig

Config for image bounding poly (and bounding box) human labeling task.

Fields
annotation_spec_set	string Required. Annotation spec set resource name.
instruction_message	string Optional. Instruction message showed on contributors UI.

ClassificationMetadata

Metadata for classification annotations.

Fields
is_multi_label	bool Whether the classification task is multi-label or not.

ClassificationMetrics

Metrics calculated for a classification model.

Fields
pr_curve	PrCurve Precision-recall curve based on ground truth labels, predicted labels, and scores for the predicted labels.
confusion_matrix	ConfusionMatrix Confusion matrix of predicted labels vs. ground truth labels.

ConfusionMatrix

Confusion matrix of the model running the classification. Only applicable when the metrics entry aggregates multiple labels. Not applicable when the entry is for a single label.

Fields
row[]	Row

ConfusionMatrixEntry

Fields
annotation_spec	AnnotationSpec The annotation spec of a predicted label.
item_count	int32 Number of items predicted to have this label. (The ground truth label for these items is the Row.annotationSpec of this entry's parent.)

Row

A row in the confusion matrix. Each entry in this row has the same ground truth label.

Fields
annotation_spec	AnnotationSpec The annotation spec of the ground truth label for this row.
entries[]	ConfusionMatrixEntry A list of the confusion matrix entries. One entry for each possible predicted label.

CreateAnnotationSpecSetRequest

Request message for CreateAnnotationSpecSet.

Fields
parent	string Required. AnnotationSpecSet resource parent, format: projects/{project_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.annotationspecsets.create
annotation_spec_set	AnnotationSpecSet Required. Annotation spec set to create. Annotation specs must be included. Only one annotation spec will be accepted for annotation specs with same display_name.

CreateDatasetRequest

Request message for CreateDataset.

Fields
parent	string Required. Dataset resource parent, format: projects/{project_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.datasets.create
dataset	Dataset Required. The dataset to be created.

CreateEvaluationJobRequest

Request message for CreateEvaluationJob.

Fields
parent	string Required. Evaluation job resource parent. Format: "projects/{project_id}" Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.evaluationjobs.create
job	EvaluationJob Required. The evaluation job to create.

CreateFeedbackMessageRequest

Request message for CreateFeedbackMessage.

Fields
parent	string Required. FeedbackMessage resource parent, format: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}. Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.feedbackMessages.create
feedback_message	FeedbackMessage Required. The feedback message to create.

CreateInstructionMetadata

Metadata of a CreateInstruction operation.

Fields
instruction	string The name of the created Instruction. projects/{project_id}/instructions/{instruction_id}
partial_failures[]	Status Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.
create_time	Timestamp Timestamp when create instruction request was created.

CreateInstructionRequest

Request message for CreateInstruction.

Fields
parent	string Required. Instruction resource parent, format: projects/{project_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.instructions.create
instruction	Instruction Required. Instruction of how to perform the labeling task.

CsvInstruction

Deprecated: this instruction format is not supported any more. Instruction from a CSV file.

Fields
gcs_file_uri	string CSV file for the instruction. Only gcs path is allowed.

DataItem

DataItem is a piece of data, without annotation. For example, an image.

Fields
name	string Output only. Name of the data item, in format of: projects/{project_id}/datasets/{dataset_id}/dataItems/{data_item_id}
Union field payload. Output only. payload can be only one of the following:
image_payload	ImagePayload The image payload, a container of the image bytes/uri.
text_payload	TextPayload The text payload, a container of text content.
video_payload	VideoPayload The video payload, a container of the video uri.

DataType

Enums
DATA_TYPE_UNSPECIFIED
IMAGE	Allowed for continuous evaluation.
VIDEO
TEXT	Allowed for continuous evaluation.
GENERAL_DATA	Allowed for continuous evaluation.

Dataset

Dataset is the resource to hold your data. You can request multiple labeling tasks for a dataset while each one will generate an AnnotatedDataset.

Fields
name	string Output only. Dataset resource name, format is: projects/{project_id}/datasets/{dataset_id}
display_name	string Required. The display name of the dataset. Maximum of 64 characters.
description	string Optional. User-provided description of the annotation specification set. The description can be up to 10000 characters long.
create_time	Timestamp Output only. Time the dataset is created.
input_configs[]	InputConfig Output only. This is populated with the original input configs where ImportData is called. It is available only after the clients import data to this dataset.
blocking_resources[]	string Output only. The names of any related resources that are blocking changes to the dataset.
data_item_count	int64 Output only. The number of data items in the dataset.

DeleteAnnotatedDatasetRequest

Request message for DeleteAnnotatedDataset.

Fields
name	string Required. Name of the annotated dataset to delete, format: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.annotateddatasets.delete

DeleteAnnotationSpecSetRequest

Request message for DeleteAnnotationSpecSet.

Fields
name	string Required. AnnotationSpec resource name, format: projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}. Authorization requires the following Google IAM permission on the specified resource name: datalabeling.annotationspecsets.delete

DeleteDatasetRequest

Request message for DeleteDataset.

Fields
name	string Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.datasets.delete

DeleteEvaluationJobRequest

Request message DeleteEvaluationJob.

Fields
name	string Required. Name of the evaluation job that is going to be deleted. Format: "projects/{project_id}/evaluationJobs/{evaluation_job_id}" Authorization requires the following Google IAM permission on the specified resource name: datalabeling.evaluationjobs.delete

DeleteFeedbackMessageRequest

Request message DeleteFeedbackMessage.

Fields
name	string Required. Name of the FeedbackMessage that is going to be deleted. Format: 'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}/feedbackMessages/{feedback_message_id}'. Authorization requires the following Google IAM permission on the specified resource name: datalabeling.feedbackMessages.delete

DeleteFeedbackThreadRequest

Request message DeleteFeedbackThread.

Fields
name	string Required. Name of the FeedbackThread that is going to be deleted. Format: 'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}'. Authorization requires the following Google IAM permission on the specified resource name: datalabeling.feedbackThreads.delete

DeleteInstructionRequest

Request message for DeleteInstruction.

Fields
name	string Required. Instruction resource name, format: projects/{project_id}/instructions/{instruction_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.instructions.delete

Evaluation

Describes an evaluation between a machine learning model's predictions and ground truth labels. Created when an EvaluationJob runs successfully.

Fields
name	string Output only. Resource name of an evaluation. The name has the following format: "projects/{project_id}/datasets/{dataset_id}/evaluations/{evaluation_id}'
config	EvaluationConfig Output only. Options used in the evaluation job that created this evaluation.
evaluation_job_run_time	Timestamp Output only. Timestamp for when the evaluation job that created this evaluation ran.
create_time	Timestamp Output only. Timestamp for when this evaluation was created.
evaluation_metrics	EvaluationMetrics Output only. Metrics comparing predictions to ground truth labels.
annotation_type	AnnotationType Output only. Type of task that the model version being evaluated performs, as defined in the evaluationJobConfig.inputConfig.annotationType field of the evaluation job that created this evaluation.
evaluated_item_count	int64 Output only. The number of items in the ground truth dataset that were used for this evaluation. Only populated when the evaulation is for certain AnnotationTypes.

EvaluationConfig

Configuration details used for calculating evaluation metrics and creating an Evaluation.

Fields
bounding_box_evaluation_options	BoundingBoxEvaluationOptions Only specify this field if the related model performs image object detection (IMAGE_BOUNDING_BOX_ANNOTATION). Describes how to evaluate bounding boxes.

EvaluationJob

Defines an evaluation job that runs periodically to generate Evaluations. Creating an evaluation job is the starting point for using continuous evaluation.

Fields
name	string Output only. After you create a job, Data Labeling Service assigns a name to the job with the following format: "projects/{project_id}/evaluationJobs/{evaluation_job_id}"
description	string Required. Description of the job. The description can be up to 25,000 characters long.
state	State Output only. Describes the current state of the job.
schedule	string Required. Describes the interval at which the job runs. This interval must be at least 1 day, and it is rounded to the nearest day. For example, if you specify a 50-hour interval, the job runs every 2 days. You can provide the schedule in crontab format or in an English-like format. Regardless of what you specify, the job will run at 10:00 AM UTC. Only the interval from this schedule is used, not the specific time of day.
model_version	string Required. The AI Platform Prediction model version to be evaluated. Prediction input and output is sampled from this model version. When creating an evaluation job, specify the model version in the following format: "projects/{project_id}/models/{model_name}/versions/{version_name}" There can only be one evaluation job per model version.
evaluation_job_config	EvaluationJobConfig Required. Configuration details for the evaluation job.
annotation_spec_set	string Required. Name of the AnnotationSpecSet describing all the labels that your machine learning model outputs. You must create this resource before you create an evaluation job and provide its name in the following format: "projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}"
label_missing_ground_truth	bool Required. Whether you want Data Labeling Service to provide ground truth labels for prediction input. If you want the service to assign human labelers to annotate your data, set this to true. If you want to provide your own ground truth labels in the evaluation job's BigQuery table, set this to false.
attempts[]	Attempt Output only. Every time the evaluation job runs and an error occurs, the failed attempt is appended to this array.
create_time	Timestamp Output only. Timestamp of when this evaluation job was created.

State

State of the job.

Enums
STATE_UNSPECIFIED
SCHEDULED	The job is scheduled to run at the configured interval. You can pause or delete the job. When the job is in this state, it samples prediction input and output from your model version into your BigQuery table as predictions occur.
RUNNING	The job is currently running. When the job runs, Data Labeling Service does several things: If you have configured your job to use Data Labeling Service for ground truth labeling, the service creates a Dataset and a labeling task for all data sampled since the last time the job ran. Human labelers provide ground truth labels for your data. Human labeling may take hours, or even days, depending on how much data has been sampled. The job remains in the RUNNING state during this time, and it can even be running multiple times in parallel if it gets triggered again (for example 24 hours later) before the earlier run has completed. When human labelers have finished labeling the data, the next step occurs. If you have configured your job to provide your own ground truth labels, Data Labeling Service still creates a Dataset for newly sampled data, but it expects that you have already added ground truth labels to the BigQuery table by this time. The next step occurs immediately. Data Labeling Service creates an Evaluation by comparing your model version's predictions with the ground truth labels. If the job remains in this state for a long time, it continues to sample prediction data into your BigQuery table and will run again at the next interval, even if it causes the job to run multiple times in parallel.
PAUSED	The job is not sampling prediction input and output into your BigQuery table and it will not run according to its schedule. You can resume the job.
STOPPED	The job has this state right before it is deleted.

EvaluationJobAlertConfig

Provides details for how an evaluation job sends email alerts based on the results of a run.

Fields
email	string Required. An email address to send alerts to.
min_acceptable_mean_average_precision	double Required. A number between 0 and 1 that describes a minimum mean average precision threshold. When the evaluation job runs, if it calculates that your model version's predictions from the recent interval have meanAveragePrecision below this threshold, then it sends an alert to your specified email.

EvaluationJobConfig

Configures specific details of how a continuous evaluation job works. Provide this configuration when you create an EvaluationJob.

Fields
input_config	InputConfig Rquired. Details for the sampled prediction input. Within this configuration, there are requirements for several fields: dataType must be one of IMAGE, TEXT, or GENERAL_DATA. annotationType must be one of IMAGE_CLASSIFICATION_ANNOTATION, TEXT_CLASSIFICATION_ANNOTATION, GENERAL_CLASSIFICATION_ANNOTATION, or IMAGE_BOUNDING_BOX_ANNOTATION (image object detection). If your machine learning model performs classification, you must specify classificationMetadata.isMultiLabel. You must specify bigquerySource (not gcsSource).
evaluation_config	EvaluationConfig Required. Details for calculating evaluation metrics and creating Evaulations. If your model version performs image object detection, you must specify the boundingBoxEvaluationOptions field within this configuration. Otherwise, provide an empty object for this configuration.
human_annotation_config	HumanAnnotationConfig Optional. Details for human annotation of your data. If you set labelMissingGroundTruth to true for this evaluation job, then you must specify this field. If you plan to provide your own ground truth labels, then omit this field. Note that you must create an Instruction resource before you can specify this field. Provide the name of the instruction resource in the instruction field within this configuration.
bigquery_import_keys	map<string, string> Required. Prediction keys that tell Data Labeling Service where to find the data for evaluation in your BigQuery table. When the service samples prediction input and output from your model version and saves it to BigQuery, the data gets stored as JSON strings in the BigQuery table. These keys tell Data Labeling Service how to parse the JSON. You can provide the following entries in this field: data_json_key: the data key for prediction input. You must provide either this key or reference_json_key. reference_json_key: the data reference key for prediction input. You must provide either this key or data_json_key. label_json_key: the label key for prediction output. Required. label_score_json_key: the score key for prediction output. Required. bounding_box_json_key: the bounding box key for prediction output. Required if your model version perform image object detection. Learn how to configure prediction keys.
example_count	int32 Required. The maximum number of predictions to sample and save to BigQuery during each evaluation interval. This limit overrides example_sample_percentage: even if the service has not sampled enough predictions to fulfill example_sample_perecentage during an interval, it stops sampling predictions when it meets this limit.
example_sample_percentage	double Required. Fraction of predictions to sample and save to BigQuery during each evaluation interval. For example, 0.1 means 10% of predictions served by your model version get saved to BigQuery.
evaluation_job_alert_config	EvaluationJobAlertConfig Optional. Configuration details for evaluation job alerts. Specify this field if you want to receive email alerts if the evaluation job finds that your predictions have low mean average precision during a run.
Union field human_annotation_request_config. Required. Details for how you want human reviewers to provide ground truth labels. human_annotation_request_config can be only one of the following:
image_classification_config	ImageClassificationConfig Specify this field if your model version performs image classification or general classification. annotationSpecSet in this configuration must match EvaluationJob.annotationSpecSet. allowMultiLabel in this configuration must match classificationMetadata.isMultiLabel in input_config.
bounding_poly_config	BoundingPolyConfig Specify this field if your model version performs image object detection (bounding box detection). annotationSpecSet in this configuration must match EvaluationJob.annotationSpecSet.
text_classification_config	TextClassificationConfig Specify this field if your model version performs text classification. annotationSpecSet in this configuration must match EvaluationJob.annotationSpecSet. allowMultiLabel in this configuration must match classificationMetadata.isMultiLabel in input_config.

EvaluationMetrics

Fields
Union field metrics. Common metrics covering most general cases. metrics can be only one of the following:
classification_metrics	ClassificationMetrics
object_detection_metrics	ObjectDetectionMetrics

EventConfig

Config for video event human labeling task.

Fields
annotation_spec_sets[]	string Required. The list of annotation spec set resource name. Similar to video classification, we support selecting event from multiple AnnotationSpecSet at the same time.

Example

An Example is a piece of data and its annotation. For example, an image with label "house".

Fields
name	string Output only. Name of the example, in format of: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}/examples/{example_id}
annotations[]	Annotation Output only. Annotations for the piece of data in Example. One piece of data can have multiple annotations.
Union field payload. Output only. The data part of Example. payload can be only one of the following:
image_payload	ImagePayload The image payload, a container of the image bytes/uri.
text_payload	TextPayload The text payload, a container of the text content.
video_payload	VideoPayload The video payload, a container of the video uri.

ExportDataOperationMetadata

Metadata of an ExportData operation.

Fields
dataset	string Output only. The name of dataset to be exported. "projects/*/datasets/*"
annotated_dataset	string Output only. The name of annotated dataset in format "projects/*/datasets/*/annotatedDatasets/*".
partial_failures[]	Status Output only. Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.
create_time	Timestamp Output only. Timestamp when export dataset request was created.

ExportDataOperationResponse

Response used for ExportDataset longrunning operation.

Fields
dataset	string Ouptut only. The name of dataset. "projects/*/datasets/*"
annotated_dataset	string Output only. The name of annotated dataset in format "projects/*/datasets/*/annotatedDatasets/*".
total_count	int32 Output only. Total number of examples requested to export
export_count	int32 Output only. Number of examples exported successfully.
label_stats	LabelStats Output only. Statistic infos of labels in the exported dataset.
output_config	OutputConfig Output only. output_config in the ExportData request.

ExportDataRequest

Request message for ExportData API.

Fields
name	string Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.datasets.export
annotated_dataset	string Required. Annotated dataset resource name. DataItem in Dataset and their annotations in specified annotated dataset will be exported. It's in format of projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}
filter	string Optional. Filter is not supported at this moment.
output_config	OutputConfig Required. Specify the output destination.
user_email_address	string Email of the user who started the export task and should be notified by email. If empty no notification will be sent.

FeedbackMessage

A feedback message inside a feedback thread.

Fields
name	string Name of the feedback message in a feedback thread. Format: 'project/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}/feedbackMessage/{feedback_message_id}'
body	string String content of the feedback. Maximum of 10000 characters.
image	bytes The image storing this feedback if the feedback is an image representing operator's comments.
create_time	Timestamp Create time.
Union field metadata. Metadata marking the source and additional information of this feedback. metadata can be only one of the following:
requester_feedback_metadata	RequesterFeedbackMetadata
operator_feedback_metadata	OperatorFeedbackMetadata

FeedbackThread

A feedback thread of a certain labeling task on a certain annotated dataset.

Fields
name	string Name of the feedback thread. Format: 'project/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}'
feedback_thread_metadata	FeedbackThreadMetadata Metadata regarding the feedback thread.

FeedbackThreadMetadata

Fields
thumbnail	bytes An image thumbnail of this thread.
status	FeedbackThreadStatus
create_time	Timestamp When the thread is created
last_update_time	Timestamp When the thread is last updated.

FeedbackThreadStatus

Enums
FEEDBACK_THREAD_STATUS_UNSPECIFIED
NEW	Feedback thread is created with no reply;
REPLIED	Feedback thread is replied at least once;

GcsDestination

Export destination of the data.Only gcs path is allowed in output_uri.

Fields
output_uri	string Required. The output uri of destination file.
mime_type	string Required. The format of the gcs destination. Only "text/csv" and "application/json" are supported.

GcsFolderDestination

Export folder destination of the data.

Fields
output_folder_uri	string Required. Cloud Storage directory to export data to.

GcsSource

Source of the Cloud Storage file to be imported.

Fields
input_uri	string Required. The input URI of source file. This must be a Cloud Storage path (gs://...).
mime_type	string Required. The format of the source file. Only "text/csv" is supported.

GetAnnotatedDatasetRequest

Request message for GetAnnotatedDataset.

Fields
name	string Required. Name of the annotated dataset to get, format: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.annotateddatasets.get

GetAnnotationSpecSetRequest

Request message for GetAnnotationSpecSet.

Fields
name	string Required. AnnotationSpecSet resource name, format: projects/{project_id}/annotationSpecSets/{annotation_spec_set_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.annotationspecsets.get

GetDataItemRequest

Request message for GetDataItem.

Fields
name	string Required. The name of the data item to get, format: projects/{project_id}/datasets/{dataset_id}/dataItems/{data_item_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.dataitems.get

GetDatasetRequest

Request message for GetDataSet.

Fields
name	string Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.datasets.get

GetEvaluationJobRequest

Request message for GetEvaluationJob.

Fields
name	string Required. Name of the evaluation job. Format: "projects/{project_id}/evaluationJobs/{evaluation_job_id}" Authorization requires the following Google IAM permission on the specified resource name: datalabeling.evaluationjobs.get

GetEvaluationRequest

Request message for GetEvaluation.

Fields
name	string Required. Name of the evaluation. Format: "projects/{project_id}/datasets/{dataset_id}/evaluations/{evaluation_id}' Authorization requires the following Google IAM permission on the specified resource name: datalabeling.evaluations.get

GetExampleRequest

Request message for GetExample

Fields
name	string Required. Name of example, format: projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/ {annotated_dataset_id}/examples/{example_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.examples.get
filter	string Optional. An expression for filtering Examples. Filter by annotation_spec.display_name is supported. Format "annotation_spec.display_name = {display_name}"

GetFeedbackMessageRequest

Request message for GetFeedbackMessage.

Fields
name	string Required. Name of the feedback. Format: 'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}/feedbackMessages/{feedback_message_id}'. Authorization requires the following Google IAM permission on the specified resource name: datalabeling.feedbackMessages.get

GetFeedbackThreadRequest

Request message for GetFeedbackThread.

Fields
name	string Required. Name of the feedback. Format: 'projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}'. Authorization requires the following Google IAM permission on the specified resource name: datalabeling.feedbackThreads.get

GetInstructionRequest

Request message for GetInstruction.

Fields
name	string Required. Instruction resource name, format: projects/{project_id}/instructions/{instruction_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.instructions.get

HumanAnnotationConfig

Configuration for how human labeling task should be done.

Fields
instruction	string Required. Instruction resource name.
annotated_dataset_display_name	string Required. A human-readable name for AnnotatedDataset defined by users. Maximum of 64 characters .
annotated_dataset_description	string Optional. A human-readable description for AnnotatedDataset. The description can be up to 10000 characters long.
label_group	string Optional. A human-readable label used to logically group labeling tasks. This string must match the regular expression [a-zA-Z\\d_-]{0,128}.
language_code	string Optional. The Language of this question, as a BCP-47. Default value is en-US. Only need to set this when task is language related. For example, French text classification.
replica_count	int32 Optional. Replication of questions. Each question will be sent to up to this number of contributors to label. Aggregated answers will be returned. Default is set to 1. For image related labeling, valid values are 1, 3, 5.
question_duration	Duration Optional. Maximum duration for contributors to answer a question. Maximum is 3600 seconds. Default is 3600 seconds.
contributor_emails[]	string Optional. If you want your own labeling contributors to manage and work on this labeling request, you can set these contributors here. We will give them access to the question types in crowdcompute. Note that these emails must be registered in crowdcompute worker UI: https://crowd-compute.appspot.com/
user_email_address	string Email of the user who started the labeling task and should be notified by email. If empty no notification will be sent.

ImageBoundingPolyAnnotation

Image bounding poly annotation. It represents a polygon including bounding box in the image.

Fields
annotation_spec	AnnotationSpec Label of object in this bounding polygon.
Union field bounded_area. The region of the polygon. If it is a bounding box, it is guaranteed to be four points. bounded_area can be only one of the following:
bounding_poly	BoundingPoly
normalized_bounding_poly	NormalizedBoundingPoly

ImageClassificationAnnotation

Image classification annotation definition.

Fields
annotation_spec	AnnotationSpec Label of image.

ImageClassificationConfig

Config for image classification human labeling task.

Fields
annotation_spec_set	string Required. Annotation spec set resource name.
allow_multi_label	bool Optional. If allow_multi_label is true, contributors are able to choose multiple labels for one image.
answer_aggregation_type	StringAggregationType Optional. The type of how to aggregate answers.

ImagePayload

Container of information about an image.

Fields
mime_type	string Image format.
image_thumbnail	bytes A byte string of a thumbnail image.
image_uri	string Image uri from the user bucket.
signed_uri	string Signed uri of the image file in the service bucket.

ImagePolylineAnnotation

A polyline for the image annotation.

Fields
annotation_spec	AnnotationSpec Label of this polyline.
Union field poly. poly can be only one of the following:
polyline	Polyline
normalized_polyline	NormalizedPolyline

ImageSegmentationAnnotation

Image segmentation annotation.

Fields
annotation_colors	map<string, AnnotationSpec> The mapping between rgb color and annotation spec. The key is the rgb color represented in format of rgb(0, 0, 0). The value is the AnnotationSpec.
mime_type	string Image format.
image_bytes	bytes A byte string of a full image's color map.

ImportDataOperationMetadata

Metadata of an ImportData operation.

Fields
dataset	string Output only. The name of imported dataset. "projects/*/datasets/*"
partial_failures[]	Status Output only. Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.
create_time	Timestamp Output only. Timestamp when import dataset request was created.

ImportDataOperationResponse

Response used for ImportData longrunning operation.

Fields
dataset	string Ouptut only. The name of imported dataset.
total_count	int32 Output only. Total number of examples requested to import
import_count	int32 Output only. Number of examples imported successfully.

ImportDataRequest

Request message for ImportData API.

Fields
name	string Required. Dataset resource name, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource name: datalabeling.datasets.import
input_config	InputConfig Required. Specify the input source of the data.
user_email_address	string Email of the user who started the import task and should be notified by email. If empty no notification will be sent.

InputConfig

The configuration of input data, including data type, location, etc.

Fields
data_type	DataType Required. Data type must be specifed when user tries to import data.
annotation_type	AnnotationType Optional. The type of annotation to be performed on this data. You must specify this field if you are using this InputConfig in an EvaluationJob.
classification_metadata	ClassificationMetadata Optional. Metadata about annotations for the input. You must specify this field if you are using this InputConfig in an EvaluationJob for a model version that performs classification.
text_metadata	TextMetadata Required for text import, as language code must be specified.
Union field source. Required. Where the data is from. source can be only one of the following:
gcs_source	GcsSource Source located in Cloud Storage.
bigquery_source	BigQuerySource Source located in BigQuery. You must specify this field if you are using this InputConfig in an EvaluationJob.

Instruction

Instruction of how to perform the labeling task for human operators. Currently only PDF instruction is supported.

Fields
name	string Output only. Instruction resource name, format: projects/{project_id}/instructions/{instruction_id}
display_name	string Required. The display name of the instruction. Maximum of 64 characters.
description	string Optional. User-provided description of the instruction. The description can be up to 10000 characters long.
create_time	Timestamp Output only. Creation time of instruction.
update_time	Timestamp Output only. Last update time of instruction.
data_type	DataType Required. The data type of this instruction.
csv_instruction (deprecated)	CsvInstruction This item is deprecated! Deprecated: this instruction format is not supported any more. Instruction from a CSV file, such as for classification task. The CSV file should have exact two columns, in the following format: The first column is labeled data, such as an image reference, text. The second column is comma separated labels associated with data.
pdf_instruction	PdfInstruction Instruction from a PDF document. The PDF should be in a Cloud Storage bucket.
blocking_resources[]	string Output only. The names of any related resources that are blocking changes to the instruction.

LabelImageBoundingBoxOperationMetadata

Details of a LabelImageBoundingBox operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelImageBoundingPolyOperationMetadata

Details of LabelImageBoundingPoly operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelImageClassificationOperationMetadata

Metadata of a LabelImageClassification operation.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelImageOrientedBoundingBoxOperationMetadata

Details of a LabelImageOrientedBoundingBox operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config.

LabelImagePolylineOperationMetadata

Details of LabelImagePolyline operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelImageRequest

Request message for starting an image labeling task.

Fields
parent	string Required. Name of the dataset to request labeling task, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.annotateddatasets.label
basic_config	HumanAnnotationConfig Required. Basic human annotation config.
feature	Feature Required. The type of image labeling task.
Union field request_config. Required. Config for labeling tasks. The type of request config must match the selected feature. request_config can be only one of the following:
image_classification_config	ImageClassificationConfig Configuration for image classification task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.
bounding_poly_config	BoundingPolyConfig Configuration for bounding box and bounding poly task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.
polyline_config	PolylineConfig Configuration for polyline task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.
segmentation_config	SegmentationConfig Configuration for segmentation task. One of image_classification_config, bounding_poly_config, polyline_config and segmentation_config are required.

Feature

Image labeling task feature.

Enums
FEATURE_UNSPECIFIED
CLASSIFICATION	Label whole image with one or more of labels.
BOUNDING_BOX	Label image with bounding boxes for labels.
ORIENTED_BOUNDING_BOX	Label oriented bounding box. The box does not have to be parallel to horizontal line.
BOUNDING_POLY	Label images with bounding poly. A bounding poly is a plane figure that is bounded by a finite chain of straight line segments closing in a loop.
POLYLINE	Label images with polyline. Polyline is formed by connected line segments which are not in closed form.
SEGMENTATION	Label images with segmentation. Segmentation is different from bounding poly since it is more fine-grained, pixel level annotation.

LabelImageSegmentationOperationMetadata

Details of a LabelImageSegmentation operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config.

LabelOperationMetadata

Metadata of a labeling operation, such as LabelImage or LabelVideo. Next tag: 20

Fields
dataset	string Output only. The name of dataset to be labeled. "projects/*/datasets/*"
progress_percent	int32 Output only. Progress of label operation. Range: [0, 100].
partial_failures[]	Status Output only. Partial failures encountered. E.g. single files that couldn't be read. Status details field will contain standard GCP error details.
create_time	Timestamp Output only. Timestamp when labeling request was created.
Union field details. Ouptut only. Details of specific label operation. details can be only one of the following:
image_classification_details	LabelImageClassificationOperationMetadata Details of label image classification operation.
image_bounding_box_details	LabelImageBoundingBoxOperationMetadata Details of label image bounding box operation.
image_bounding_poly_details	LabelImageBoundingPolyOperationMetadata Details of label image bounding poly operation.
image_oriented_bounding_box_details	LabelImageOrientedBoundingBoxOperationMetadata Details of label image oriented bounding box operation.
image_polyline_details	LabelImagePolylineOperationMetadata Details of label image polyline operation.
image_segmentation_details	LabelImageSegmentationOperationMetadata Details of label image segmentation operation.
video_classification_details	LabelVideoClassificationOperationMetadata Details of label video classification operation.
video_object_detection_details	LabelVideoObjectDetectionOperationMetadata Details of label video object detection operation.
video_object_tracking_details	LabelVideoObjectTrackingOperationMetadata Details of label video object tracking operation.
video_event_details	LabelVideoEventOperationMetadata Details of label video event operation.
text_classification_details	LabelTextClassificationOperationMetadata Details of label text classification operation.
text_entity_extraction_details	LabelTextEntityExtractionOperationMetadata Details of label text entity extraction operation.

LabelStats

Statistics about annotation specs.

Fields
example_count	map<string, int64> Map of each annotation spec's example count. Key is the annotation spec name and value is the number of examples for that annotation spec. If the annotated dataset does not have annotation spec, the map will return a pair where the key is empty string and value is the total number of annotations.

LabelTextClassificationOperationMetadata

Details of a LabelTextClassification operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelTextEntityExtractionOperationMetadata

Details of a LabelTextEntityExtraction operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelTextRequest

Request message for LabelText.

Fields
parent	string Required. Name of the data set to request labeling task, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.annotateddatasets.label
basic_config	HumanAnnotationConfig Required. Basic human annotation config.
feature	Feature Required. The type of text labeling task.
Union field request_config. Required. Config for labeling tasks. The type of request config must match the selected feature. request_config can be only one of the following:
text_classification_config	TextClassificationConfig Configuration for text classification task. One of text_classification_config and text_entity_extraction_config is required.
text_entity_extraction_config	TextEntityExtractionConfig Configuration for entity extraction task. One of text_classification_config and text_entity_extraction_config is required.

Feature

Text labeling task feature.

Enums
FEATURE_UNSPECIFIED
TEXT_CLASSIFICATION	Label text content to one of more labels.
TEXT_ENTITY_EXTRACTION	Label entities and their span in text.

LabelVideoClassificationOperationMetadata

Details of a LabelVideoClassification operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelVideoEventOperationMetadata

Details of a LabelVideoEvent operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelVideoObjectDetectionOperationMetadata

Details of a LabelVideoObjectDetection operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelVideoObjectTrackingOperationMetadata

Details of a LabelVideoObjectTracking operation metadata.

Fields
basic_config	HumanAnnotationConfig Basic human annotation config used in labeling request.

LabelVideoRequest

Request message for LabelVideo.

Fields
parent	string Required. Name of the dataset to request labeling task, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.annotateddatasets.label
basic_config	HumanAnnotationConfig Required. Basic human annotation config.
feature	Feature Required. The type of video labeling task.
Union field request_config. Required. Config for labeling tasks. The type of request config must match the selected feature. request_config can be only one of the following:
video_classification_config	VideoClassificationConfig Configuration for video classification task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.
object_detection_config	ObjectDetectionConfig Configuration for video object detection task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.
object_tracking_config	ObjectTrackingConfig Configuration for video object tracking task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.
event_config	EventConfig Configuration for video event task. One of video_classification_config, object_detection_config, object_tracking_config and event_config is required.

Feature

Video labeling task feature.

Enums
FEATURE_UNSPECIFIED
CLASSIFICATION	Label whole video or video segment with one or more labels.
OBJECT_DETECTION	Label objects with bounding box on image frames extracted from the video.
OBJECT_TRACKING	Label and track objects in video.
EVENT	Label the range of video for the specified events.

ListAnnotatedDatasetsRequest

Request message for ListAnnotatedDatasets.

Fields
parent	string Required. Name of the dataset to list annotated datasets, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.annotateddatasets.list
filter	string Optional. Filter is not supported at this moment.
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by ListAnnotatedDatasetsResponse.next_page_token of the previous [DataLabelingService.ListAnnotatedDatasets] call. Return first page if empty.

ListAnnotatedDatasetsResponse

Results of listing annotated datasets for a dataset.

Fields
annotated_datasets[]	AnnotatedDataset The list of annotated datasets to return.
next_page_token	string A token to retrieve next page of results.

ListAnnotationSpecSetsRequest

Request message for ListAnnotationSpecSets.

Fields
parent	string Required. Parent of AnnotationSpecSet resource, format: projects/{project_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.annotationspecsets.list
filter	string Optional. Filter is not supported at this moment.
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by ListAnnotationSpecSetsResponse.next_page_token of the previous [DataLabelingService.ListAnnotationSpecSets] call. Return first page if empty.

ListAnnotationSpecSetsResponse

Results of listing annotation spec set under a project.

Fields
annotation_spec_sets[]	AnnotationSpecSet The list of annotation spec sets.
next_page_token	string A token to retrieve next page of results.

ListDataItemsRequest

Request message for ListDataItems.

Fields
parent	string Required. Name of the dataset to list data items, format: projects/{project_id}/datasets/{dataset_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.dataitems.list
filter	string Optional. Filter is not supported at this moment.
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by ListDataItemsResponse.next_page_token of the previous [DataLabelingService.ListDataItems] call. Return first page if empty.

ListDataItemsResponse

Results of listing data items in a dataset.

Fields
data_items[]	DataItem The list of data items to return.
next_page_token	string A token to retrieve next page of results.

ListDatasetsRequest

Request message for ListDataset.

Fields
parent	string Required. Dataset resource parent, format: projects/{project_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.datasets.list
filter	string Optional. Filter on dataset is not supported at this moment.
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by ListDatasetsResponse.next_page_token of the previous [DataLabelingService.ListDatasets] call. Returns the first page if empty.

ListDatasetsResponse

Results of listing datasets within a project.

Fields
datasets[]	Dataset The list of datasets to return.
next_page_token	string A token to retrieve next page of results.

ListEvaluationJobsRequest

Request message for ListEvaluationJobs.

Fields
parent	string Required. Evaluation job resource parent. Format: "projects/{project_id}" Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.evaluationjobs.list
filter	string Optional. You can filter the jobs to list by model_id (also known as model_name, as described in EvaluationJob.modelVersion) or by evaluation job state (as described in EvaluationJob.state). To filter by both criteria, use the AND operator or the OR operator. For example, you can use the following string for your filter: "evaluation_job.model_id = {model_name} AND evaluation_job.state = {evaluation_job_state}"
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by the nextPageToken in the response to the previous request. The request returns the first page if this is empty.

ListEvaluationJobsResponse

Results for listing evaluation jobs.

Fields
evaluation_jobs[]	EvaluationJob The list of evaluation jobs to return.
next_page_token	string A token to retrieve next page of results.

ListExamplesRequest

Request message for ListExamples.

Fields
parent	string Required. Example resource parent. Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.examples.list
filter	string Optional. An expression for filtering Examples. For annotated datasets that have annotation spec set, filter by annotation_spec.display_name is supported. Format "annotation_spec.display_name = {display_name}"
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by ListExamplesResponse.next_page_token of the previous [DataLabelingService.ListExamples] call. Return first page if empty.

ListExamplesResponse

Results of listing Examples in and annotated dataset.

Fields
examples[]	Example The list of examples to return.
next_page_token	string A token to retrieve next page of results.

ListFeedbackMessagesRequest

Request message for ListFeedbackMessages.

Fields
parent	string Required. FeedbackMessage resource parent. Format: "projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}/feedbackThreads/{feedback_thread_id}" Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.feedbackMessages.list
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by [ListFeedbackMessages.next_page_token][] of the previous [DataLabelingService.ListFeedbackMessages] call. Return first page if empty.

ListFeedbackMessagesResponse

Results for listing FeedbackMessages.

Fields
feedback_messages[]	FeedbackMessage The list of feedback messages to return.
next_page_token	string A token to retrieve next page of results.

ListFeedbackThreadsRequest

Request message for ListFeedbackThreads.

Fields
parent	string Required. FeedbackThread resource parent. Format: "projects/{project_id}/datasets/{dataset_id}/annotatedDatasets/{annotated_dataset_id}" Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.feedbackThreads.list
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by [ListFeedbackThreads.next_page_token][] of the previous [DataLabelingService.ListFeedbackThreads] call. Return first page if empty.

ListFeedbackThreadsResponse

Results for listing FeedbackThreads.

Fields
feedback_threads[]	FeedbackThread The list of feedback threads to return.
next_page_token	string A token to retrieve next page of results.

ListInstructionsRequest

Request message for ListInstructions.

Fields
parent	string Required. Instruction resource parent, format: projects/{project_id} Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.instructions.list
filter	string Optional. Filter is not supported at this moment.
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by ListInstructionsResponse.next_page_token of the previous [DataLabelingService.ListInstructions] call. Return first page if empty.

ListInstructionsResponse

Results of listing instructions under a project.

Fields
instructions[]	Instruction The list of Instructions to return.
next_page_token	string A token to retrieve next page of results.

NormalizedBoundingPoly

Normalized bounding polygon.

Fields
normalized_vertices[]	NormalizedVertex The bounding polygon normalized vertices.

NormalizedPolyline

Normalized polyline.

Fields
normalized_vertices[]	NormalizedVertex The normalized polyline vertices.

NormalizedVertex

A vertex represents a 2D point in the image. NOTE: the normalized vertex coordinates are relative to the original image and range from 0 to 1.

Fields
x	float X coordinate.
y	float Y coordinate.

ObjectDetectionConfig

Config for video object detection human labeling task. Object detection will be conducted on the images extracted from the video, and those objects will be labeled with bounding boxes. User need to specify the number of images to be extracted per second as the extraction frame rate.

Fields
annotation_spec_set	string Required. Annotation spec set resource name.
extraction_frame_rate	double Required. Number of frames per second to be extracted from the video.

ObjectDetectionMetrics

Metrics calculated for an image object detection (bounding box) model.

Fields
pr_curve	PrCurve Precision-recall curve.

ObjectTrackingConfig

Config for video object tracking human labeling task.

Fields
annotation_spec_set	string Required. Annotation spec set resource name.

ObjectTrackingFrame

Video frame level annotation for object detection and tracking.

Fields
time_offset	Duration The time offset of this frame relative to the beginning of the video.
Union field bounded_area. The bounding box location of this object track for the frame. bounded_area can be only one of the following:
bounding_poly	BoundingPoly
normalized_bounding_poly	NormalizedBoundingPoly

OperatorFeedbackMetadata

Metadata describing the feedback from the operator.

OperatorMetadata

General information useful for labels coming from contributors.

Fields
score	float Confidence score corresponding to a label. For examle, if 3 contributors have answered the question and 2 of them agree on the final label, the confidence score will be 0.67 (2/3).
total_votes	int32 The total number of contributors that answer this question.
label_votes	int32 The total number of contributors that choose this label.
comments[]	string Comments from contributors.

OutputConfig

The configuration of output data.

Fields
Union field destination. Required. Location to output data to. destination can be only one of the following:
gcs_destination	GcsDestination Output to a file in Cloud Storage. Should be used for labeling output other than image segmentation.
gcs_folder_destination	GcsFolderDestination Output to a folder in Cloud Storage. Should be used for image segmentation labeling output.

PauseEvaluationJobRequest

Request message for PauseEvaluationJob.

Fields
name	string Required. Name of the evaluation job that is going to be paused. Format: "projects/{project_id}/evaluationJobs/{evaluation_job_id}" Authorization requires the following Google IAM permission on the specified resource name: datalabeling.evaluationjobs.pause

PdfInstruction

Instruction from a PDF file.

Fields
gcs_file_uri	string PDF file for the instruction. Only gcs path is allowed.

Polyline

A line with multiple line segments.

Fields
vertices[]	Vertex The polyline vertices.

PolylineConfig

Config for image polyline human labeling task.

Fields
annotation_spec_set	string Required. Annotation spec set resource name.
instruction_message	string Optional. Instruction message showed on contributors UI.

PrCurve

Fields
annotation_spec	AnnotationSpec The annotation spec of the label for which the precision-recall curve calculated. If this field is empty, that means the precision-recall curve is an aggregate curve for all labels.
area_under_curve	float Area under the precision-recall curve. Not to be confused with area under a receiver operating characteristic (ROC) curve.
confidence_metrics_entries[]	ConfidenceMetricsEntry Entries that make up the precision-recall graph. Each entry is a "point" on the graph drawn for a different confidence_threshold.
mean_average_precision	float Mean average prcision of this curve.

ConfidenceMetricsEntry

Fields
confidence_threshold	float Threshold used for this entry. For classification tasks, this is a classification threshold: a predicted label is categorized as positive or negative (in the context of this point on the PR curve) based on whether the label's score meets this threshold. For image object detection (bounding box) tasks, this is the [intersection-over-union (IOU)](/vision/automl/object-detection/docs/evaluate#intersection-over-union) threshold for the context of this point on the PR curve.
recall	float Recall value.
precision	float Precision value.
f1_score	float Harmonic mean of recall and precision.
recall_at1	float Recall value for entries with label that has highest score.
precision_at1	float Precision value for entries with label that has highest score.
f1_score_at1	float The harmonic mean of recall_at1 and precision_at1.
recall_at5	float Recall value for entries with label that has highest 5 scores.
precision_at5	float Precision value for entries with label that has highest 5 scores.
f1_score_at5	float The harmonic mean of recall_at5 and precision_at5.

RequesterFeedbackMetadata

Metadata describing the feedback from the labeling task requester.

ResumeEvaluationJobRequest

Request message ResumeEvaluationJob.

Fields
name	string Required. Name of the evaluation job that is going to be resumed. Format: "projects/{project_id}/evaluationJobs/{evaluation_job_id}" Authorization requires the following Google IAM permission on the specified resource name: datalabeling.evaluationjobs.resume

SearchEvaluationsRequest

Request message for SearchEvaluation.

Fields
parent	string Required. Evaluation search parent (project ID). Format: "projects/{project_id}" Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.evaluations.list
filter	string Optional. To search evaluations, you can filter by the following: evaluation_job.evaluation_job_id (the last part of EvaluationJob.name) evaluation_job.model_id (the {model_name} portion of EvaluationJob.modelVersion) evaluation_job.evaluation_job_run_time_start (Minimum threshold for the evaluationJobRunTime that created the evaluation) evaluation_job.evaluation_job_run_time_end (Maximum threshold for the evaluationJobRunTime that created the evaluation) evaluation_job.job_state (EvaluationJob.state) annotation_spec.display_name (the Evaluation contains a metric for the annotation spec with this displayName) To filter by multiple critiera, use the AND operator or the OR operator. The following examples shows a string that filters by several critiera: "evaluation_job.evaluation_job_id = {evaluation_job_id} AND evaluation_job.model_id = {model_name} AND evaluation_job.evaluation_job_run_time_start = {timestamp_1} AND evaluation_job.evaluation_job_run_time_end = {timestamp_2} AND annotation_spec.display_name = {display_name}"
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by the nextPageToken of the response to a previous search request. If you don't specify this field, the API call requests the first page of the search.

SearchEvaluationsResponse

Results of searching evaluations.

Fields
evaluations[]	Evaluation The list of evaluations matching the search.
next_page_token	string A token to retrieve next page of results.

SearchExampleComparisonsRequest

Request message of SearchExampleComparisons.

Fields
parent	string Required. Name of the Evaluation resource to search for example comparisons from. Format: "projects/{project_id}/datasets/{dataset_id}/evaluations/{evaluation_id}" Authorization requires the following Google IAM permission on the specified resource parent: datalabeling.examplecomparisons.list
page_size	int32 Optional. Requested page size. Server may return fewer results than requested. Default value is 100.
page_token	string Optional. A token identifying a page of results for the server to return. Typically obtained by the [nextPageToken][SearchExampleComparisons.next_page_token] of the response to a previous search rquest. If you don't specify this field, the API call requests the first page of the search.

SearchExampleComparisonsResponse

Results of searching example comparisons.

Fields
example_comparisons[]	ExampleComparison A list of example comparisons matching the search criteria.
next_page_token	string A token to retrieve next page of results.

ExampleComparison

Example comparisons comparing ground truth output and predictions for a specific input.

Fields
ground_truth_example	Example The ground truth output for the input.
model_created_examples[]	Example Predictions by the model for the input.

SegmentationConfig

Config for image segmentation

Fields
annotation_spec_set	string Required. Annotation spec set resource name. format: projects/{project_id}/annotationSpecSets/{annotation_spec_set_id}
instruction_message	string Instruction message showed on labelers UI.

SentimentConfig

Config for setting up sentiments.

Fields
enable_label_sentiment_selection	bool If set to true, contributors will have the option to select sentiment of the label they selected, to mark it as negative or positive label. Default is false.

SequentialSegment

Start and end position in a sequence (e.g. text segment).

Fields
start	int32 Start position (inclusive).
end	int32 End position (exclusive).

StringAggregationType

Enums
STRING_AGGREGATION_TYPE_UNSPECIFIED
MAJORITY_VOTE	Majority vote to aggregate answers.
UNANIMOUS_VOTE	Unanimous answers will be adopted.
NO_AGGREGATION	Preserve all answers by crowd compute.

TextClassificationAnnotation

Text classification annotation.

Fields
annotation_spec	AnnotationSpec Label of the text.

TextClassificationConfig

Config for text classification human labeling task.

Fields
allow_multi_label	bool Optional. If allow_multi_label is true, contributors are able to choose multiple labels for one text segment.
annotation_spec_set	string Required. Annotation spec set resource name.
sentiment_config	SentimentConfig Optional. Configs for sentiment selection.

TextEntityExtractionAnnotation

Text entity extraction annotation.

Fields
annotation_spec	AnnotationSpec Label of the text entities.
sequential_segment	SequentialSegment Position of the entity.

TextEntityExtractionConfig

Config for text entity extraction human labeling task.

Fields
annotation_spec_set	string Required. Annotation spec set resource name.

TextMetadata

Metadata for the text.

Fields
language_code	string The language of this text, as a BCP-47. Default value is en-US.

TextPayload

Container of information about a piece of text.

Fields
text_content	string Text content.

TimeSegment

A time period inside of an example that has a time dimension (e.g. video).

Fields
start_time_offset	Duration Start of the time segment (inclusive), represented as the duration since the example start.
end_time_offset	Duration End of the time segment (exclusive), represented as the duration since the example start.

UpdateEvaluationJobRequest

Request message for UpdateEvaluationJob.

Fields
evaluation_job	EvaluationJob Required. Evaluation job that is going to be updated. Authorization requires the following Google IAM permission on the specified resource evaluationJob: datalabeling.evaluationjobs.update
update_mask	FieldMask Optional. Mask for which fields to update. You can only provide the following fields: evaluationJobConfig.humanAnnotationConfig.instruction evaluationJobConfig.exampleCount evaluationJobConfig.exampleSamplePercentage You can provide more than one of these fields by separating them with commas.

Vertex

A vertex represents a 2D point in the image. NOTE: the vertex coordinates are in the same scale as the original image.

Fields
x	int32 X coordinate.
y	int32 Y coordinate.

VideoClassificationAnnotation

Video classification annotation.

Fields
time_segment	TimeSegment The time segment of the video to which the annotation applies.
annotation_spec	AnnotationSpec Label of the segment specified by time_segment.

VideoClassificationConfig

Config for video classification human labeling task. Currently two types of video classification are supported: 1. Assign labels on the entire video. 2. Split the video into multiple video clips based on camera shot, and assign labels on each video clip.

Fields
annotation_spec_set_configs[]	AnnotationSpecSetConfig Required. The list of annotation spec set configs. Since watching a video clip takes much longer time than an image, we support label with multiple AnnotationSpecSet at the same time. Labels in each AnnotationSpecSet will be shown in a group to contributors. Contributors can select one or more (depending on whether to allow multi label) from each group.
apply_shot_detection	bool Optional. Option to apply shot detection on the video.

AnnotationSpecSetConfig

Annotation spec set with the setting of allowing multi labels or not.

Fields
annotation_spec_set	string Required. Annotation spec set resource name.
allow_multi_label	bool Optional. If allow_multi_label is true, contributors are able to choose multiple labels from one annotation spec set.

VideoEventAnnotation

Video event annotation.

Fields
annotation_spec	AnnotationSpec Label of the event in this annotation.
time_segment	TimeSegment The time segment of the video to which the annotation applies.

VideoObjectTrackingAnnotation

Video object tracking annotation.

Fields
annotation_spec	AnnotationSpec Label of the object tracked in this annotation.
time_segment	TimeSegment The time segment of the video to which object tracking applies.
object_tracking_frames[]	ObjectTrackingFrame The list of frames where this object track appears.

VideoPayload

Container of information of a video.

Fields
mime_type	string Video format.
video_uri	string Video uri from the user bucket.
video_thumbnails[]	VideoThumbnail The list of video thumbnails.
frame_rate	float FPS of the video.
signed_uri	string Signed uri of the video file in the service bucket.

VideoThumbnail

Container of information of a video thumbnail.

Fields
thumbnail	bytes A byte string of the video frame.
time_offset	Duration Time offset relative to the beginning of the video, corresponding to the video frame where the thumbnail has been extracted from.