API documentation for videointelligence_v1p3beta1.types
package.
Classes
AnnotateVideoProgress
Video annotation progress. Included in the metadata
field of the
Operation
returned by the GetOperation
call of the
google::longrunning::Operations
service.
AnnotateVideoRequest
Video annotation request.
AnnotateVideoResponse
Video annotation response. Included in the response
field of the
Operation
returned by the GetOperation
call of the
google::longrunning::Operations
service.
Celebrity
Celebrity definition.
CelebrityRecognitionAnnotation
Celebrity recognition annotation per video.
CelebrityTrack
The annotation result of a celebrity face track. RecognizedCelebrity field could be empty if the face track does not have any matched celebrities.
DetectedAttribute
A generic detected attribute represented by name in string format.
DetectedLandmark
A generic detected landmark represented by name in string format and a 2D location.
Entity
Detected entity from video analysis.
ExplicitContentAnnotation
Explicit content annotation (based on per-frame visual signals only). If no explicit content has been detected in a frame, no annotations are present for that frame.
ExplicitContentDetectionConfig
Config for EXPLICIT_CONTENT_DETECTION.
ExplicitContentFrame
Video frame level annotation results for explicit content.
FaceDetectionAnnotation
Face detection annotation.
FaceDetectionConfig
Config for FACE_DETECTION.
Feature
Video annotation feature.
Values: FEATURE_UNSPECIFIED (0): Unspecified. LABEL_DETECTION (1): Label detection. Detect objects, such as dog or flower. SHOT_CHANGE_DETECTION (2): Shot change detection. EXPLICIT_CONTENT_DETECTION (3): Explicit content detection. FACE_DETECTION (4): Human face detection. SPEECH_TRANSCRIPTION (6): Speech transcription. TEXT_DETECTION (7): OCR text detection and tracking. OBJECT_TRACKING (9): Object detection and tracking. LOGO_RECOGNITION (12): Logo detection, tracking, and recognition. CELEBRITY_RECOGNITION (13): Celebrity recognition. PERSON_DETECTION (14): Person detection.
LabelAnnotation
Label annotation.
LabelDetectionConfig
Config for LABEL_DETECTION.
LabelDetectionMode
Label detection mode.
Values: LABEL_DETECTION_MODE_UNSPECIFIED (0): Unspecified. SHOT_MODE (1): Detect shot-level labels. FRAME_MODE (2): Detect frame-level labels. SHOT_AND_FRAME_MODE (3): Detect both shot-level and frame-level labels.
LabelFrame
Video frame level annotation results for label detection.
LabelSegment
Video segment level annotation results for label detection.
Likelihood
Bucketized representation of likelihood.
Values: LIKELIHOOD_UNSPECIFIED (0): Unspecified likelihood. VERY_UNLIKELY (1): Very unlikely. UNLIKELY (2): Unlikely. POSSIBLE (3): Possible. LIKELY (4): Likely. VERY_LIKELY (5): Very likely.
LogoRecognitionAnnotation
Annotation corresponding to one detected, tracked and recognized logo class.
NormalizedBoundingBox
Normalized bounding box. The normalized vertex coordinates are relative to the original image. Range: [0, 1].
NormalizedBoundingPoly
Normalized bounding polygon for text (that might not be aligned with axis). Contains list of the corner points in clockwise order starting from top-left corner. For example, for a rectangular bounding box: When the text is horizontal it might look like: 0----1 | | 3----2
When it's clockwise rotated 180 degrees around the top-left corner it becomes: 2----3 | | 1----0
and the vertex order will still be (0, 1, 2, 3). Note that values can be less than 0, or greater than 1 due to trignometric calculations for location of the box.
NormalizedVertex
A vertex represents a 2D point in the image. NOTE: the normalized vertex coordinates are relative to the original image and range from 0 to 1.
ObjectTrackingAnnotation
Annotations corresponding to one tracked object.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
ObjectTrackingConfig
Config for OBJECT_TRACKING.
ObjectTrackingFrame
Video frame level annotations for object detection and tracking. This field stores per frame location, time offset, and confidence.
PersonDetectionAnnotation
Person detection annotation per video.
PersonDetectionConfig
Config for PERSON_DETECTION.
ShotChangeDetectionConfig
Config for SHOT_CHANGE_DETECTION.
SpeechContext
Provides "hints" to the speech recognizer to favor specific words and phrases in the results.
SpeechRecognitionAlternative
Alternative hypotheses (a.k.a. n-best list).
SpeechTranscription
A speech recognition result corresponding to a portion of the audio.
SpeechTranscriptionConfig
Config for SPEECH_TRANSCRIPTION.
StreamingAnnotateVideoRequest
The top-level message sent by the client for the
StreamingAnnotateVideo
method. Multiple
StreamingAnnotateVideoRequest
messages are sent. The first
message must only contain a StreamingVideoConfig
message. All
subsequent messages must only contain input_content
data.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
StreamingAnnotateVideoResponse
StreamingAnnotateVideoResponse
is the only message returned to
the client by StreamingAnnotateVideo
. A series of zero or more
StreamingAnnotateVideoResponse
messages are streamed back to the
client.
StreamingAutomlActionRecognitionConfig
Config for STREAMING_AUTOML_ACTION_RECOGNITION.
StreamingAutomlClassificationConfig
Config for STREAMING_AUTOML_CLASSIFICATION.
StreamingAutomlObjectTrackingConfig
Config for STREAMING_AUTOML_OBJECT_TRACKING.
StreamingExplicitContentDetectionConfig
Config for STREAMING_EXPLICIT_CONTENT_DETECTION.
StreamingFeature
Streaming video annotation feature.
Values: STREAMING_FEATURE_UNSPECIFIED (0): Unspecified. STREAMING_LABEL_DETECTION (1): Label detection. Detect objects, such as dog or flower. STREAMING_SHOT_CHANGE_DETECTION (2): Shot change detection. STREAMING_EXPLICIT_CONTENT_DETECTION (3): Explicit content detection. STREAMING_OBJECT_TRACKING (4): Object detection and tracking. STREAMING_AUTOML_ACTION_RECOGNITION (23): Action recognition based on AutoML model. STREAMING_AUTOML_CLASSIFICATION (21): Video classification based on AutoML model. STREAMING_AUTOML_OBJECT_TRACKING (22): Object detection and tracking based on AutoML model.
StreamingLabelDetectionConfig
Config for STREAMING_LABEL_DETECTION.
StreamingObjectTrackingConfig
Config for STREAMING_OBJECT_TRACKING.
StreamingShotChangeDetectionConfig
Config for STREAMING_SHOT_CHANGE_DETECTION.
StreamingStorageConfig
Config for streaming storage option.
StreamingVideoAnnotationResults
Streaming annotation results corresponding to a portion of the video that is currently being processed.
StreamingVideoConfig
Provides information to the annotator that specifies how to process the request.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
TextAnnotation
Annotations related to one detected OCR text snippet. This will contain the corresponding text, confidence value, and frame level information for each detection.
TextDetectionConfig
Config for TEXT_DETECTION.
TextFrame
Video frame level annotation results for text annotation (OCR). Contains information regarding timestamp and bounding box locations for the frames containing detected OCR text snippets.
TextSegment
Video segment level annotation results for text detection.
TimestampedObject
For tracking related features. An object at time_offset with attributes, and located with normalized_bounding_box.
Track
A track of an object instance.
VideoAnnotationProgress
Annotation progress for a single video.
VideoAnnotationResults
Annotation results for a single video.
VideoContext
Video context and/or feature-specific parameters.
VideoSegment
Video segment.
WordInfo
Word-specific information for recognized words. Word information is
only included in the response when certain request parameters are
set, such as enable_word_time_offsets
.