API documentation for speech_v1.types
module.
Classes
Any
API documentation for speech_v1.types.Any
class.
CancelOperationRequest
API documentation for speech_v1.types.CancelOperationRequest
class.
DeleteOperationRequest
API documentation for speech_v1.types.DeleteOperationRequest
class.
Duration
API documentation for speech_v1.types.Duration
class.
GetOperationRequest
API documentation for speech_v1.types.GetOperationRequest
class.
ListOperationsRequest
API documentation for speech_v1.types.ListOperationsRequest
class.
ListOperationsResponse
API documentation for speech_v1.types.ListOperationsResponse
class.
LongRunningRecognizeMetadata
Describes the progress of a long-running
LongRunningRecognize
call. It is included in the metadata
field
of the Operation
returned by the GetOperation
call of the
google::longrunning::Operations
service.
Time when the request was received.
LongRunningRecognizeRequest
The top-level message sent by the client for the
LongRunningRecognize
method.
Required. The audio data to be recognized.
LongRunningRecognizeResponse
The only message returned to the client by the
LongRunningRecognize
method. It contains the result as zero or more
sequential SpeechRecognitionResult
messages. It is included in the
result.response
field of the Operation
returned by the
GetOperation
call of the google::longrunning::Operations
service.
Operation
API documentation for speech_v1.types.Operation
class.
OperationInfo
API documentation for speech_v1.types.OperationInfo
class.
RecognitionAudio
Contains audio data in the encoding specified in the
RecognitionConfig
. Either content
or uri
must be supplied.
Supplying both or neither returns
[google.rpc.Code.INVALID_ARGUMENT][google.rpc.Code.INVALID_ARGUMENT].
See content
limits <https://cloud.google.com/speech-to-text/quotas#content>
__.
The audio data bytes encoded as specified in
RecognitionConfig
. Note: as with all bytes fields, proto
buffers use a pure binary representation, whereas JSON
representations use base64.
RecognitionConfig
Provides information to the recognizer that specifies how to process the request.
Sample rate in Hertz of the audio data sent in all
RecognitionAudio
messages. Valid values are: 8000-48000.
16000 is optimal. For best results, set the sampling rate of
the audio source to 16000 Hz. If that's not possible, use the
native sample rate of the audio source (instead of re-
sampling). This field is optional for FLAC and WAV audio
files, but is required for all other audio formats. For
details, see [AudioEncoding][google.cloud.speech.v1.Recognitio
nConfig.AudioEncoding].
This needs to be set to true
explicitly and
audio_channel_count
> 1 to get each channel recognized
separately. The recognition result will contain a
channel_tag
field to state which channel that result
belongs to. If this is not true, we will only recognize the
first channel. The request is billed cumulatively for all
channels recognized: audio_channel_count
multiplied by the
length of the audio.
Maximum number of recognition hypotheses to be returned.
Specifically, the maximum number of
SpeechRecognitionAlternative
messages within each
SpeechRecognitionResult
. The server may return fewer than
max_alternatives
. Valid values are 0
-30
. A value
of 0
or 1
will return a maximum of one. If omitted,
will return a maximum of one.
Array of
SpeechContext. A means
to provide context to assist the speech recognition. For more
information, see speech adaptation
<https://cloud.google.com/speech-to-text/docs/context-
strength>
__.
If 'true', adds punctuation to recognition result hypotheses. This feature is only available in select languages. Setting this for requests in other languages has no effect at all. The default 'false' value does not add punctuation to result hypotheses. Note: This is currently offered as an experimental service, complimentary to all users. In the future this may be exclusively available as a premium feature.
Metadata regarding this request.
Set to true to use an enhanced model for speech recognition.
If use_enhanced
is set to true and the model
field is
not set, then an appropriate enhanced model is chosen if an
enhanced model exists for the audio. If use_enhanced
is
true and an enhanced version of the specified model does not
exist, then the speech is recognized using the standard
version of the specified model.
RecognitionMetadata
Description of audio data to be recognized.
The industry vertical to which this speech recognition request most closely applies. This is most indicative of the topics contained in the audio. Use the 6-digit NAICS code to identify the industry vertical - see https://www.naics.com/search/.
The original media the speech was recorded on.
The device used to make the recording. Examples 'Nexus 5X' or 'Polycom SoundStation IP 6000' or 'POTS' or 'VoIP' or 'Cardioid Microphone'.
Description of the content. Eg. "Recordings of federal supreme court hearings from 2012".
RecognizeRequest
The top-level message sent by the client for the
Recognize
method.
Required. The audio data to be recognized.
RecognizeResponse
The only message returned to the client by the
Recognize
method. It contains the result as zero or more sequential
SpeechRecognitionResult
messages.
SpeakerDiarizationConfig
Config to enable speaker diarization.
Minimum number of speakers in the conversation. This range gives you more flexibility by allowing the system to automatically determine the correct number of speakers. If not set, the default value is 2.
Unused.
SpeechContext
Provides "hints" to the speech recognizer to favor specific words and phrases in the results.
SpeechRecognitionAlternative
Alternative hypotheses (a.k.a. n-best list).
The confidence estimate between 0.0 and 1.0. A higher number
indicates an estimated greater likelihood that the recognized
words are correct. This field is set only for the top
alternative of a non-streaming result or, of a streaming
result where is_final=true
. This field is not guaranteed
to be accurate and users should not rely on it to be always
provided. The default of 0.0 is a sentinel value indicating
confidence
was not set.
SpeechRecognitionResult
A speech recognition result corresponding to a portion of the audio.
For multi-channel audio, this is the channel number corresponding to the recognized result for the audio from that channel. For audio_channel_count = N, its output values can range from '1' to 'N'.
Status
API documentation for speech_v1.types.Status
class.
StreamingRecognitionConfig
Provides information to the recognizer that specifies how to process the request.
If false
or omitted, the recognizer will perform
continuous recognition (continuing to wait for and process
audio even if the user pauses speaking) until the client
closes the input stream (gRPC API) or until the maximum time
limit has been reached. May return multiple
StreamingRecognitionResult
\ s with the is_final
flag
set to true
. If true
, the recognizer will detect a
single spoken utterance. When it detects that the user has
paused or stopped speaking, it will return an
END_OF_SINGLE_UTTERANCE
event and cease recognition. It
will return no more than one StreamingRecognitionResult
with the is_final
flag set to true
.
StreamingRecognitionResult
A streaming speech recognition result corresponding to a portion of the audio that is currently being processed.
If false
, this StreamingRecognitionResult
represents
an interim result that may change. If true
, this is the
final time the speech service will return this particular
StreamingRecognitionResult
, the recognizer will not return
any further hypotheses for this portion of the transcript and
corresponding audio.
Time offset of the end of this result relative to the beginning of the audio.
The BCP-47 <https://www.rfc-editor.org/rfc/bcp/bcp47.txt>
__
language tag of the language in this result. This language
code was detected to have the most likelihood of being spoken
in the audio.
StreamingRecognizeRequest
The top-level message sent by the client for the StreamingRecognize
method. Multiple StreamingRecognizeRequest
messages are sent. The
first message must contain a streaming_config
message and must not
contain audio_content
. All subsequent messages must contain
audio_content
and must not contain a streaming_config
message.
Provides information to the recognizer that specifies how to
process the request. The first StreamingRecognizeRequest
message must contain a streaming_config
message.
StreamingRecognizeResponse
\ StreamingRecognizeResponse
is the only message
returned to the client by StreamingRecognize
. A series of zero or
more StreamingRecognizeResponse
messages are streamed back to the
client. If there is no recognizable audio, and single_utterance
is
set to false, then no messages are streamed back to the client.
Here's an example of a series of ten StreamingRecognizeResponse
\ s
that might be returned while processing audio:
results { alternatives { transcript: "tube" } stability: 0.01 }
results { alternatives { transcript: "to be a" } stability: 0.01 }
results { alternatives { transcript: "to be" } stability: 0.9 } results { alternatives { transcript: " or not to be" } stability: 0.01 }
results { alternatives { transcript: "to be or not to be" confidence: 0.92 } alternatives { transcript: "to bee or not to bee" } is_final: true }
results { alternatives { transcript: " that's" } stability: 0.01 }
results { alternatives { transcript: " that is" } stability: 0.9 } results { alternatives { transcript: " the question" } stability: 0.01 }
results { alternatives { transcript: " that is the question" confidence: 0.98 } alternatives { transcript: " that was the question" } is_final: true }
Notes:
Only two of the above responses #4 and #7 contain final results; they are indicated by
is_final: true
. Concatenating these together generates the full transcript: "to be or not to be that is the question".The others contain interim
results
. #3 and #6 contain two interimresults
: the first portion has a high stability and is less likely to change; the second portion has a low stability and is very likely to change. A UI designer might choose to show only high stabilityresults
.The specific
stability
andconfidence
values shown above are only for illustrative purposes. Actual values may vary.In each response, only one of these fields will be set:
error
,speech_event_type
, or one or more (repeated)results
.This repeated list contains zero or more results that correspond to consecutive portions of the audio currently being processed. It contains zero or one
is_final=true
result (the newly settled portion), followed by zero or moreis_final=false
results (the interim results).
Timestamp
API documentation for speech_v1.types.Timestamp
class.
WaitOperationRequest
API documentation for speech_v1.types.WaitOperationRequest
class.
WordInfo
Word-specific information for recognized words.
Time offset relative to the beginning of the audio, and
corresponding to the end of the spoken word. This field is
only set if enable_word_time_offsets=true
and only in the
top hypothesis. This is an experimental feature and the
accuracy of the time offset can vary.
A distinct integer value is assigned for every speaker within the audio. This field specifies which one of those speakers was detected to have spoken this word. Value ranges from '1' to diarization_speaker_count. speaker_tag is set if enable_speaker_diarization = 'true' and only in the top alternative.