Class GenerationConfig (1.93.0)

Version latest

• 1.93.0 (latest)
• 1.92.0
• 1.91.0
• 1.90.0
• 1.89.0
• 1.88.0
• 1.87.0
• 1.86.0
• 1.85.0
• 1.84.0
• 1.83.0
• 1.82.0
• 1.81.0
• 1.80.0
• 1.79.0
• 1.78.0
• 1.77.0
• 1.76.0
• 1.75.0
• 1.74.0
• 1.73.0
• 1.72.0
• 1.71.1
• 1.70.0
• 1.69.0
• 1.68.0
• 1.67.1
• 1.66.0
• 1.65.0
• 1.63.0
• 1.62.0
• 1.60.0
• 1.59.0
• 1.58.0
• 1.57.0
• 1.56.0
• 1.55.0
• 1.54.1
• 1.53.0
• 1.52.0
• 1.51.0
• 1.50.0
• 1.49.0
• 1.48.0
• 1.47.0
• 1.46.0
• 1.45.0
• 1.44.0
• 1.43.0
• 1.39.0
• 1.38.1
• 1.37.0
• 1.36.4
• 1.35.0
• 1.34.0
• 1.33.1
• 1.32.0
• 1.31.1
• 1.30.1
• 1.29.0
• 1.28.1
• 1.27.1
• 1.26.1
• 1.25.0
• 1.24.1
• 1.23.0
• 1.22.1
• 1.21.0
• 1.20.0
• 1.19.1
• 1.18.3
• 1.17.1
• 1.16.1
• 1.15.1
• 1.14.0
• 1.13.1
• 1.12.1
• 1.11.0
• 1.10.0
• 1.9.0
• 1.8.1
• 1.7.1
• 1.6.2
• 1.5.0
• 1.4.3
• 1.3.0
• 1.2.0
• 1.1.1
• 1.0.1
• 0.9.0
• 0.8.0
• 0.7.1
• 0.6.0
• 0.5.1
• 0.4.0
• 0.3.1

GenerationConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Generation config.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes
Name	Description
temperature	float Optional. Controls the randomness of predictions. This field is a member of oneof_ _temperature.
top_p	float Optional. If specified, nucleus sampling will be used. This field is a member of oneof_ _top_p.
top_k	float Optional. If specified, top-k sampling will be used. This field is a member of oneof_ _top_k.
candidate_count	int Optional. Number of candidates to generate. This field is a member of oneof_ _candidate_count.
max_output_tokens	int Optional. The maximum number of output tokens to generate per message. This field is a member of oneof_ _max_output_tokens.
stop_sequences	MutableSequence[str] Optional. Stop sequences.
response_logprobs	bool Optional. If true, export the logprobs results in response. This field is a member of oneof_ _response_logprobs.
logprobs	int Optional. Logit probabilities. This field is a member of oneof_ _logprobs.
presence_penalty	float Optional. Positive penalties. This field is a member of oneof_ _presence_penalty.
frequency_penalty	float Optional. Frequency penalties. This field is a member of oneof_ _frequency_penalty.
seed	int Optional. Seed. This field is a member of oneof_ _seed.
response_mime_type	str Optional. Output response mimetype of the generated candidate text. Supported mimetype: - text/plain: (default) Text output. - application/json: JSON response in the candidates. The model needs to be prompted to output the appropriate response type, otherwise the behavior is undefined. This is a preview feature.
response_schema	google.cloud.aiplatform_v1beta1.types.Schema Optional. The Schema object allows the definition of input and output data types. These types can be objects, but also primitives and arrays. Represents a select subset of an `OpenAPI 3.0 schema object
routing_config	google.cloud.aiplatform_v1beta1.types.GenerationConfig.RoutingConfig Optional. Routing configuration. This field is a member of oneof_ _routing_config.
audio_timestamp	bool Optional. If enabled, audio timestamp will be included in the request to the model. This field is a member of oneof_ _audio_timestamp.
response_modalities	MutableSequence[google.cloud.aiplatform_v1beta1.types.GenerationConfig.Modality] Optional. The modalities of the response.
media_resolution	google.cloud.aiplatform_v1beta1.types.GenerationConfig.MediaResolution Optional. If specified, the media resolution specified will be used. This field is a member of oneof_ _media_resolution.
speech_config	google.cloud.aiplatform_v1beta1.types.SpeechConfig Optional. The speech generation config. This field is a member of oneof_ _speech_config.
thinking_config	google.cloud.aiplatform_v1beta1.types.GenerationConfig.ThinkingConfig Optional. Config for thinking features. An error will be returned if this field is set for models that don't support thinking.
model_config	google.cloud.aiplatform_v1beta1.types.GenerationConfig.ModelConfig Optional. Config for model selection.

Classes

MediaResolution

MediaResolution(value)

Media resolution for the input media.

Modality

Modality(value)

The modalities of the response.

ModelConfig

ModelConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Config for model selection.

RoutingConfig

RoutingConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

The configuration for routing the request to a specific model.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

ThinkingConfig

ThinkingConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Config for thinking features.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Methods

GenerationConfig

GenerationConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Generation config.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields