Class GenerationConfig (1.48.0)

Version latest

• 1.48.0 (latest)
• 1.47.0
• 1.46.0
• 1.45.0
• 1.44.0
• 1.43.0
• 1.39.0
• 1.38.1
• 1.37.0
• 1.36.4
• 1.35.0
• 1.34.0
• 1.33.1
• 1.32.0
• 1.31.1
• 1.30.1
• 1.29.0
• 1.28.1
• 1.27.1
• 1.26.1
• 1.25.0
• 1.24.1
• 1.23.0
• 1.22.1
• 1.21.0
• 1.20.0
• 1.19.1
• 1.18.3
• 1.17.1
• 1.16.1
• 1.15.1
• 1.14.0
• 1.13.1
• 1.12.1
• 1.11.0
• 1.10.0
• 1.9.0
• 1.8.1
• 1.7.1
• 1.6.2
• 1.5.0
• 1.4.3
• 1.3.0
• 1.2.0
• 1.1.1
• 1.0.1
• 0.9.0
• 0.8.0
• 0.7.1
• 0.6.0
• 0.5.1
• 0.4.0
• 0.3.1

GenerationConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Generation config.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes
Name	Description
temperature	float Optional. Controls the randomness of predictions. This field is a member of oneof_ _temperature.
top_p	float Optional. If specified, nucleus sampling will be used. This field is a member of oneof_ _top_p.
top_k	float Optional. If specified, top-k sampling will be used. This field is a member of oneof_ _top_k.
candidate_count	int Optional. Number of candidates to generate. This field is a member of oneof_ _candidate_count.
max_output_tokens	int Optional. The maximum number of output tokens to generate per message. This field is a member of oneof_ _max_output_tokens.
stop_sequences	MutableSequence[str] Optional. Stop sequences.
presence_penalty	float Optional. Positive penalties. This field is a member of oneof_ _presence_penalty.
frequency_penalty	float Optional. Frequency penalties. This field is a member of oneof_ _frequency_penalty.
response_mime_type	str Optional. Output response mimetype of the generated candidate text. Supported mimetype: - text/plain: (default) Text output. - application/json: JSON response in the candidates. The model needs to be prompted to output the appropriate response type, otherwise the behavior is undefined. This is a preview feature.

Methods

GenerationConfig

GenerationConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Generation config.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields