Cloud AI Platform v1 API - Class GenerationConfig (3.7.0) 

public sealed class GenerationConfig : IMessage<GenerationConfig>, IEquatable<GenerationConfig>, IDeepCloneable<GenerationConfig>, IBufferMessage, IMessage

Reference documentation and code samples for the Cloud AI Platform v1 API class GenerationConfig.

Generation config.

Inheritance

object > GenerationConfig

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Constructors

GenerationConfig()

public GenerationConfig()

GenerationConfig(GenerationConfig)

public GenerationConfig(GenerationConfig other)
Parameter
Name Description
other GenerationConfig

Properties

CandidateCount

public int CandidateCount { get; set; }

Optional. Number of candidates to generate.

Property Value
Type Description
int

FrequencyPenalty

public float FrequencyPenalty { get; set; }

Optional. Frequency penalties.

Property Value
Type Description
float

HasCandidateCount

public bool HasCandidateCount { get; }

Gets whether the "candidate_count" field is set

Property Value
Type Description
bool

HasFrequencyPenalty

public bool HasFrequencyPenalty { get; }

Gets whether the "frequency_penalty" field is set

Property Value
Type Description
bool

HasMaxOutputTokens

public bool HasMaxOutputTokens { get; }

Gets whether the "max_output_tokens" field is set

Property Value
Type Description
bool

HasPresencePenalty

public bool HasPresencePenalty { get; }

Gets whether the "presence_penalty" field is set

Property Value
Type Description
bool

HasSeed

public bool HasSeed { get; }

Gets whether the "seed" field is set

Property Value
Type Description
bool

HasTemperature

public bool HasTemperature { get; }

Gets whether the "temperature" field is set

Property Value
Type Description
bool

HasTopK

public bool HasTopK { get; }

Gets whether the "top_k" field is set

Property Value
Type Description
bool

HasTopP

public bool HasTopP { get; }

Gets whether the "top_p" field is set

Property Value
Type Description
bool

MaxOutputTokens

public int MaxOutputTokens { get; set; }

Optional. The maximum number of output tokens to generate per message.

Property Value
Type Description
int

PresencePenalty

public float PresencePenalty { get; set; }

Optional. Positive penalties.

Property Value
Type Description
float

ResponseMimeType

public string ResponseMimeType { get; set; }

Optional. Output response mimetype of the generated candidate text. Supported mimetype:

  • text/plain: (default) Text output.
  • application/json: JSON response in the candidates. The model needs to be prompted to output the appropriate response type, otherwise the behavior is undefined. This is a preview feature.
Property Value
Type Description
string

ResponseSchema

public OpenApiSchema ResponseSchema { get; set; }

Optional. The Schema object allows the definition of input and output data types. These types can be objects, but also primitives and arrays. Represents a select subset of an OpenAPI 3.0 schema object. If set, a compatible response_mime_type must also be set. Compatible mimetypes: application/json: Schema for JSON response.

Property Value
Type Description
OpenApiSchema

RoutingConfig

public GenerationConfig.Types.RoutingConfig RoutingConfig { get; set; }

Optional. Routing configuration.

Property Value
Type Description
GenerationConfigTypesRoutingConfig

Seed

public int Seed { get; set; }

Optional. Seed.

Property Value
Type Description
int

StopSequences

public RepeatedField<string> StopSequences { get; }

Optional. Stop sequences.

Property Value
Type Description
RepeatedFieldstring

Temperature

public float Temperature { get; set; }

Optional. Controls the randomness of predictions.

Property Value
Type Description
float

TopK

public float TopK { get; set; }

Optional. If specified, top-k sampling will be used.

Property Value
Type Description
float

TopP

public float TopP { get; set; }

Optional. If specified, nucleus sampling will be used.

Property Value
Type Description
float