- 0.66.0 (latest)
- 0.65.0
- 0.64.0
- 0.63.0
- 0.62.0
- 0.60.0
- 0.59.0
- 0.58.0
- 0.57.0
- 0.56.0
- 0.55.0
- 0.54.0
- 0.53.0
- 0.52.0
- 0.51.0
- 0.50.0
- 0.48.0
- 0.47.0
- 0.46.0
- 0.45.0
- 0.44.0
- 0.43.0
- 0.42.0
- 0.41.0
- 0.40.0
- 0.39.0
- 0.38.0
- 0.35.0
- 0.34.0
- 0.33.0
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.0
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.14.7
- 0.13.1
- 0.12.1
- 0.11.5
public static interface Generator.ModelParameterOrBuilder extends MessageOrBuilder
Implements
MessageOrBuilderMethods
getMaxDecodeSteps()
public abstract int getMaxDecodeSteps()
The maximum number of tokens to generate.
optional int32 max_decode_steps = 2;
Returns | |
---|---|
Type | Description |
int |
The maxDecodeSteps. |
getTemperature()
public abstract float getTemperature()
The temperature used for sampling. Temperature sampling occurs after both topP and topK have been applied. Valid range: [0.0, 1.0] Low temperature = less random. High temperature = more random.
optional float temperature = 1;
Returns | |
---|---|
Type | Description |
float |
The temperature. |
getTopK()
public abstract int getTopK()
If set, the sampling process in each step is limited to the top_k tokens with highest probabilities. Valid range: [1, 40] or 1000+. Small topK = less random. Large topK = more random.
optional int32 top_k = 4;
Returns | |
---|---|
Type | Description |
int |
The topK. |
getTopP()
public abstract float getTopP()
If set, only the tokens comprising the top top_p probability mass are considered. If both top_p and top_k are set, top_p will be used for further refining candidates selected with top_k. Valid range: (0.0, 1.0]. Small topP = less random. Large topP = more random.
optional float top_p = 3;
Returns | |
---|---|
Type | Description |
float |
The topP. |
hasMaxDecodeSteps()
public abstract boolean hasMaxDecodeSteps()
The maximum number of tokens to generate.
optional int32 max_decode_steps = 2;
Returns | |
---|---|
Type | Description |
boolean |
Whether the maxDecodeSteps field is set. |
hasTemperature()
public abstract boolean hasTemperature()
The temperature used for sampling. Temperature sampling occurs after both topP and topK have been applied. Valid range: [0.0, 1.0] Low temperature = less random. High temperature = more random.
optional float temperature = 1;
Returns | |
---|---|
Type | Description |
boolean |
Whether the temperature field is set. |
hasTopK()
public abstract boolean hasTopK()
If set, the sampling process in each step is limited to the top_k tokens with highest probabilities. Valid range: [1, 40] or 1000+. Small topK = less random. Large topK = more random.
optional int32 top_k = 4;
Returns | |
---|---|
Type | Description |
boolean |
Whether the topK field is set. |
hasTopP()
public abstract boolean hasTopP()
If set, only the tokens comprising the top top_p probability mass are considered. If both top_p and top_k are set, top_p will be used for further refining candidates selected with top_k. Valid range: (0.0, 1.0]. Small topP = less random. Large topP = more random.
optional float top_p = 3;
Returns | |
---|---|
Type | Description |
boolean |
Whether the topP field is set. |