Vertex AI V1 API - Class Google::Cloud::AIPlatform::V1::ManualBatchTuningParameters (v0.3.0)

Stay organized with collections Save and categorize content based on your preferences.

Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::ManualBatchTuningParameters.

Manual batch tuning parameters.

Inherits

  • Object

Extended By

  • Google::Protobuf::MessageExts::ClassMethods

Includes

  • Google::Protobuf::MessageExts

Methods

#batch_size

def batch_size() -> ::Integer
Returns
  • (::Integer) — Immutable. The number of the records (e.g. instances) of the operation given in each batch to a machine replica. Machine type, and size of a single record should be considered when setting this parameter, higher value speeds up the batch operation's execution, but too high value will result in a whole batch not fitting in a machine's memory, and the whole operation will fail. The default value is 4.

#batch_size=

def batch_size=(value) -> ::Integer
Parameter
  • value (::Integer) — Immutable. The number of the records (e.g. instances) of the operation given in each batch to a machine replica. Machine type, and size of a single record should be considered when setting this parameter, higher value speeds up the batch operation's execution, but too high value will result in a whole batch not fitting in a machine's memory, and the whole operation will fail. The default value is 4.
Returns
  • (::Integer) — Immutable. The number of the records (e.g. instances) of the operation given in each batch to a machine replica. Machine type, and size of a single record should be considered when setting this parameter, higher value speeds up the batch operation's execution, but too high value will result in a whole batch not fitting in a machine's memory, and the whole operation will fail. The default value is 4.