Class TuningEvaluationSpec (1.45.0)

TuningEvaluationSpec(
    evaluation_data: typing.Optional[str] = None,
    evaluation_interval: typing.Optional[int] = None,
    enable_early_stopping: typing.Optional[bool] = None,
    enable_checkpoint_selection: typing.Optional[bool] = None,
    tensorboard: typing.Optional[
        typing.Union[
            google.cloud.aiplatform.tensorboard.tensorboard_resource.Tensorboard, str
        ]
    ] = None,
)

Specification for model evaluation to perform during tuning.

Attributes

Name Description
evaluation_data Optional[str]
GCS URI of the evaluation dataset. This will run model evaluation as part of the tuning job.
evaluation_interval Optional[int]
The evaluation will run at every evaluation_interval tuning steps. Default: 20.
enable_early_stopping Optional[bool]
If True, the tuning may stop early before completing all the tuning steps. Requires evaluation_data.
enable_checkpoint_selection Optional[bool]
If set to True, the tuning process returns the best model checkpoint (based on model evaluation). If set to False, the latest model checkpoint is returned. If unset, the selection is only enabled for *-bison@001 models.
tensorboard Optional[Union[google.cloud.aiplatform.tensorboard.tensorboard_resource.Tensorboard, str]]
Vertex Tensorboard where to write the evaluation metrics. The Tensorboard must be in the same location as the tuning job.