Track parameters and metrics for custom training jobs: Notebook

This notebook demonstrates how to use Vertex AI SDK for Python to track metrics and parameters for Vertex AI custom training jobs, and how to perform detailed analysis using this data.

Notebook:

To see an example of tracking parameters and metrics for a custom training job, run the "Track parameters and metrics for custom training job" Jupyter notebook in one of the following environments:

Open in Colab | Open in Colab Enterprise | Open in Vertex AI Workbench user-managed notebooks | View on GitHub

This tutorial uses the following Google Cloud ML services and resources:

• Vertex AI dataset
• Vertex AI model
• Vertex AI endpoint
• Vertex AI custom training Job
• Vertex AI Experiments

The steps performed include:

1. Track training parameters and prediction metrics for a custom training job.
2. Extract and perform analysis for all parameters and metrics within a Vertex AI Experiments.

Relevant content

• Vertex ML Metadata
• Custom training overview
• Endpoint
• Create and manage experiment runs