The Vertex AI Pipelines Template Gallery contains Google-authored pipeline templates and components, which you can use to create pipeline runs or embed in your own pipelines.
Available templates
The templates and components in the Template Gallery include templates for the following pipelines and components:
AutoML for Tabular Classification / Regression: This is a template for the Tabular Workflow for End-to-End AutoML pipeline. It is the complete AutoML pipeline for training a classification or regression model from a tabular dataset. To create a pipeline run using this template, click Create run. For detailed instructions about creating a pipeline run for Tabular Workflow for End-to-End AutoML, see Train a Model. For more information about the Tabular Workflow for End-to-End AutoML pipeline, see Tabular Workflow for End-to-End AutoML.
Wide & Deep training: For more information about the Wide & Deep training pipeline, see Tabular Workflow for Wide & Deep. To learn how to train a model using this pipeline, including links to Jupyter Notebook Tutorials, see Train a Model.
TabNet training: For more information about the TabNet training pipeline, see Tabular Workflow for TabNet. To learn how to train a model using this pipeline, including links to Jupyter Notebook Tutorials, see Train a Model.
Google Cloud Pipeline Components: These Kubeflow Pipelines components are maintained by Google. You can use them to accomplish a variety of common MLOps tasks. Google Cloud Pipeline Components are the best way to interface with Google Cloud services from an ML pipeline. To learn more about Google Cloud Pipeline Components, see Google Cloud Pipeline Components list. For component reference, see the
google_cloud_pipeline_componentsSDK reference.
Create a pipeline run from the Template Gallery
Use the following instructions to create a pipeline run from a Google-authored template from the Template Gallery. Alternatively, you can create your own custom pipeline template and then create a pipeline run based on it. For more information about creating and using a custom pipeline template, see Create, upload, and use a pipeline template.
Console
Use the following instructions to create a pipeline run from the Template Gallery:
In the Google Cloud console, in the Vertex AI section, go to the Template Gallery tab on the Pipelines page.
Optional: To filter the list of pipeline templates, in the left pane, select the filter criteria. For example, to show only pipeline templates, select Templates under Type.
On the card corresponding to the template that you want to use, click Create run to open the Create pipeline run page.
Specify the following Run details by selecting any one of the following options:
To create a pipeline run based on an existing pipeline template, select Select from existing pipelines and enter the following details:
Select the Repository containing the pipeline or component definition file.
Select the Pipeline or component and Version.
To upload a compiled pipeline definition, select Upload file and enter the following details:
Click Browse to open the file selector. Navigate to the compiled pipeline YAML file that you want to run, select the pipeline, and click Open.
The Pipeline or component name shows the name specified in the pipeline definition, by default. Optionally, specify a different Pipeline name.
To import a pipeline definition file from Cloud Storage, select Import from Cloud Storage and enter the following details:
Click Browse to navigate to the Cloud Storage bucket containing the pipeline definition object, select the file, and then click Select.
Specify the Pipeline or component name.
Specify a Run name to uniquely identify the pipeline run.
Optional: To schedule recurring pipeline runs, specify the Run schedule, as follows:
Select Recurring.
Under Start time, specify when the schedule becomes active.
To schedule the first run to occur immediately after schedule creation, select Immediately.
To schedule the first run to occur at a specific time and date, select On.
In the Frequency field, specify the frequency to schedule and execute the pipeline runs, using a cron schedule expression based on unix-cron.
Under Ends, specify when the schedule ends.
To indicate that the schedule creates pipeline runs indefinitely, select Never.
To indicate that the schedule ends on a specific date and time, select On, and specify the end date and time for the schedule.
Optional: To specify that the pipeline run uses a custom service account, a customer-managed encryption key (CMEK), or a peered VPC network, click Advanced options, and then use the following instructions:
To specify a service account, select a service account from the Service account drop-down list.
If you don't specify a service account, Vertex AI Pipelines runs your pipeline using the default Compute Engine service account.
Learn more about [configuring a service account for use with Vertex AI Pipelines][configure-sa].
To use a CMEK, select Use a customer-managed encryption key. The Select a customer-managed key drop-down list appears. In the Select a customer-managed key drop-down list, select the key that you want to use.
To use a peered VPC network in this pipeline run, enter the VPC network name in the Peered VPC network box.
Click Continue. The Runtime configuration pane appears.
Under Cloud storage location, click Browse to select the Cloud Storage bucket for storing the pipeline output artifacts, and then click Select.
Optional: To configure the failure policy and the cache for the pipeline run, click Advanced options, and then use the following instructions:
Under Failure policy, specify the failure policy for the entire pipeline. Learn more about pipeline failure policies.
To configure the pipeline to continue scheduling tasks after one task fails, select Run all steps to completion. This option is selected, by default.
To configure the pipeline to fail after one task fails, select Fail this run as soon as one step fails.
Under Caching configuration, specify the cache configuration for the entire pipeline.
To use the task-level cache configuration for task in the pipeline, select Do not override task-level cache configuration.
To turn on caching for all the tasks in the pipeline and override any task-level cache configuration, select Enable read from cache for all steps (fastest).
To turn off caching for all the tasks in the pipeline and override any task-level cache configuration, select Disable read from cache for all steps (fastest).
Optional: If your pipeline has parameters, under Pipeline parameters, specify your pipeline run parameters.
Click Submit to create your pipeline run.