Google Cloud Pipeline Components list

Google Cloud Pipeline Components are released in two stages:

• Generally available (v1.0 and later)

• Preview

For more information, see the launch stage descriptions.

Generally available (1.0 and later) components

Generally available (GA) Google Cloud Pipeline Components are available in the v1 namespace of the Google Cloud Pipeline Components SDK. These components have a stable interface and are ready to be used in a production environment.

AutoML components

AutoML Forecasting components

The Google Cloud Pipeline Components SDK includes the following operators related to AutoML forecasting:

• ProphetTrainerOp

AutoML Tabular components

The Google Cloud Pipeline Components SDK includes the following operators related to AutoML tabular:

• CvTrainerOp
• EnsembleOp
• FinalizerOp
• InfraValidatorOp
• SplitMaterializedDataOp
• Stage1TunerOp
• StatsAndExampleGenOp
• TrainingConfiguratorAndValidatorOp
• TransformOp

AutoML Training Job components

The Google Cloud Pipeline Components SDK includes the following operators related to AutoML training jobs:

• AutoMLForecastingTrainingJobRunOp
• AutoMLImageTrainingJobRunOp
• AutoMLTabularTrainingJobRunOp
• AutoMLTextTrainingJobRunOp
• AutoMLVideoTrainingJobRunOp

Batch Prediction components

The Google Cloud Pipeline Components SDK includes the following operators related to Batch Prediction:

• ModelBatchPredictOp

BigQuery ML components

The Google Cloud Pipeline Components SDK includes the following operators for creating and executing machine learning models using BigQuery:

• BigqueryCreateModelJobOp
• BigqueryDetectAnomaliesModelJobOp
• BigqueryDropModelJobOp
• BigqueryEvaluateModelJobOp
• BigqueryExplainForecastModelJobOp
• BigqueryExplainPredictModelJobOp
• BigqueryExportModelJobOp
• BigqueryForecastModelJobOp
• BigqueryMLAdvancedWeightsJobOp
• BigqueryMLArimaCoefficientsJobOp
• BigqueryMLArimaEvaluateJobOp
• BigqueryMLCentroidsJobOp
• BigqueryMLConfusionMatrixJobOp
• BigqueryMLFeatureImportanceJobOp
• BigqueryMLFeatureInfoJobOp
• BigqueryMLGlobalExplainJobOp
• BigqueryMLPrincipalComponentInfoJobOp
• BigqueryMLPrincipalComponentsJobOp
• BigqueryMLRecommendJobOp
• BigqueryMLReconstructionLossJobOp
• BigqueryMLRocCurveJobOp
• BigqueryMLTrainingInfoJobOp
• BigqueryMLTrialInfoJobOp
• BigqueryMLWeightsJobOp
• BigqueryPredictModelJobOp
• BigqueryQueryJobOp

Custom Job components

The Google Cloud Pipeline Components SDK includes the following operators for running KFP components as Vertex AI Custom Training jobs:

• CustomTrainingJobOp

Dataflow components

The Google Cloud Pipeline Components SDK includes the following operators related to Dataflow:

• DataflowFlexTemplateJobOp
• DataflowPythonJobOp

Dataproc Serverless components

The Google Cloud Pipeline Components SDK includes the following operators related to Dataproc Serverless:

• DataprocPySparkBatchOp
• DataprocSparkBatchOp
• DataprocSparkRBatchOp
• DataprocSparkSqlBatchOp

Dataset components

The Google Cloud Pipeline Components SDK includes the following operators for AutoML dataset resource management:

• GetVertexDatasetOp
• ImageDatasetCreateOp
• ImageDatasetExportDataOp
• ImageDatasetImportDataOp
• TabularDatasetCreateOp
• TabularDatasetExportDataOp
• TextDatasetCreateOp
• TextDatasetExportDataOp
• TextDatasetImportDataOp
• TimeSeriesDatasetCreateOp
• TimeSeriesDatasetExportDataOp
• VideoDatasetCreateOp
• VideoDatasetExportDataOp
• VideoDatasetImportDataOp

Endpoint components

The Google Cloud Pipeline Components SDK includes the following operators related to model serving endpoints:

• EndpointCreateOp
• EndpointDeleteOp
• ModelDeployOp
• ModelUndeployOp

Forecasting components

The Google Cloud Pipeline Components SDK includes the following operators related to forecasting:

• ForecastingPrepareDataForTrainOp
• ForecastingPreprocessingOp
• ForecastingValidationOp

Hyperparameter Tuning components

The Google Cloud Pipeline Components SDK includes the following operators related to hyperparameter tuning jobs:

• HyperparameterTuningJobRunOp

Model components

The Google Cloud Pipeline Components SDK includes the following operators for managing models through the Vertex AI Model Registry:

• ModelDeleteOp
• ModelExportOp
• ModelUploadOp

Model evaluation components

The Google Cloud Pipeline Components SDK includes the following operators related to model evaluation:

• ModelEvaluationClassificationOp
• ModelEvaluationForecastingOp
• ModelEvaluationRegressionOp

Email notification components

The Google Cloud Pipeline Components SDK includes the following operators for managing email notifications:

• VertexNotificationEmailOp

Components related to wait on resources

The Google Cloud Pipeline Components SDK includes the following operator related to waiting on resource creation:

• WaitGcpResourcesOp

Preview components

Preview

This feature is subject to the "Pre-GA Offerings Terms" in the General Service Terms section of the Service Specific Terms. Pre-GA features are available "as is" and might have limited support. For more information, see the launch stage descriptions.

Google Cloud Pipeline Components in the Preview stage are available in the preview namespace of the Google Cloud Pipeline Components SDK.

AutoML components

AutoML Forecasting components

The Google Cloud Pipeline Components SDK includes the following preview operators related to AutoML forecasting:

• ForecastingEnsembleOp
• ForecastingStage1TunerOp
• ForecastingStage2TunerOp

AutoML Tabular components

The Google Cloud Pipeline Components SDK includes the following preview operators related to AutoML tabular:

• AutoFeatureEngineeringOp
• DistillationStageFeatureTransformEngineOp
• FeatureSelectionOp
• FeatureTransformEngineOp
• TabNetHyperparameterTuningJobOp
• TabNetTrainerOp
• WideAndDeepHyperparameterTuningJobOp
• WideAndDeepTrainerOp
• XGBoostHyperparameterTuningJobOp
• XGBoostTrainerOp

Custom Job components

The Google Cloud Pipeline Components SDK includes the following preview operators for running KFP components as Vertex AI Custom Training jobs:

• CustomTrainingJobOp

Dataflow components

The Google Cloud Pipeline Components SDK includes the following preview operators related to Dataflow:

• DataflowFlexTemplateJobOp

Large-language model (LLM) components

The Google Cloud Pipeline Components SDK includes the following preview operators related to LLMs:

• infer_pipeline
• rlhf_pipeline

Model evaluation components

The Google Cloud Pipeline Components SDK includes the following preview operators related to model evaluation:

• DetectDataBiasOp
• DetectModelBiasOp
• ModelEvaluationFeatureAttributionOp

What's next

• See the following reference pages for specific Google Cloud Pipeline Components information:

  • Dataflow components

  • Dataproc Serverless components

  • CustomJob components

  • Batch prediction component

  • Model and endpoint components

  • Model evaluation component

  • Vertex AI (aiplatform) AutoML components