Google Cloud Pipeline Components list

Google Cloud Pipeline Components are released in two phases:

• Experimental: These components are feature complete but might subject to breaking interface changes or bugs. Also, the components are not guaranteed to run in enterprise environments (for example, within VPC-SC perimeters).
• 1.0 and beyond: These components have a stable interface and are ready to be used in a production environment.

1.0 components

Vertex AI components

The Google Cloud Pipeline Components SDK includes the following operators related to Vertex AI:

• EndpointCreateOp
• ModelBatchPredictOp
• ModelDeployOp
• ModelUploadOp
• HyperparameterTuningJobRunOp
• CustomTrainingJobOp
• create_custom_training_job_from_component^*

*	A utility function to convert a container or Python component into a custom training job component.

The Google Cloud Pipeline Components SDK also includes the following operators related to AutoML dataset resource management:

• ImageDatasetCreateOp
• ImageDatasetExportDataOp
• TabularDatasetCreateOp
• TabularDatasetExportDataOp
• TextDatasetCreateOp
• TextDatasetImportDataOp
• TextDatasetExportDataOp
• VideoDatasetCreateOp
• VideoDatasetImportDataOp
• VideoDatasetExportDataOp
• ImageDatasetImportDataOp
• TimeSeriesDatasetCreateOp
• TimeSeriesDatasetExportDataOp
• VertexNotificationEmailOp

BigQuery ML components

• BigqueryCreateModelJobOp
• BigqueryDetectAnomaliesModelJobOp
• BigqueryDropModelJobOp
• BigqueryEvaluateModelJobOp
• BigqueryExplainForecastModelJobOp
• BigqueryExplainPredictModelJobOp
• BigqueryExportModelJobOp
• BigqueryForecastModelJobOp
• BigqueryForecastModelJobOp
• BigqueryMLAdvancedWeightsJobOp
• BigqueryMLArimaCoefficientsJobOp
• BigqueryMLArimaEvaluateJobOp
• BigqueryMLCentroidsJobOp
• BigqueryMLConfusionMatrixJobOp
• BigqueryMLFeatureImportanceJobOp
• BigqueryMLFeatureInfoJobOp
• BigqueryMLGlobalExplainJobOp
• BigqueryMLPrincipalComponentInfoJobOp
• BigqueryMLPrincipalComponentsJobOp
• BigqueryMLRecommendJobOp
• BigqueryMLReconstructionLossJobOp
• BigqueryMLRocCurveJobOp
• BigqueryMLTrainingInfoJobOp
• BigqueryMLTrialInfoJobOp
• BigqueryMLWeightsJobOp
• BigqueryPredictModelJobOp
• BigqueryQueryJobOp

Dataproc Serverless components

The Google Cloud Pipeline Components SDK includes the following operators related to Dataproc Serverless:

• DataprocPySparkBatchOp
• DataprocSparkBatchOp
• DataprocSparkRBatchOp
• DataprocSparkSqlBatchOp

Other Google Cloud components

The Google Cloud Pipeline Components SDK includes the following operators related to Google Cloud:

• DataflowPythonJobOp
• WaitGcpResourcesOp

Experimental components

Vertex AI components

The Google Cloud Pipeline Components SDK includes the following operators related to Vertex AI:

• ModelEvaluationOp

AutoML components

The Google Cloud Pipeline Components SDK includes the following operators related to AutoML model resource creation:

• AutoMLImageTrainingJobRunOp
• AutoMLTextTrainingJobRunOp
• AutoMLTabularTrainingJobRunOp
• AutoMLVideoTrainingJobRunOp
• AutoMLForecastingTrainingJobRunOp

The Google Cloud Pipeline Components SDK also includes the following operators related to AutoML tabular data:

• CvTrainerOp
• InfraValidatorOp
• Stage1TunerOp
• EnsembleOp
• StatsAndExampleGenOp
• FeatureSelectionOp
• TransformOp
• FinalizerOp

Forecasting components

The Google Cloud Pipeline Components SDK includes the following operators related to forecasting:

• ForecastingPreprocessingOp
• ForecastingValidationOp
• ForecastingPrepareDataForTrainOp

What's next

• See the following reference pages for specific Google Cloud Pipeline Components information:
  • Dataflow components
  • Dataproc Serverless components
  • CustomJob components
  • Batch prediction component
  • Model and endpoint components
  • Model evaluation component
  • Vertex AI (aiplatform) AutoML components