Pre-built containers for prediction and explanation

Vertex AI provides Docker container images that you run as pre-built containers for serving predictions and explanations from trained model artifacts. These containers, which are organized by machine learning (ML) framework and framework version, provide HTTP prediction servers that you can use to serve predictions with minimal configuration. In many cases, using a pre-built container is simpler than creating your own custom container for prediction.

This document lists the pre-built containers for predictions and explanations, and it describes how to use them with model artifacts that you created using Vertex AI's custom training functionality or model artifacts that you created outside of Vertex AI.

Available container images

Each of the following container images is available in several Artifact Registry repositories, which store data in various locations. You can use any of the URIs for an image when you perform custom training; each provides the same container image. If you use the Google Cloud console to create a Model resource, the Google Cloud console selects the URI that best matches the location where you are using Vertex AI in order to reduce latency.

TensorFlow

ML framework version	Use with GPUs?	URIs (choose any)
2.11	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-11:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-11:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-11:latest
2.11	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-11:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-11:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-11:latest
2.10	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-10:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-10:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-10:latest
2.10	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-10:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-10:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-10:latest
2.9	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-9:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-9:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-9:latest
2.9	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-9:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-9:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-9:latest
2.8	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-8:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-8:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-8:latest
2.8	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-8:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-8:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-8:latest
2.7	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-7:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-7:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-7:latest
2.7	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-7:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-7:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-7:latest
2.6	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-6:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-6:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-6:latest
2.6	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-6:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-6:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-6:latest
2.5	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-5:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-5:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-5:latest
2.5	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-5:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-5:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-5:latest
2.4	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-4:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-4:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-4:latest
2.4	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-4:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-4:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-4:latest
2.3	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-3:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-3:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-3:latest
2.3	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-3:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-3:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-3:latest
2.2	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-2:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-2:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-2:latest
2.2	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-2:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-2:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-2:latest
2.1	No	us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-1:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-1:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-1:latest
2.1	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-2:latest europe-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-2:latest asia-docker.pkg.dev/vertex-ai/prediction/tf2-gpu.2-2:latest
1.15	No	us-docker.pkg.dev/vertex-ai/prediction/tf-cpu.1-15:latest europe-docker.pkg.dev/vertex-ai/prediction/tf-cpu.1-15:latest asia-docker.pkg.dev/vertex-ai/prediction/tf-cpu.1-15:latest
1.15	Yes	us-docker.pkg.dev/vertex-ai/prediction/tf-gpu.1-15:latest europe-docker.pkg.dev/vertex-ai/prediction/tf-gpu.1-15:latest asia-docker.pkg.dev/vertex-ai/prediction/tf-gpu.1-15:latest

Optimized TensorFlow runtime (Preview)

Container images that use the optimized TensorFlow runtime are in Preview. For more information, see Use the optimized TensorFlow runtime.

ML framework version	Use with GPUs?	URIs (choose any)
nightly	No	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.nightly:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.nightly:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.nightly:latest
nightly	Yes	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.nightly:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.nightly:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.nightly:latest
2.11	No	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-11:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-11:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-11:latest
2.11	Yes	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-11:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-11:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-11:latest
2.10	No	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-10:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-10:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-10:latest
2.10	Yes	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-10:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-10:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-10:latest
2.9	No	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-9:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-9:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-9:latest
2.9	Yes	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-9:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-9:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-9:latest
2.8	No	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-8:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-8:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-cpu.2-8:latest
2.8	Yes	us-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-8:latest europe-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-8:latest asia-docker.pkg.dev/vertex-ai-restricted/prediction/tf_opt-gpu.2-8:latest

scikit-learn

ML framework version	Use with GPUs?	URIs (choose any)
1.0	No	us-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.1-0:latest europe-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.1-0:latest asia-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.1-0:latest
0.24	No	us-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-24:latest europe-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-24:latest asia-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-24:latest
0.23	No	us-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-23:latest europe-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-23:latest asia-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-23:latest
0.22	No	us-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-22:latest europe-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-22:latest asia-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-22:latest
0.20	No	us-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-20:latest europe-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-20:latest asia-docker.pkg.dev/vertex-ai/prediction/sklearn-cpu.0-20:latest

XGBoost

ML framework version	Use with GPUs?	URIs (choose any)
1.6	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-6:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-6:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-6:latest
1.5	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-5:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-5:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-5:latest
1.4	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-4:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-4:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-4:latest
1.3	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-3:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-3:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-3:latest
1.2	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-2:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-2:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-2:latest
1.1	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-1:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-1:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.1-1:latest
0.90	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.0-90:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.0-90:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.0-90:latest
0.82	No	us-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.0-82:latest europe-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.0-82:latest asia-docker.pkg.dev/vertex-ai/prediction/xgboost-cpu.0-82:latest

Use a pre-built container

To see an example of using a pre-built container when you import a Model as part of a more comprehensive workflow, run the "Custom training and online prediction" Jupyter notebook in one of the following environments:

• Run the notebook in Colab.
• Run the notebook in a Vertex AI Workbench user-managed notebooks instance.
• View the notebook on GitHub.

You can specify a pre-built container for prediction when you create a custom TrainingPipeline resource that uploads a Model or when you import model artifacts as a Model.

What's next

• Learn how to deploy a Model to an Endpoint resource to serve predictions.