Tutorials

Image Classification

• Training ResNet on Cloud TPU (PyTorch)

  A ResNet image classification model using PyTorch, optimized to run on Cloud TPU.

Distributed Processing on a Pod

• Training models on Cloud TPU Pods (PyTorch)

  A ResNet-50 image classification model using PyTorch, optimized to run on a Cloud TPU Pod.

Large Language Models

• Train on a single-device TPU using Pax

  A guide to train a SPMD model with Pax on a single-device Cloud TPU.

• JetStream MaxText inference on v5e

  A guide to set up and use JetStream with MaxText for inference.

• JetStream PyTorch inference on v5e

  A guide to set up and use JetStream with PyTorch for inference.

• Serve an LLM using TPUs on GKE with vLLM

  A guide to using vLLM to serve large language models (LLMs) using Tensor Processing Units (TPUs) on Google Kubernetes Engine (GKE).