Tutorials

Image Classification

• Running MNIST on Cloud TPU (TF 2.x)

  An MNIST image classification model using TensorFlow, optimized to run on Cloud TPU.

• Training ResNet on Cloud TPU (TF 2.x)

  A ResNet image classification model using TensorFlow, optimized to run on Cloud TPU.

• Training Keras ResNet-RS on Cloud TPU (TF 2.x)

  A Keras ResNet-RS model using TensorFlow, optimized to run on Cloud TPU.

• Training ResNet on Cloud TPU (PyTorch)

  A ResNet image classification model using PyTorch, optimized to run on Cloud TPU.

• Training EfficientNet on Cloud TPU (TF 2.x)

  An EfficientNet image classification model using TensorFlow, optimized to run on Cloud TPU.

Object Detection

• Training RetinaNet on Cloud TPU (TF 2.x)

  A RetinaNet object detection model using TensorFlow, optimized to run on Cloud TPU.

• Training ShapeMask on Cloud TPU (TF 2.x)

  A ShapeMask object detection model using TensorFlow, optimized to run on Cloud TPU.

• Training Mask RCNN on Cloud TPU (TF 2.x)

  A Mask RCNN model using TensorFlow, optimized to run on Cloud TPU.

Recommendation Systems

• Training DLRM model on Cloud TPU (PyTorch)

  A guide to training the PyTorch DLRM model on Cloud TPU.

• Training DLRM and DCN models on Cloud TPU (TF 2.x)

  A guide to training DLRM and DCN v2 ranking models for tasks such as click-through rate (CTR) prediction.

• Training a Neural Collaboration Filtering model on Cloud TPU (TF 2.x)

  An implementation of the Neural Collaborative Filtering (NCF) framework with the Neural Matrix Factorization (NeuMF) model

Distributed Processing on a Pod

• Training models on Cloud TPU Pods (PyTorch)

  A ResNet-50 image classification model using PyTorch, optimized to run on a Cloud TPU Pod.

Natural Language Processing

• BERT FineTuning with Cloud TPU: Sentence and Sentence-Pair Classification Tasks (TF 2.x)

  Discover how to use Bidirectional Encoder Representations from Transformers (BERT) with Cloud TPU.

• Pre-training FairSeq RoBERTa on Cloud TPU (PyTorch)

  A guide to pre-training the FairSeq version of the RoBERTa model on Cloud TPU using the public wikitext-103 dataset.

Transformer

• Training HuggingFace GPT2 on Cloud TPU (TF 2.x)

  A guide to training the HuggingFace GPT2 model on Cloud TPU.

• Training Transformer on Cloud TPU (TF 2.x)

  A guide to training the Tensor2Tensor Transformer model on Cloud TPU, for English-German translation.

• Training FairSeq Transformer on Cloud TPU (PyTorch)

  A guide to training the FairSeq version of the Transformer model on Cloud TPU and running the WMT 18 translation task translating English to German.