ML Batch Predictions Are Slow

Problem

The customer is using AI Platform ML Batch Predictions and the jobs start to take considerably more time than before.

Environment

  • AI Platform ML Batch Predictions

Solution

  1. Upgrade to a newer runtime version.
  2. As AI Platform is currently being replaced by Vertex AI, the best advice would be to migrate to Vertex AI.

Cause

Usually this happens in older versions of AI Platform runtime (see the runtime versions list here).​ ​ It is expected to happen when the version reaches its end of availability, despite the fact that it still can be used after that for some time.​ ​ ​ ​