Data pipeline creation using Cloud Data Fusion fails

Problem

Data pipeline creation using Cloud Data Fusion fails due to the following error during PROVISIONING, it will be observed in the pipeline logs:

java.lang.NumberFormatException: multiple points

The error is then followed by another error that indicates the PROVISION task of the Dataproc cluster creation is terminated:

DEBUG [provisioning-service-6:i.c.c.i.p.t.ProvisioningTask@163] - Terminated PROVISION task for program run ... due to exception

Environment

  • Cloud Data Fusion version 6.1.4

Solution

You must migrate to a new Cloud Data Fusion instance with version 6.4.0 or above.

Workaround

Upgrade the current instance by following the instructions here.

Cause

The NumberFormatException is a pretty common error in Java, and it occurs when trying to convert a String into numeric data types.