This page shows you how to resolve issues with Cloud Data Fusion upgrades.
Dataproc cluster to gets stuck in provisioning state after upgrading from 6.1
The following issue occurs when you upgrade from version 6.1 to version 6.2.0 or later:
Network tags aren't preserved when you upgrade, causing your Dataproc cluster to get stuck in provisioning state. This error can happen especially when your environment has restrictive networking and security policies.
Instead, in each updated instance, manually add your network tags to each of the compute profiles it uses.
Add the network tags to a compute profile by following these steps:
In the Google Cloud console, go to the Cloud Data Fusion Instances page.
Click View Instance.
Click System Admin.
Click the Configuration tab.
Expand the System Compute Profiles field.
Click Create New Profile. A page of provisioners opens.
Click Dataproc.
Enter your profile information, including the network tags.
Click Create.
After adding the tags, use the updated profile in your pipeline. The new tags are preserved in future releases.
What's next
- Manage patch revisions for Cloud Data Fusion instances.
- Manage version upgrades for pipelines and instances.
- Learn about versioning in Cloud Data Fusion.
- Refer to the available version and patch revision upgrades.