Creating a Cloud Data Fusion instance

This page explains how to create a Cloud Data Fusion instance.

Before you begin

Creating an instance


If the API is enabled, the Cloud Data Fusion section in the Cloud Console shows an Instances page where you can create and manage your Cloud Data Fusion instances.

  1. Click Create Instance.


  2. Enter an Instance name.
  3. Enter a Description for your instance.
  4. Specify the Region in which to create the instance.
  5. Specify the Cloud Data Fusion Version you prefer.
  6. Select the Cloud Data Fusion Edition you prefer.
  7. In Cloud Data Fusion version 6.2.3 and higher, specify the Dataproc service account to use for running your Cloud Data Fusion pipeline in Dataproc. The UI pre-selects the default Compute Engine account. Regardless of version, make sure that a service account has appropriate Identity and Access Management roles for your needs. For more information, see Granting service account user permission.
  8. Specify any additional settings. If you do not specify anything for the additional settings, the following defaults are used:

    Developer, Basic or Enterprise
    Instance and pipeline features
    Advanced Options
    Private IP
    Enable private IP addresses
    Create a Cloud Data Fusion instance that uses private IP addresses.
    Accelerator Enable Cloud Logging service
    Option to enable Cloud Logging
    Logging and Monitoring Enable Cloud Logging service
    Option to enable Cloud Logging

    Enable Cloud Monitoring service
    Option to enable Cloud Monitoring
    <Key> <Value> pair(s)
    The resource labels for the instance to use to annotate any related underlying resources, such as Compute Engine VMs. Label keys and label values can only contain letters, numbers, dashes, and underscores. Label keys must start with a letter or number.

  9. Click Create. It takes up to 30 minutes for the instance creation process to complete.

While Cloud Data Fusion creates your instance, a progress wheel displays next to the instance name on the Instances page. After completion, it turns into a green check mark and indicates that you can start using the instance.


Create an instance:

To create a Cloud Data Fusion instance with the Cloud Data Fusion REST API, construct an instances.create API request, filling in the Instance resource with your configuration information.

What's next