Export and import pipelines

This page describes how to export and import pipeline configurations in JSON format. These JSON files are useful in the following scenarios:

  • Moving pipelines from a design environment to an execution environment.
  • Moving pipelines to a new Cloud Data Fusion version or instance.
  • Troubleshooting.

Export a pipeline

To export your pipeline in JSON Format:

  1. Go to your instance:

    1. In the Google Cloud console, go to the Cloud Data Fusion page.

    2. To open the instance in the Cloud Data Fusion Studio, click Instances, and then click View instance.

      Go to Instances

  2. Click List.
  3. For the desired pipelines, click .
  4. Click Export.
  5. Save the JSON files.

Import a pipeline

In the environment or instance where you want to import your pipeline:

  1. Open the Cloud Data Fusion Studio page.
  2. Click Import.
  3. Upload the JSON file that you saved when you exported your pipeline.
  4. Optional: You might be prompted to upgrade the version of your plugins. Click Fix all. If a particular plugin is not found, follow the prompts to install it from the Hub.
  5. Optional: If you use a custom plugin in your pipeline and you receive a prompt in the upgrade window that the plugin was not found, you must deploy that custom plugin first, and then import the pipeline again.

Your pipeline opens in the Studio page. To deploy your pipeline as-is, click Deploy.

Details

A pipeline is exported in JSON format. The file includes information about sources, sinks, and the connections between them.

It doesn't include triggers that you created after the pipeline was deployed. To get details about those triggers, recreate them in a different environment.

What's next