Use JDBC drivers with Cloud Data Fusion

This page explains how to use Java Database Connectivity (JDBC) drivers with Cloud Data Fusion pipelines.

When using Cloud Data Fusion, you can connect to your database using the JDBC to read data, transform it, and load it into a destination of your choice, without having to write any code. To do this, you need to upload a JDBC driver to your Cloud Data Fusion instance and configure it so that you can use it in your data pipelines.

Before you begin

Create a Cloud Data Fusion instance.

It takes up to 30 minutes for the instance creation process to complete.

Open the instance in Cloud Data Fusion

1. In the Google Cloud console, go to the Cloud Data Fusion page.

2. Click Instances, and then click View instance to open the instance in the Cloud Data Fusion web interface.

   Go to Instances

Upload a JDBC driver

1. Access the Cloud Data Fusion graphical interface. Go to the Cloud Data Fusion Control Center.
2. Click the green circle button.
3. In the Add entity window that opens, in the Driver box, click the Upload button.

   

4. In the Add driver window that opens, upload the JAR file that contains your JDBC driver. Your JAR file must follow the format <name>-<version>.jar. If your JAR file doesn't follow this format, rename it before you upload.
5. Click Next.
6. In the Driver configuration tab:
   1. In the Name field, enter a name for your JDBC driver. Make note of the name you enter because you will need it in later steps. Do not use spaces or special characters in the name.
   2. In the Class name field, enter the official Java class name of the JDBC driver you're using.

      See class names of common JDBC drivers.

      Database driver	Class name
      Amazon Redshift	com.amazon.redshift.jdbc.Driver
      Google Cloud SQL for MySQL	com.mysql.jdbc.Driver
      Google Cloud SQL for PostgreSQL	org.postgresql.Driver
      Hiveserver 2 (Unsecured Binary)	org.apache.hive.jdbc.HiveDriver
      Hiveserver 2 (Unsecured HTTP)	org.apache.hive.jdbc.HiveDriver
      IBM DB2	com.ibm.db2.jcc.DB2Driver
      Microsoft SQL Server (v6.2 and later)	com.microsoft.sqlserver.jdbc.SQLServerDriver
      MySQL	com.mysql.jdbc.Driver
      Netezza	org.netezza.Driver
      Oracle Database	oracle.jdbc.OracleDriver
      Oracle Thin	oracle.jdbc.driver.OracleDriver
      PostgreSQL (v6.5 and earlier)	postgresql.Driver
      PostgreSQL (v7.0 and later)	org.postgresql.Driver
      Progress OpenEdge	com.ddtek.jdbc.openedge.OpenEdgeDriver (> v10.1A) com.progress.sql.jdbc.ProgressDriver (< v10.1A)
      SAP Hana	com.sap.db.jdbc.Driver
      Teradata	com.teradata.jdbc.TeraDriver

   3. Optional: Enter a description.
   4. Click Finish.

Use a JDBC driver

1. Access the Cloud Data Fusion graphical interface. Go to the Cloud Data Fusion Pipeline Studio.
2. In the left navigation panel, select Source or Sink and click the source or sink of your choice. A rectangle that represents the source or sink appears in the Studio canvas.

3. Hover over the source or sink. Click Properties on the Database source or sink.

   

4. In the Reference name field, enter the name you defined for the driver in the uploading step.

5. Fill out the rest of the fields in the Configuration tab.

View a JDBC driver

The JDBC drivers you upload appear as artifacts in the Cloud Data Fusion Control Center. To view a JDBC driver:

1. Access the Cloud Data Fusion graphical interface. Go to the Cloud Data Fusion Control Center.
2. In the Filter by dropdown, select Artifacts. An artifact card with your JDBC driver information appears.

   

Delete a JDBC driver

1. Access the Cloud Data Fusion graphical interface. Go to the Cloud Data Fusion Control Center.
2. View your JDBC driver. In the Filter by dropdown, select Artifacts.
3. In the artifact card of your JDBC driver, click the trash button at the bottom.

   

What's next

• Learn more about Cloud Data Fusion.
• Work through a tutorial.