Error in Database plugin validation message: Exception while trying to validate schema of database table

Problem

Validation in database plug-in, shows an error message:

Exception while trying to validate schema of database table '{NAME}' for connection 'jdbc:postgresql://...'

Environment

  • Cloud Data Fusion
  • Cask Data Application Platform (CDAP) version 6.2.3 and earlier is a private instance or is in a private network
  • MySQL plugin
  • PostgreSQL

Solution

  1. Set database username value as a macro. Follow the documentation instructions.
  2. Use a secure mechanism as described here. This allows validation to proceed and work in preview mode.
    • If the pipeline's Dataproc cluster also runs in a private network:
      1. Change the profile to use a custom network that can connect to the database. This can be tested through a Compute Engine VM created in the same network.

Cause

Private network is unable to reach database in another network. Issue described in PLUGIN-381. A guide related to this scenario is available here.