Rehydrating Data


Before you work with the Rehydrator, make sure that your Google Cloud Storage project:

Setting up public IP addresses

Transfer Appliance Rehydrator requires a publicly routable or external IP address. To set up a public IP address, see Reserving a Static External IP Address.

Rehydrating uploaded data

You can run one or more rehydration jobs in parallel. If you choose to start all pending jobs at once, the Rehydrator schedules the jobs to avoid overloading the instance. Jobs are scheduled such that at any point there are at most eight 1TB tasks running simultaneously to achieve optimal rehydration speed.

To start a rehydration job:

  1. Open the Transfer Appliance Rehydrator User Interface in a browser by entering the URL that was provided as the Site address value when you deployed the Rehydrator instance.

  2. Sign in using the Rehydrator Username and Rehydrator Password credentials you noted when you deployed the Rehydrator instance.

  3. Select the rehydration jobs you want to run.

    For all jobs, including individual jobs, you can provide a target path or prefix via the Transfer Appliance Rehydrator User Interface. The data will be rehydrated into the Cloud Storage bucket and folder identified by the target path or prefix.

  4. Provide the target path or prefix on the Rehydrate Job Confirmation popup. A new input field labelled Target Path is displayed with the default path set to gs://<destination-bucket-name>/<job-name>. If you want to change the default path, edit <job-name>. You can't edit <destination-bucket-name>.

  5. To start a specific rehydration job, click the Start icon associated with that job in the Jobs Pending pane. To run all pending rehydration jobs, click the Start icon at the top of the Jobs Pending pane.

  6. Click OK to start the selected rehydration jobs. It may take up to one minute for a rehydration job to display in the Jobs Running pane after you start it.

Retrying failed rehydration jobs

A rehydration job can fail for various reasons, usually related to cloud networking issues. The Rehydrator instance will retry failed rehydration jobs several times before terminating them with a status of either failed or completed with issues. If a job fails either partially or completely, try running it again.

To retry a rehydration job:

  1. Open the Rehydrator User Interface.
  2. Click the Start icon associated with a job in the Jobs Completed pane.

Searching for a rehydration job

  1. Open the Transfer Appliance Rehydrator User Interface.
  2. Click the Search icon.
  3. Enter your desired search criteria.
  4. Click the Search icon again to display the job list, filtered with your search criteria.

Refreshing the rehydration job dashboard

  1. Open the Transfer Appliance Rehydrator User Interface.
  2. Click the Refresh icon.

Exporting rehydration job information

  1. Open the Transfer Appliance Rehydrator User Interface.
  2. Click the Settings icon.
  3. Click Export to CSV.

    The Jobs_Monitor_Details.csv is downloaded, which contains the job information in comma-separated value format (CSV) to the default download directory on that workstation.

Verifying rehydrated data

A check of the integrity of migrated data using hash comparison, checksums, and other mechanisms is performed automatically by the Transfer Appliance software at every stage of your migration. Data integrity issues are generally caught and addressed automatically. For additional certainty, we recommend that you also verify that your files and data have been correctly recovered once they have been rehydrated and moved to the Cloud Storage destination bucket.

Checksums are the most commonly used method for data verification. After migration is complete, you can identify a set of key files from your source data and use a checksum tool to verify the migrated data compared to the original data. To do this, follow the instructions in Working with checksums.

What's next