Retrying Unsuccessful Data Capture Jobs

During data capture, it is possible for files or directories to be skipped for various reasons, such as networking or permissions issues. Files may be skipped during capture jobs for the following reasons:

  • The capture process doesn't have sufficient permission to access the file or directory. This can occur both for workstation capture when the account under which the capture utility was run doesn't have appropriate permissions to the data and for direct capture when the NFS share isn't exported to allow connection from Google Transfer Appliance.
  • A file exceeds 5 terabytes (TB). Because all files captured will eventually be stored in Google Cloud Storage, they must be under Cloud Storage's file size limit of 5 TB.
  • There is a special character in the file or directory name. File names must meet these object name requirements.
  • The file is a symbolic link. Symbolic links aren't supported in Cloud Storage.

When files are skipped, the completed data capture job is marked with a warning icon in the Jobs Monitor pane of the Transfer Appliance web interface. Clicking the icon shows the list of skipped files and the reasons they were skipped. Use the skipped file list to fix the issues that caused the files to be skipped. For convenience, you can export this list to a comma-delimited (.csv) text file by clicking Export to CSV from the List of skipped files dialog.

If either Insufficient permission to capture data or Read Operation Failed messages are returned as the reason for skipping a file, we recommend that you fix the permission or connectivity issues that caused the failure and re-run the capture job using the command line capture utility.

For more information on using the Transfer Appliance monitoring interface, see Monitoring Data Capture Jobs.

Capture files skipped by a Microsoft Windows workstation capture

To capture files that were skipped during a workstation capture, run the capture utility on the workstation again, using the same job name and data directory as the original data capture job. When you do so, a confirmation message is displayed to confirm that you wish to continue the job from the previous state.

  1. Use the following command to re-run the capture job:

    C:\Program Files\TA>TACapture.exe [JOB NAME] [CAPTURE DIRECTORY]

    where [JOB NAME] is the name of the previously run data capture job and [CAPTURE DIRECTORY] is the directory that contains the data to capture.

  2. You are prompted to enter the capture user password provided to you by Google:

    Enter Transfer Appliance <Transfer Appliance IP address> "cuser" password for SSH

  3. Type y to capture only skipped files.

    [CAPTURE DIRECTORY] was previously captured with job: [JOB NAME] Do you want to continue job: [JOB NAME], from previous state? (y/n): y

For more information, see Performing a Microsoft Windows Workstation Capture.

Capture files skipped by a Linux workstation capture

To capture files that were skipped during a workstation capture, run the capture utility on the workstation again, using the same job name and data directory as the original data capture job. When you do so, a confirmation message is displayed to confirm that you wish to continue the job from the previous state.

  1. Use the following command to re-run the capture job:

    $ ./TACapture.sh [JOB NAME] [CAPTURE DIRECTORY]

    where [JOB NAME] is the name of the previously run data capture job and [CAPTURE DIRECTORY] is the directory that contains the data to capture.

  2. You are prompted to enter the capture user password provided to you by Google:

    Enter Transfer Appliance <Transfer Appliance IP address> "cuser" password for SSH

  3. Type y to capture only skipped files.

    [CAPTURE DIRECTORY] was previously captured with job: [JOB NAME] Do you want to continue job: [JOB NAME], from previous state? (y/n): y

For more information, see Performing a Linux Workstation Capture.

Capture files skipped by an appliance capture

  1. On a workstation, connect to the Transfer Appliance web interface.
  2. Select NFS Capture in the Operations pane.
  3. The NFS Capture window appears and displays any currently mounted NFS shares. Choose the directory containing the skipped files.
  4. Choose Capture.
  5. For Restart job from previous capture state, choose Yes.
  6. Choose OK.

For more information, see Performing an Appliance Capture.

Monitor your resources on the go

Get the Google Cloud Console app to help you manage your projects.

Send feedback about...

Google Transfer Appliance