Overview
You can modify the following information about a stream:
- High-level information, such as the display name and labels for the stream.
Configuration information for the source database and the destination, such as the tables and schemas in the source database that Datastream will either transfer to the destination or will be restricted from transferring into the destination. Datastream uses this configuration information to transfer the correct data from the source database to the destination.
Modify high-level information
Go to the Streams page in the Google Cloud Console.
Click the stream that you want to modify.
On the Stream details page, click EDIT.
Select Edit stream settings from the menu that appears.
Modify the display name or labels for the stream.
After making your changes, click SAVE.
Modify configuration information about the source database
Go to the Streams page in the Google Cloud Console.
Click the stream that you want to modify.
On the Stream details page, click EDIT.
Select Edit source configuration from the menu that appears.
In the Select objects to include section, use the Objects to include drop-down menu to change the tables and schemas in the source database that Datastream will transfer to the destination.
Optionally, expand the Select objects to exclude node. In the Objects to exclude field, modify the tables and schemas in the source database that you want to restrict Datastream from transferring into the destination. If tables are added to this list, then they're no longer pulled into the destination. However, they're not removed from the destination.
Optionally, expand the Choose backfill mode for historical data node to modify whether Datastream backfills the destination with current and future data from the source, or streams only changes to this data.
Select the Automatic option to stream all existing data, in addition to changes to the data, from the source into the destination.
If you select this option, then in the Objects excluded from automatic backfill field, you can modify the tables and schemas in the source database that you want to restrict Datastream from backfilling into the destination.
Select the Manual option to stream only changes to the data.
After making your changes, click SAVE.
Modify configuration information about the destination
Go to the Streams page in the Google Cloud Console.
Click the stream that you want to modify.
On the Stream details page, click EDIT.
Select Edit destination configuration from the menu that appears.
In the Stream path prefix field, modify the folder of the destination into which Datastream will transfer schemas, tables, and data from the source database.
From the Output format menu:
- Choose the format of files written to Cloud Storage. Datastream supports two output formats: Avro and JSON.
- If you select the JSON format, then select or clear the Include a Unified Types schema file in the file path and Enable gzip compression check boxes.
After making your changes, click SAVE.
After creating and viewing high-level and detailed information about a stream, and making any necessary changes to it, you can start it. Also, any modifications that you make to streams that are running will be updated by Datastream automatically.