In this section, you learn how to view high-level and detailed information about a stream.
View high-level information
High-level information about a stream includes:
- The name and status of the stream.
- The source and destination connection profiles that the stream uses to transfer data from a source database into a destination.
- The profile types of the connection profiles.
- The region where the stream is stored. Streams, like all resources, are saved in a region. Streams can only use connection profiles and private connectivity configurations that are in the same region.
- When the stream was created or last updated.
- Any labels added to the stream. These labels are used to organize the stream.
View detailed information
In addition to viewing high-level information about a stream, you can click a stream to see additional information, including:
- The tables and schemas in the source database which Datastream should include when processing the stream.
- The tables and schemas in the source database that Datastream should exclude when processing the stream.
- Whether historical backfill is enabled or disabled for the stream.
- If it's enabled, how many schemas and tables in the source database are excluded from backfilling.
- For BigQuery destinations, whether the destination dataset is a dynamic or default dataset.
- For Cloud Storage destinations:
- The location of the destination into which the stream transfers schemas, tables, and data from a source database.
- The format of files written to the destination. Datastream currently supports two output formats: Avro and JSON.
- Whether your data is encrypted with a key that's managed by Google (Google-managed) or by you (Customer-managed)
- A link and the path to the customer-managed encryption key (if you're managing the encryption)
- A status of how many backfills are in progress, pending, or failed.
- The number of events that are processed and loaded to the destination by Datastream in the last 7 days.
- The number of events that Datastream couldn't process in the last 7 days.
The Data freshness graph. This graph displays the time gap between data residing in the source and the data being transferred into the destination by the stream. This is calculated as the time elapsed since Datastream last checked for new data in the source.
Go to the Streams page in the Google Cloud Console.
Click the stream for which you want to see detailed information. This information appears on the Stream details page.
After viewing high-level and detailed information about a stream, you can modify it.