View a stream

Overview

In this section, you learn how to view high-level and detailed information about a stream.

View high-level information

High-level information about a stream includes:

  • The name and status of the stream.
  • The source and destination connection profiles that the stream uses to transfer data from a source database into a destination.
  • The profile types of the connection profiles.

View detailed information

In addition to viewing high-level information about a stream, you can click a stream to see additional information, including:

  • The region where the stream is stored. Streams, like all resources, are saved in a region. Streams can only use connection profiles and private connectivity configurations that are in the same region.
  • When the stream was created, last updated, or recovered.
  • Any labels added to the stream. These labels are used to organize the stream.
  • Depending on the source database, the CDC method that you selected for the stream.
  • The tables and schemas in the source database which Datastream should include when processing the stream.
  • The tables and schemas in the source database that Datastream should exclude when processing the stream.
  • Whether historical backfill is enabled or disabled for the stream.
    • If it's enabled, how many schemas and tables in the source database are excluded from backfilling.
  • For BigQuery destinations:
    • Whether the destination dataset is a dynamic or default dataset.
    • Whether the write mode for the stream is set to Merge or Append-only.
    • If you selected Merge mode, the staleness limit configuration applied to the new BigQuery tables created by Datastream.
  • For Cloud Storage destinations:
    • The location of the destination into which the stream transfers schemas, tables, and data from a source database.
    • The format of files written to the destination. Datastream supports two output formats: Avro and JSON.
  • Whether your data is encrypted with a key that's managed by Google (Google-managed) or by you (Customer-managed).
  • A link and the path to the customer-managed encryption key (if you're managing the encryption).
  • A link to create an alerting policy for the stream.
  • A status of how many backfills are in progress, pending, or failed.
  • The number of events that are processed and loaded to the destination by Datastream in the last 7 days.
  • The number of events that Datastream couldn't process in the last 7 days.

  • The Data freshness graph. This graph displays the time gap between data residing in the source and the data being transferred into the destination by the stream. This is calculated as the time elapsed since Datastream last checked for new data in the source.

    For more information about this graph, see Monitor a stream.

  1. Go to the Streams page in the Google Cloud Console.

    Go to the Streams page

  2. Click the stream for which you want to see detailed information. This information appears on the Stream details page.

After viewing high-level and detailed information about a stream, you can modify it.

What's next