Class TopologyConfig (0.8.0)

TopologyConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Global topology of the streaming Dataflow job, including all computations and their sharded locations.

Attributes

NameDescription
computations MutableSequence[google.cloud.dataflow_v1beta3.types.ComputationTopology]
The computations associated with a streaming Dataflow job.
data_disk_assignments MutableSequence[google.cloud.dataflow_v1beta3.types.DataDiskAssignment]
The disks assigned to a streaming Dataflow job.
user_stage_to_computation_name_map MutableMapping[str, str]
Maps user stage names to stable computation names.
forwarding_key_bits int
The size (in bits) of keys that will be assigned to source messages.
persistent_state_version int
Version number for persistent state.

Classes

UserStageToComputationNameMapEntry

UserStageToComputationNameMapEntry(
    mapping=None, *, ignore_unknown_fields=False, **kwargs
)

The abstract base class for a message.

Parameters
NameDescription
kwargs dict

Keys and values corresponding to the fields of the message.

mapping Union[dict, .Message]

A dictionary or message to be used to determine the values for this message.

ignore_unknown_fields Optional(bool)

If True, do not raise errors for unknown fields. Only applied if mapping is a mapping type or there are keyword parameters.