ExecutionStageSummary(mapping=None, *, ignore_unknown_fields=False, **kwargs)Description of the composing transforms, names/ids, and input/outputs of a stage of execution. Some composing transforms and sources may have been generated by the Dataflow service during execution planning.
Attributes |
|
|---|---|
| Name | Description |
name |
str
Dataflow service generated name for this stage. |
id |
str
Dataflow service generated id for this stage. |
kind |
google.cloud.dataflow_v1beta3.types.KindType
Type of transform this stage is executing. |
input_source |
MutableSequence[google.cloud.dataflow_v1beta3.types.ExecutionStageSummary.StageSource]
Input sources for this stage. |
output_source |
MutableSequence[google.cloud.dataflow_v1beta3.types.ExecutionStageSummary.StageSource]
Output sources for this stage. |
prerequisite_stage |
MutableSequence[str]
Other stages that must complete before this stage can run. |
component_transform |
MutableSequence[google.cloud.dataflow_v1beta3.types.ExecutionStageSummary.ComponentTransform]
Transforms that comprise this execution stage. |
component_source |
MutableSequence[google.cloud.dataflow_v1beta3.types.ExecutionStageSummary.ComponentSource]
Collections produced and consumed by component transforms of this stage. |
Classes
ComponentSource
ComponentSource(mapping=None, *, ignore_unknown_fields=False, **kwargs)Description of an interstitial value between transforms in an execution stage.
ComponentTransform
ComponentTransform(mapping=None, *, ignore_unknown_fields=False, **kwargs)Description of a transform executed as part of an execution stage.
StageSource
StageSource(mapping=None, *, ignore_unknown_fields=False, **kwargs)Description of an input or output of an execution stage.