public final class Step extends GeneratedMessageV3 implements StepOrBuilder
Defines a particular step within a Cloud Dataflow job.
A job consists of multiple steps, each of which performs some
specific operation as part of the overall job. Data is typically
passed from one step to another as part of the job.
Here's an example of a sequence of steps which together implement a
Map-Reduce job:
- Read a collection of data from some source, parsing the
collection's elements.
- Validate the elements.
- Apply a user-defined function to map each element to some value
and extract an element-specific key value.
- Group elements with the same key into a single element with
that key, transforming a multiply-keyed collection into a
uniquely-keyed collection.
- Write the elements out to some data sink.
Note that the Cloud Dataflow service may be used to run many different
types of jobs, not just Map-Reduce.
Protobuf type google.dataflow.v1beta3.Step
Static Fields
KIND_FIELD_NUMBER
public static final int KIND_FIELD_NUMBER
Field Value
NAME_FIELD_NUMBER
public static final int NAME_FIELD_NUMBER
Field Value
PROPERTIES_FIELD_NUMBER
public static final int PROPERTIES_FIELD_NUMBER
Field Value
Static Methods
getDefaultInstance()
public static Step getDefaultInstance()
Returns
getDescriptor()
public static final Descriptors.Descriptor getDescriptor()
Returns
newBuilder()
public static Step.Builder newBuilder()
Returns
newBuilder(Step prototype)
public static Step.Builder newBuilder(Step prototype)
Parameter
Name | Description |
prototype | Step
|
Returns
public static Step parseDelimitedFrom(InputStream input)
Parameter
Returns
Exceptions
public static Step parseDelimitedFrom(InputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
parseFrom(byte[] data)
public static Step parseFrom(byte[] data)
Parameter
Name | Description |
data | byte[]
|
Returns
Exceptions
parseFrom(byte[] data, ExtensionRegistryLite extensionRegistry)
public static Step parseFrom(byte[] data, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
parseFrom(ByteString data)
public static Step parseFrom(ByteString data)
Parameter
Returns
Exceptions
parseFrom(ByteString data, ExtensionRegistryLite extensionRegistry)
public static Step parseFrom(ByteString data, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static Step parseFrom(CodedInputStream input)
Parameter
Returns
Exceptions
public static Step parseFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
public static Step parseFrom(InputStream input)
Parameter
Returns
Exceptions
public static Step parseFrom(InputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
parseFrom(ByteBuffer data)
public static Step parseFrom(ByteBuffer data)
Parameter
Returns
Exceptions
parseFrom(ByteBuffer data, ExtensionRegistryLite extensionRegistry)
public static Step parseFrom(ByteBuffer data, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Exceptions
parser()
public static Parser<Step> parser()
Returns
Methods
equals(Object obj)
public boolean equals(Object obj)
Parameter
Returns
Overrides
getDefaultInstanceForType()
public Step getDefaultInstanceForType()
Returns
getKind()
The kind of step in the Cloud Dataflow job.
string kind = 1;
Returns
Type | Description |
String | The kind.
|
getKindBytes()
public ByteString getKindBytes()
The kind of step in the Cloud Dataflow job.
string kind = 1;
Returns
getName()
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
string name = 2;
Returns
Type | Description |
String | The name.
|
getNameBytes()
public ByteString getNameBytes()
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
string name = 2;
Returns
getParserForType()
public Parser<Step> getParserForType()
Returns
Overrides
getProperties()
public Struct getProperties()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
Returns
Type | Description |
Struct | The properties.
|
getPropertiesOrBuilder()
public StructOrBuilder getPropertiesOrBuilder()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
Returns
getSerializedSize()
public int getSerializedSize()
Returns
Overrides
getUnknownFields()
public final UnknownFieldSet getUnknownFields()
Returns
Overrides
hasProperties()
public boolean hasProperties()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
Returns
Type | Description |
boolean | Whether the properties field is set.
|
hashCode()
Returns
Overrides
internalGetFieldAccessorTable()
protected GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()
Returns
Overrides
isInitialized()
public final boolean isInitialized()
Returns
Overrides
newBuilderForType()
public Step.Builder newBuilderForType()
Returns
newBuilderForType(GeneratedMessageV3.BuilderParent parent)
protected Step.Builder newBuilderForType(GeneratedMessageV3.BuilderParent parent)
Parameter
Returns
Overrides
newInstance(GeneratedMessageV3.UnusedPrivateParameter unused)
protected Object newInstance(GeneratedMessageV3.UnusedPrivateParameter unused)
Parameter
Returns
Overrides
toBuilder()
public Step.Builder toBuilder()
Returns
writeTo(CodedOutputStream output)
public void writeTo(CodedOutputStream output)
Parameter
Overrides
Exceptions