public static final class Step.Builder extends GeneratedMessageV3.Builder<Step.Builder> implements StepOrBuilder
Defines a particular step within a Cloud Dataflow job.
A job consists of multiple steps, each of which performs some
specific operation as part of the overall job. Data is typically
passed from one step to another as part of the job.
Here's an example of a sequence of steps which together implement a
Map-Reduce job:
- Read a collection of data from some source, parsing the
collection's elements.
- Validate the elements.
- Apply a user-defined function to map each element to some value
and extract an element-specific key value.
- Group elements with the same key into a single element with
that key, transforming a multiply-keyed collection into a
uniquely-keyed collection.
- Write the elements out to some data sink.
Note that the Cloud Dataflow service may be used to run many different
types of jobs, not just Map-Reduce.
Protobuf type google.dataflow.v1beta3.Step
Static Methods
getDescriptor()
public static final Descriptors.Descriptor getDescriptor()
Returns
Methods
addRepeatedField(Descriptors.FieldDescriptor field, Object value)
public Step.Builder addRepeatedField(Descriptors.FieldDescriptor field, Object value)
Parameters
Returns
Overrides
build()
Returns
buildPartial()
public Step buildPartial()
Returns
clear()
public Step.Builder clear()
Returns
Overrides
clearField(Descriptors.FieldDescriptor field)
public Step.Builder clearField(Descriptors.FieldDescriptor field)
Parameter
Returns
Overrides
clearKind()
public Step.Builder clearKind()
The kind of step in the Cloud Dataflow job.
string kind = 1;
clearName()
public Step.Builder clearName()
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
string name = 2;
clearOneof(Descriptors.OneofDescriptor oneof)
public Step.Builder clearOneof(Descriptors.OneofDescriptor oneof)
Parameter
Returns
Overrides
clearProperties()
public Step.Builder clearProperties()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
clone()
public Step.Builder clone()
Returns
Overrides
getDefaultInstanceForType()
public Step getDefaultInstanceForType()
Returns
getDescriptorForType()
public Descriptors.Descriptor getDescriptorForType()
Returns
Overrides
getKind()
The kind of step in the Cloud Dataflow job.
string kind = 1;
| Type | Description |
| String | The kind.
|
getKindBytes()
public ByteString getKindBytes()
The kind of step in the Cloud Dataflow job.
string kind = 1;
getName()
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
string name = 2;
| Type | Description |
| String | The name.
|
getNameBytes()
public ByteString getNameBytes()
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
string name = 2;
getProperties()
public Struct getProperties()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
| Type | Description |
| Struct | The properties.
|
getPropertiesBuilder()
public Struct.Builder getPropertiesBuilder()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
getPropertiesOrBuilder()
public StructOrBuilder getPropertiesOrBuilder()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
hasProperties()
public boolean hasProperties()
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
| Type | Description |
| boolean | Whether the properties field is set.
|
internalGetFieldAccessorTable()
protected GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()
Returns
Overrides
isInitialized()
public final boolean isInitialized()
Returns
Overrides
mergeFrom(Step other)
public Step.Builder mergeFrom(Step other)
Parameter
Returns
public Step.Builder mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
Returns
Overrides
Exceptions
mergeFrom(Message other)
public Step.Builder mergeFrom(Message other)
Parameter
Returns
Overrides
mergeProperties(Struct value)
public Step.Builder mergeProperties(Struct value)
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
mergeUnknownFields(UnknownFieldSet unknownFields)
public final Step.Builder mergeUnknownFields(UnknownFieldSet unknownFields)
Parameter
Returns
Overrides
setField(Descriptors.FieldDescriptor field, Object value)
public Step.Builder setField(Descriptors.FieldDescriptor field, Object value)
Parameters
Returns
Overrides
setKind(String value)
public Step.Builder setKind(String value)
The kind of step in the Cloud Dataflow job.
string kind = 1;
| Name | Description |
| value | String
The kind to set.
|
Returns
setKindBytes(ByteString value)
public Step.Builder setKindBytes(ByteString value)
The kind of step in the Cloud Dataflow job.
string kind = 1;
| Name | Description |
| value | ByteString
The bytes for kind to set.
|
Returns
setName(String value)
public Step.Builder setName(String value)
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
string name = 2;
| Name | Description |
| value | String
The name to set.
|
Returns
setNameBytes(ByteString value)
public Step.Builder setNameBytes(ByteString value)
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
string name = 2;
| Name | Description |
| value | ByteString
The bytes for name to set.
|
Returns
setProperties(Struct value)
public Step.Builder setProperties(Struct value)
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
setProperties(Struct.Builder builderForValue)
public Step.Builder setProperties(Struct.Builder builderForValue)
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
.google.protobuf.Struct properties = 3;
| Name | Description |
| builderForValue | Builder
|
Returns
setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)
public Step.Builder setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)
Parameters
Returns
Overrides
setUnknownFields(UnknownFieldSet unknownFields)
public final Step.Builder setUnknownFields(UnknownFieldSet unknownFields)
Parameter
Returns
Overrides
