WorkerSettings(mapping=None, *, ignore_unknown_fields=False, **kwargs)Provides data to pass through to the worker harness.
Attributes | |
|---|---|
| Name | Description |
base_url |
str
The base URL for accessing Google Cloud APIs. When workers access Google Cloud APIs, they logically do so via relative URLs. If this field is specified, it supplies the base URL to use for resolving these relative URLs. The normative algorithm used is defined by RFC 1808, "Relative Uniform Resource Locators". If not specified, the default value is "http://www.googleapis.com/". |
reporting_enabled |
bool
Whether to send work progress updates to the service. |
service_path |
str
The Cloud Dataflow service path relative to the root URL, for example, "dataflow/v1b3/projects". |
shuffle_service_path |
str
The Shuffle service path relative to the root URL, for example, "shuffle/v1beta1". |
worker_id |
str
The ID of the worker running this pipeline. |
temp_storage_prefix |
str
The prefix of the resources the system should use for temporary storage. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object} |