Class TaskRunnerSettings (0.5.5)

Stay organized with collections Save and categorize content based on your preferences.
TaskRunnerSettings(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Taskrunner configuration settings.

Attributes

NameDescription
task_user str
The UNIX user ID on the worker VM to use for tasks launched by taskrunner; e.g. "root".
task_group str
The UNIX group ID on the worker VM to use for tasks launched by taskrunner; e.g. "wheel".
oauth_scopes Sequence[str]
The OAuth2 scopes to be requested by the taskrunner in order to access the Cloud Dataflow API.
base_url str
The base URL for the taskrunner to use when accessing Google Cloud APIs. When workers access Google Cloud APIs, they logically do so via relative URLs. If this field is specified, it supplies the base URL to use for resolving these relative URLs. The normative algorithm used is defined by RFC 1808, "Relative Uniform Resource Locators". If not specified, the default value is "http://www.googleapis.com/".
dataflow_api_version str
The API version of endpoint, e.g. "v1b3".
parallel_worker_settings google.cloud.dataflow_v1beta3.types.WorkerSettings
The settings to pass to the parallel worker harness.
base_task_dir str
The location on the worker for task-specific subdirectories.
continue_on_exception bool
Whether to continue taskrunner if an exception is hit.
log_to_serialconsole bool
Whether to send taskrunner log info to Google Compute Engine VM serial console.
alsologtostderr bool
Whether to also send taskrunner log info to stderr.
log_upload_location str
Indicates where to put logs. If this is not specified, the logs will not be uploaded. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
log_dir str
The directory on the VM to store logs.
temp_storage_prefix str
The prefix of the resources the taskrunner should use for temporary storage. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
harness_command str
The command to launch the worker harness.
workflow_file_name str
The file to store the workflow in.
commandlines_file_name str
The file to store preprocessing commands in.
vm_id str
The ID string of the VM.
language_hint str
The suggested backend language.
streaming_worker_main_class str
The streaming worker main class name.

Inheritance

builtins.object > proto.message.Message > TaskRunnerSettings