Class BatchControllerClient

The BatchController provides methods to manage batch workloads.

Inheritance

builtins.object > BatchControllerClient

Properties

transport

Returns the transport used by the client instance.

Returns
TypeDescription
BatchControllerTransportThe transport used by the client instance.

Methods

__exit__

__exit__(type, value, traceback)

Releases underlying transport's resources.

.. warning:: ONLY use as a context manager if the transport is NOT shared with other clients! Exiting the with block will CLOSE the transport and may cause errors in other clients!

batch_path

batch_path(project: str, location: str, batch: str)

Returns a fully-qualified batch string.

Parameters
NameDescription
project str
location str
batch str

common_billing_account_path

common_billing_account_path(billing_account: str)

Returns a fully-qualified billing_account string.

Parameter
NameDescription
billing_account str

common_folder_path

common_folder_path(folder: str)

Returns a fully-qualified folder string.

Parameter
NameDescription
folder str

common_location_path

common_location_path(project: str, location: str)

Returns a fully-qualified location string.

Parameters
NameDescription
project str
location str

common_organization_path

common_organization_path(organization: str)

Returns a fully-qualified organization string.

Parameter
NameDescription
organization str

common_project_path

common_project_path(project: str)

Returns a fully-qualified project string.

Parameter
NameDescription
project str

create_batch

create_batch(request: Optional[Union[google.cloud.dataproc_v1.types.batches.CreateBatchRequest, dict]] = None, *, parent: Optional[str] = None, batch: Optional[google.cloud.dataproc_v1.types.batches.Batch] = None, batch_id: Optional[str] = None, retry: Union[google.api_core.retry.Retry, object] = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())

Creates a batch workload that executes asynchronously.

Parameters
NameDescription
request Union[google.cloud.dataproc_v1.types.CreateBatchRequest, dict]

The request object. A request to create a batch workload.

parent str

Required. The parent resource where this batch will be created. This corresponds to the parent field on the request instance; if request is provided, this should not be set.

batch google.cloud.dataproc_v1.types.Batch

Required. The batch to create. This corresponds to the batch field on the request instance; if request is provided, this should not be set.

batch_id str

Optional. The ID to use for the batch, which will become the final component of the batch's resource name. This value must be 4-63 characters. Valid characters are /`a-z][0-9]`-/. This corresponds to the batch_id field on the request instance; if request is provided, this should not be set.

retry google.api_core.retry.Retry

Designation of what errors, if any, should be retried.

timeout float

The timeout for this request.

metadata Sequence[Tuple[str, str]]

Strings which should be sent along with the request as metadata.

Returns
TypeDescription
google.api_core.operation.OperationAn object representing a long-running operation. The result type for the operation will be Batch A representation of a batch workload in the service.

delete_batch

delete_batch(request: Optional[Union[google.cloud.dataproc_v1.types.batches.DeleteBatchRequest, dict]] = None, *, name: Optional[str] = None, retry: Union[google.api_core.retry.Retry, object] = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())

Deletes the batch workload resource. If the batch is not in terminal state, the delete fails and the response returns FAILED_PRECONDITION.

Parameters
NameDescription
request Union[google.cloud.dataproc_v1.types.DeleteBatchRequest, dict]

The request object. A request to delete a batch workload.

name str

Required. The name of the batch resource to delete. This corresponds to the name field on the request instance; if request is provided, this should not be set.

retry google.api_core.retry.Retry

Designation of what errors, if any, should be retried.

timeout float

The timeout for this request.

metadata Sequence[Tuple[str, str]]

Strings which should be sent along with the request as metadata.

from_service_account_file

from_service_account_file(filename: str, *args, **kwargs)

Creates an instance of this client using the provided credentials file.

Parameters
NameDescription
filename str

The path to the service account private key json file.

args

Additional arguments to pass to the constructor.

kwargs

Additional arguments to pass to the constructor.

Returns
TypeDescription
BatchControllerClientThe constructed client.

from_service_account_info

from_service_account_info(info: dict, *args, **kwargs)

Creates an instance of this client using the provided credentials info.

Parameters
NameDescription
info dict

The service account private key info.

args

Additional arguments to pass to the constructor.

kwargs

Additional arguments to pass to the constructor.

Returns
TypeDescription
BatchControllerClientThe constructed client.

from_service_account_json

from_service_account_json(filename: str, *args, **kwargs)

Creates an instance of this client using the provided credentials file.

Parameters
NameDescription
filename str

The path to the service account private key json file.

args

Additional arguments to pass to the constructor.

kwargs

Additional arguments to pass to the constructor.

Returns
TypeDescription
BatchControllerClientThe constructed client.

get_batch

get_batch(request: Optional[Union[google.cloud.dataproc_v1.types.batches.GetBatchRequest, dict]] = None, *, name: Optional[str] = None, retry: Union[google.api_core.retry.Retry, object] = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())

Gets the batch workload resource representation.

Parameters
NameDescription
request Union[google.cloud.dataproc_v1.types.GetBatchRequest, dict]

The request object. A request to get the resource representation for a batch workload.

name str

Required. The name of the batch to retrieve. This corresponds to the name field on the request instance; if request is provided, this should not be set.

retry google.api_core.retry.Retry

Designation of what errors, if any, should be retried.

timeout float

The timeout for this request.

metadata Sequence[Tuple[str, str]]

Strings which should be sent along with the request as metadata.

Returns
TypeDescription
google.cloud.dataproc_v1.types.BatchA representation of a batch workload in the service.

list_batches

list_batches(request: Optional[Union[google.cloud.dataproc_v1.types.batches.ListBatchesRequest, dict]] = None, *, parent: Optional[str] = None, retry: Union[google.api_core.retry.Retry, object] = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())

Lists batch workloads.

Parameters
NameDescription
request Union[google.cloud.dataproc_v1.types.ListBatchesRequest, dict]

The request object. A request to list batch workloads in a project.

parent str

Required. The parent, which owns this collection of batches. This corresponds to the parent field on the request instance; if request is provided, this should not be set.

retry google.api_core.retry.Retry

Designation of what errors, if any, should be retried.

timeout float

The timeout for this request.

metadata Sequence[Tuple[str, str]]

Strings which should be sent along with the request as metadata.

Returns
TypeDescription
google.cloud.dataproc_v1.services.batch_controller.pagers.ListBatchesPagerA list of batch workloads. Iterating over this object will yield results and resolve additional pages automatically.

parse_batch_path

parse_batch_path(path: str)

Parses a batch path into its component segments.

Parameter
NameDescription
path str

parse_common_billing_account_path

parse_common_billing_account_path(path: str)

Parse a billing_account path into its component segments.

Parameter
NameDescription
path str

parse_common_folder_path

parse_common_folder_path(path: str)

Parse a folder path into its component segments.

Parameter
NameDescription
path str

parse_common_location_path

parse_common_location_path(path: str)

Parse a location path into its component segments.

Parameter
NameDescription
path str

parse_common_organization_path

parse_common_organization_path(path: str)

Parse a organization path into its component segments.

Parameter
NameDescription
path str

parse_common_project_path

parse_common_project_path(path: str)

Parse a project path into its component segments.

Parameter
NameDescription
path str