Cloud Dataproc API - Module Google::Cloud::Dataproc (v2.7.0)

Reference documentation and code samples for the Cloud Dataproc API module Google::Cloud::Dataproc.

Methods

.autoscaling_policy_service

def self.autoscaling_policy_service(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for AutoscalingPolicyService.

By default, this returns an instance of Google::Cloud::Dataproc::V1::AutoscalingPolicyService::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the AutoscalingPolicyService service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the AutoscalingPolicyService service. You can determine whether the method will succeed by calling Dataproc.autoscaling_policy_service_available?.

About AutoscalingPolicyService

The API interface for managing autoscaling policies in the Dataproc API.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.autoscaling_policy_service_available?

def self.autoscaling_policy_service_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the AutoscalingPolicyService service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.autoscaling_policy_service. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the AutoscalingPolicyService service, or if the versioned client gem needs an update to support the AutoscalingPolicyService service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

.batch_controller

def self.batch_controller(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for BatchController.

By default, this returns an instance of Google::Cloud::Dataproc::V1::BatchController::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the BatchController service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the BatchController service. You can determine whether the method will succeed by calling Dataproc.batch_controller_available?.

About BatchController

The BatchController provides methods to manage batch workloads.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.batch_controller_available?

def self.batch_controller_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the BatchController service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.batch_controller. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the BatchController service, or if the versioned client gem needs an update to support the BatchController service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

.cluster_controller

def self.cluster_controller(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for ClusterController.

By default, this returns an instance of Google::Cloud::Dataproc::V1::ClusterController::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the ClusterController service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the ClusterController service. You can determine whether the method will succeed by calling Dataproc.cluster_controller_available?.

About ClusterController

The ClusterControllerService provides methods to manage clusters of Compute Engine instances.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.cluster_controller_available?

def self.cluster_controller_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the ClusterController service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.cluster_controller. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the ClusterController service, or if the versioned client gem needs an update to support the ClusterController service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

.configure

def self.configure() -> ::Google::Cloud::Config

Configure the google-cloud-dataproc library.

The following configuration parameters are supported:

  • credentials (type: String, Hash, Google::Auth::Credentials) - The path to the keyfile as a String, the contents of the keyfile as a Hash, or a Google::Auth::Credentials object.
  • lib_name (type: String) - The library name as recorded in instrumentation and logging.
  • lib_version (type: String) - The library version as recorded in instrumentation and logging.
  • interceptors (type: Array<GRPC::ClientInterceptor>) - An array of interceptors that are run before calls are executed.
  • timeout (type: Numeric) - Default timeout in seconds.
  • metadata (type: Hash{Symbol=>String}) - Additional headers to be sent with the call.
  • retry_policy (type: Hash) - The retry policy. The value is a hash with the following keys:
    • :initial_delay (type: Numeric) - The initial delay in seconds.
    • :max_delay (type: Numeric) - The max delay in seconds.
    • :multiplier (type: Numeric) - The incremental backoff multiplier.
    • :retry_codes (type: Array<String>) - The error codes that should trigger a retry.
Yields
  • (::Google::Cloud.configure.dataproc)
Returns
  • (::Google::Cloud::Config) — The default configuration used by this library

.job_controller

def self.job_controller(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for JobController.

By default, this returns an instance of Google::Cloud::Dataproc::V1::JobController::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the JobController service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the JobController service. You can determine whether the method will succeed by calling Dataproc.job_controller_available?.

About JobController

The JobController provides methods to manage jobs.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.job_controller_available?

def self.job_controller_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the JobController service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.job_controller. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the JobController service, or if the versioned client gem needs an update to support the JobController service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

.node_group_controller

def self.node_group_controller(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for NodeGroupController.

By default, this returns an instance of Google::Cloud::Dataproc::V1::NodeGroupController::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the NodeGroupController service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the NodeGroupController service. You can determine whether the method will succeed by calling Dataproc.node_group_controller_available?.

About NodeGroupController

The NodeGroupControllerService provides methods to manage node groups of Compute Engine managed instances.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.node_group_controller_available?

def self.node_group_controller_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the NodeGroupController service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.node_group_controller. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the NodeGroupController service, or if the versioned client gem needs an update to support the NodeGroupController service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

.session_controller

def self.session_controller(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for SessionController.

By default, this returns an instance of Google::Cloud::Dataproc::V1::SessionController::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the SessionController service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the SessionController service. You can determine whether the method will succeed by calling Dataproc.session_controller_available?.

About SessionController

The SessionController provides methods to manage interactive sessions.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.session_controller_available?

def self.session_controller_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the SessionController service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.session_controller. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the SessionController service, or if the versioned client gem needs an update to support the SessionController service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

.session_template_controller

def self.session_template_controller(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for SessionTemplateController.

By default, this returns an instance of Google::Cloud::Dataproc::V1::SessionTemplateController::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the SessionTemplateController service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the SessionTemplateController service. You can determine whether the method will succeed by calling Dataproc.session_template_controller_available?.

About SessionTemplateController

The SessionTemplateController provides methods to manage session templates.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.session_template_controller_available?

def self.session_template_controller_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the SessionTemplateController service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.session_template_controller. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the SessionTemplateController service, or if the versioned client gem needs an update to support the SessionTemplateController service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

.workflow_template_service

def self.workflow_template_service(version: :v1, transport: :grpc, &block) -> ::Object

Create a new client object for WorkflowTemplateService.

By default, this returns an instance of Google::Cloud::Dataproc::V1::WorkflowTemplateService::Client for a gRPC client for version V1 of the API. However, you can specify a different API version by passing it in the version parameter. If the WorkflowTemplateService service is supported by that API version, and the corresponding gem is available, the appropriate versioned client will be returned. You can also specify a different transport by passing :rest or :grpc in the transport parameter.

Raises an exception if the currently installed versioned client gem for the given API version does not support the given transport of the WorkflowTemplateService service. You can determine whether the method will succeed by calling Dataproc.workflow_template_service_available?.

About WorkflowTemplateService

The API interface for managing Workflow Templates in the Dataproc API.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (::Object) — A client object for the specified version.

.workflow_template_service_available?

def self.workflow_template_service_available?(version: :v1, transport: :grpc) -> boolean

Determines whether the WorkflowTemplateService service is supported by the current client. If true, you can retrieve a client object by calling Dataproc.workflow_template_service. If false, that method will raise an exception. This could happen if the given API version does not exist or does not support the WorkflowTemplateService service, or if the versioned client gem needs an update to support the WorkflowTemplateService service.

Parameters
  • version (::String, ::Symbol) (defaults to: :v1) — The API version to connect to. Optional. Defaults to :v1.
  • transport (:grpc, :rest) (defaults to: :grpc) — The transport to use. Defaults to :grpc.
Returns
  • (boolean) — Whether the service is available.

Constants

VERSION

value: "2.7.0"