Package @google-cloud/dataproc

Stay organized with collections Save and categorize content based on your preferences.


Represents a CustomHttpPattern.

Represents a Http.

Represents a HttpRule.

Represents a ResourceDescriptor.

Represents a ResourceReference.

Represents an AcceleratorConfig.

Represents an AutoscalingConfig.

Represents an AutoscalingPolicy.

Represents an AutoscalingPolicyService

Represents a BasicAutoscalingAlgorithm.

Represents a BasicYarnAutoscalingConfig.

Represents a Batch.

Represents a StateHistory.

Represents a BatchController

Represents a BatchOperationMetadata.

Represents a CancelJobRequest.

Represents a Cluster.

Represents a ClusterConfig.

Represents a ClusterController

Represents a ClusterMetrics.

Represents a ClusterOperation.

Represents a ClusterOperationMetadata.

Represents a ClusterOperationStatus.

Represents a ClusterSelector.

Represents a ClusterStatus.

Represents a ConfidentialInstanceConfig.

Represents a CreateAutoscalingPolicyRequest.

Represents a CreateBatchRequest.

Represents a CreateClusterRequest.

Represents a CreateWorkflowTemplateRequest.

Represents a DeleteAutoscalingPolicyRequest.

Represents a DeleteBatchRequest.

Represents a DeleteClusterRequest.

Represents a DeleteJobRequest.

Represents a DeleteWorkflowTemplateRequest.

Represents a DiagnoseClusterRequest.

Represents a DiagnoseClusterResults.

Represents a DiskConfig.

Represents an EncryptionConfig.

Represents an EndpointConfig.

Represents an EnvironmentConfig.

Represents an ExecutionConfig.

Represents a GceClusterConfig.

Represents a GetAutoscalingPolicyRequest.

Represents a GetBatchRequest.

Represents a GetClusterRequest.

Represents a GetJobRequest.

Represents a GetWorkflowTemplateRequest.

Represents a GkeClusterConfig.

Represents a NamespacedGkeDeploymentTarget.

Represents a HadoopJob.

Represents a HiveJob.

Represents an IdentityConfig.

Represents an InstanceGroupAutoscalingPolicyConfig.

Represents an InstanceGroupConfig.

Represents an InstantiateInlineWorkflowTemplateRequest.

Represents an InstantiateWorkflowTemplateRequest.

Represents a Job.

Represents a JobController

Represents a JobMetadata.

Represents a JobPlacement.

Represents a JobReference.

Represents a JobScheduling.

Represents a JobStatus.

Represents a KerberosConfig.

Represents a LifecycleConfig.

Represents a ListAutoscalingPoliciesRequest.

Represents a ListAutoscalingPoliciesResponse.

Represents a ListBatchesRequest.

Represents a ListBatchesResponse.

Represents a ListClustersRequest.

Represents a ListClustersResponse.

Represents a ListJobsRequest.

Represents a ListJobsResponse.

Represents a ListWorkflowTemplatesRequest.

Represents a ListWorkflowTemplatesResponse.

Represents a LoggingConfig.

Represents a ManagedCluster.

Represents a ManagedGroupConfig.

Represents a MetastoreConfig.

Represents a NodeGroupAffinity.

Represents a NodeInitializationAction.

Represents an OrderedJob.

Represents a ParameterValidation.

Represents a PeripheralsConfig.

Represents a PigJob.

Represents a PrestoJob.

Represents a PySparkBatch.

Represents a PySparkJob.

Represents a QueryList.

Represents a RegexValidation.

Represents a ReservationAffinity.

Represents a RuntimeConfig.

Represents a RuntimeInfo.

Represents a SecurityConfig.

Represents a ShieldedInstanceConfig.

Represents a SoftwareConfig.

Represents a SparkBatch.

Represents a SparkHistoryServerConfig.

Represents a SparkJob.

Represents a SparkRBatch.

Represents a SparkRJob.

Represents a SparkSqlBatch.

Represents a SparkSqlJob.

Represents a StartClusterRequest.

Represents a StopClusterRequest.

Represents a SubmitJobRequest.

Represents a TemplateParameter.

Represents an UpdateAutoscalingPolicyRequest.

Represents an UpdateClusterRequest.

Represents an UpdateJobRequest.

Represents an UpdateWorkflowTemplateRequest.

Represents a ValueValidation.

Represents a WorkflowGraph.

Represents a WorkflowMetadata.

Represents a WorkflowNode.

Represents a WorkflowTemplate.

Represents a WorkflowTemplatePlacement.

Represents a WorkflowTemplateService

Represents a YarnApplication.

Represents a CancelOperationRequest.

Represents a DeleteOperationRequest.

Represents a GetOperationRequest.

Represents a ListOperationsRequest.

Represents a ListOperationsResponse.

Represents an Operation.

Represents an OperationInfo.

Represents an Operations

Represents a WaitOperationRequest.

Represents an Any.

Represents a DescriptorProto.

Represents an ExtensionRange.

Represents a ReservedRange.

Represents a Duration.

Represents an Empty.

Represents an EnumDescriptorProto.

Represents an EnumReservedRange.

Represents an EnumOptions.

Represents an EnumValueDescriptorProto.

Represents an EnumValueOptions.

Represents an ExtensionRangeOptions.

Represents a FieldDescriptorProto.

Represents a FieldMask.

Represents a FieldOptions.

Represents a FileDescriptorProto.

Represents a FileDescriptorSet.

Represents a FileOptions.

Represents a GeneratedCodeInfo.

Represents an Annotation.

Represents a MessageOptions.

Represents a MethodDescriptorProto.

Represents a MethodOptions.

Represents an OneofDescriptorProto.

Represents an OneofOptions.

Represents a ServiceDescriptorProto.

Represents a ServiceOptions.

Represents a SourceCodeInfo.

Represents a Location.

Represents a Timestamp.

Represents an UninterpretedOption.

Represents a NamePart.

Represents a Status.


The API interface for managing autoscaling policies in the Dataproc API. v1


The BatchController provides methods to manage batch workloads. v1


The ClusterControllerService provides methods to manage clusters of Compute Engine instances. v1


The JobController provides methods to manage jobs. v1


The API interface for managing Workflow Templates in the Dataproc API. v1


Properties of a CustomHttpPattern.

Properties of a Http.

Properties of a HttpRule.

Properties of a ResourceDescriptor.

Properties of a ResourceReference.

Properties of a StateHistory.

Properties of a NamespacedGkeDeploymentTarget.

Properties of an AcceleratorConfig.

Properties of an AutoscalingConfig.

Properties of an AutoscalingPolicy.

Properties of a BasicAutoscalingAlgorithm.

Properties of a BasicYarnAutoscalingConfig.

Properties of a Batch.

Properties of a BatchOperationMetadata.

Properties of a CancelJobRequest.

Properties of a Cluster.

Properties of a ClusterConfig.

Properties of a ClusterMetrics.

Properties of a ClusterOperation.

Properties of a ClusterOperationMetadata.

Properties of a ClusterOperationStatus.

Properties of a ClusterSelector.

Properties of a ClusterStatus.

Properties of a ConfidentialInstanceConfig.

Properties of a CreateAutoscalingPolicyRequest.

Properties of a CreateBatchRequest.

Properties of a CreateClusterRequest.

Properties of a CreateWorkflowTemplateRequest.

Properties of a DeleteAutoscalingPolicyRequest.

Properties of a DeleteBatchRequest.

Properties of a DeleteClusterRequest.

Properties of a DeleteJobRequest.

Properties of a DeleteWorkflowTemplateRequest.

Properties of a DiagnoseClusterRequest.

Properties of a DiagnoseClusterResults.

Properties of a DiskConfig.

Properties of an EncryptionConfig.

Properties of an EndpointConfig.

Properties of an EnvironmentConfig.

Properties of an ExecutionConfig.

Properties of a GceClusterConfig.

Properties of a GetAutoscalingPolicyRequest.

Properties of a GetBatchRequest.

Properties of a GetClusterRequest.

Properties of a GetJobRequest.

Properties of a GetWorkflowTemplateRequest.

Properties of a GkeClusterConfig.

Properties of a HadoopJob.

Properties of a HiveJob.

Properties of an IdentityConfig.

Properties of an InstanceGroupAutoscalingPolicyConfig.

Properties of an InstanceGroupConfig.

Properties of an InstantiateInlineWorkflowTemplateRequest.

Properties of an InstantiateWorkflowTemplateRequest.

Properties of a Job.

Properties of a JobMetadata.

Properties of a JobPlacement.

Properties of a JobReference.

Properties of a JobScheduling.

Properties of a JobStatus.

Properties of a KerberosConfig.

Properties of a LifecycleConfig.

Properties of a ListAutoscalingPoliciesRequest.

Properties of a ListAutoscalingPoliciesResponse.

Properties of a ListBatchesRequest.

Properties of a ListBatchesResponse.

Properties of a ListClustersRequest.

Properties of a ListClustersResponse.

Properties of a ListJobsRequest.

Properties of a ListJobsResponse.

Properties of a ListWorkflowTemplatesRequest.

Properties of a ListWorkflowTemplatesResponse.

Properties of a LoggingConfig.

Properties of a ManagedCluster.

Properties of a ManagedGroupConfig.

Properties of a MetastoreConfig.

Properties of a NodeGroupAffinity.

Properties of a NodeInitializationAction.

Properties of an OrderedJob.

Properties of a ParameterValidation.

Properties of a PeripheralsConfig.

Properties of a PigJob.

Properties of a PrestoJob.

Properties of a PySparkBatch.

Properties of a PySparkJob.

Properties of a QueryList.

Properties of a RegexValidation.

Properties of a ReservationAffinity.

Properties of a RuntimeConfig.

Properties of a RuntimeInfo.

Properties of a SecurityConfig.

Properties of a ShieldedInstanceConfig.

Properties of a SoftwareConfig.

Properties of a SparkBatch.

Properties of a SparkHistoryServerConfig.

Properties of a SparkJob.

Properties of a SparkRBatch.

Properties of a SparkRJob.

Properties of a SparkSqlBatch.

Properties of a SparkSqlJob.

Properties of a StartClusterRequest.

Properties of a StopClusterRequest.

Properties of a SubmitJobRequest.

Properties of a TemplateParameter.

Properties of an UpdateAutoscalingPolicyRequest.

Properties of an UpdateClusterRequest.

Properties of an UpdateJobRequest.

Properties of an UpdateWorkflowTemplateRequest.

Properties of a ValueValidation.

Properties of a WorkflowGraph.

Properties of a WorkflowMetadata.

Properties of a WorkflowNode.

Properties of a WorkflowTemplate.

Properties of a WorkflowTemplatePlacement.

Properties of a YarnApplication.

Properties of a CancelOperationRequest.

Properties of a DeleteOperationRequest.

Properties of a GetOperationRequest.

Properties of a ListOperationsRequest.

Properties of a ListOperationsResponse.

Properties of an Operation.

Properties of an OperationInfo.

Properties of a WaitOperationRequest.

Properties of an ExtensionRange.

Properties of a ReservedRange.

Properties of an EnumReservedRange.

Properties of an Annotation.

Properties of an Any.

Properties of a DescriptorProto.

Properties of a Duration.

Properties of an Empty.

Properties of an EnumDescriptorProto.

Properties of an EnumOptions.

Properties of an EnumValueDescriptorProto.

Properties of an EnumValueOptions.

Properties of an ExtensionRangeOptions.

Properties of a FieldDescriptorProto.

Properties of a FieldMask.

Properties of a FieldOptions.

Properties of a FileDescriptorProto.

Properties of a FileDescriptorSet.

Properties of a FileOptions.

Properties of a GeneratedCodeInfo.

Properties of a MessageOptions.

Properties of a MethodDescriptorProto.

Properties of a MethodOptions.

Properties of an OneofDescriptorProto.

Properties of an OneofOptions.

Properties of a ServiceDescriptorProto.

Properties of a ServiceOptions.

Properties of a SourceCodeInfo.

Properties of a Timestamp.

Properties of an UninterpretedOption.

Properties of a Location.

Properties of a NamePart.

Properties of a Status.


FieldBehavior enum.

History enum.

Style enum.

State enum.

BatchOperationType enum.

State enum.

State enum.

Substate enum.

Component enum.

FailureAction enum.

PrivateIpv6GoogleAccess enum.

Preemptibility enum.

State enum.

Substate enum.

JobStateMatcher enum.

Level enum.

Type enum.

State enum.

NodeState enum.

State enum.

Label enum.

Type enum.

CType enum.

JSType enum.

OptimizeMode enum.

IdempotencyLevel enum.



_default: {
    v1: typeof v1;
    AutoscalingPolicyServiceClient: typeof v1.AutoscalingPolicyServiceClient;
    BatchControllerClient: typeof v1.BatchControllerClient;
    ClusterControllerClient: typeof v1.ClusterControllerClient;
    JobControllerClient: typeof v1.JobControllerClient;
    WorkflowTemplateServiceClient: typeof v1.WorkflowTemplateServiceClient;


AutoscalingPolicyServiceClient: typeof v1.AutoscalingPolicyServiceClient


BatchControllerClient: typeof v1.BatchControllerClient


ClusterControllerClient: typeof v1.ClusterControllerClient


JobControllerClient: typeof v1.JobControllerClient


WorkflowTemplateServiceClient: typeof v1.WorkflowTemplateServiceClient

Type Aliases


declare type AutoscalingPolicyServiceClient = v1.AutoscalingPolicyServiceClient;


declare type BatchControllerClient = v1.BatchControllerClient;


declare type ClusterControllerClient = v1.ClusterControllerClient;


declare type JobControllerClient = v1.JobControllerClient;

type CreateAutoscalingPolicyCallback = (error: (Error|null), response?: => void;

Callback as used by .

type DeleteAutoscalingPolicyCallback = (error: (Error|null), response?: google.protobuf.Empty) => void;

Callback as used by .

type GetAutoscalingPolicyCallback = (error: (Error|null), response?: => void;

Callback as used by .

type ListAutoscalingPoliciesCallback = (error: (Error|null), response?: => void;

Callback as used by .

type UpdateAutoscalingPolicyCallback = (error: (Error|null), response?: => void;

Callback as used by .

type CreateBatchCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type DeleteBatchCallback = (error: (Error|null), response?: google.protobuf.Empty) => void;

Callback as used by .

type GetBatchCallback = (error: (Error|null), response?: => void;

Callback as used by .

type ListBatchesCallback = (error: (Error|null), response?: => void;

Callback as used by .

type CreateClusterCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type DeleteClusterCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type DiagnoseClusterCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type GetClusterCallback = (error: (Error|null), response?: => void;

Callback as used by .

type ListClustersCallback = (error: (Error|null), response?: => void;

Callback as used by .

type StartClusterCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type StopClusterCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type UpdateClusterCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type CancelJobCallback = (error: (Error|null), response?: => void;

Callback as used by .

type DeleteJobCallback = (error: (Error|null), response?: google.protobuf.Empty) => void;

Callback as used by .

type GetJobCallback = (error: (Error|null), response?: => void;

Callback as used by .

type ListJobsCallback = (error: (Error|null), response?: => void;

Callback as used by .

type SubmitJobAsOperationCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type SubmitJobCallback = (error: (Error|null), response?: => void;

Callback as used by .

type UpdateJobCallback = (error: (Error|null), response?: => void;

Callback as used by .

type CreateWorkflowTemplateCallback = (error: (Error|null), response?: => void;

Callback as used by .

type DeleteWorkflowTemplateCallback = (error: (Error|null), response?: google.protobuf.Empty) => void;

Callback as used by .

type GetWorkflowTemplateCallback = (error: (Error|null), response?: => void;

Callback as used by .

type InstantiateInlineWorkflowTemplateCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type InstantiateWorkflowTemplateCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type ListWorkflowTemplatesCallback = (error: (Error|null), response?: => void;

Callback as used by .

type UpdateWorkflowTemplateCallback = (error: (Error|null), response?: => void;

Callback as used by .

type CancelOperationCallback = (error: (Error|null), response?: google.protobuf.Empty) => void;

Callback as used by .

type DeleteOperationCallback = (error: (Error|null), response?: google.protobuf.Empty) => void;

Callback as used by .

type GetOperationCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .

type ListOperationsCallback = (error: (Error|null), response?: google.longrunning.ListOperationsResponse) => void;

Callback as used by .

type WaitOperationCallback = (error: (Error|null), response?: google.longrunning.Operation) => void;

Callback as used by .


declare type WorkflowTemplateServiceClient = v1.WorkflowTemplateServiceClient;