Version history

Version 5.9.0, released 2024-02-28

No API surface changes; just dependency updates.

Version 5.8.0, released 2023-11-07

New features

  • Support required_registration_fraction for secondary workers (commit cccf5b6)

Version 5.7.0, released 2023-09-18

New features

  • Add optional parameters (tarball_gcs_dir, diagnosis_interval, jobs, yarn_application_ids) in DiagnoseClusterRequest (commit adf57b2)

Version 5.6.0, released 2023-08-23

New features

  • Support min_num_instances for primary worker and InstanceFlexibilityPolicy for secondary worker (commit 1783572)

Documentation improvements

Version 5.5.0, released 2023-03-20

New features

Version 5.4.0, released 2023-01-19

New features

Version 5.3.0, released 2023-01-16

New features

Version 5.2.0, released 2022-12-14

New features

Version 5.1.0, released 2022-10-03

New features

Version 5.0.0, released 2022-06-08

This is the first version of this package to depend on GAX v4.

There are some breaking changes, both in GAX v4 and in the generated code. The changes that aren't specific to any given API are described in the Google Cloud documentation. We don't anticipate any changes to most customer code, but please file a GitHub issue if you run into problems.

The most important change in this release is the use of the Grpc.Net.Client package for gRPC communication, instead of Grpc.Core. When using .NET Core 3.1 or .NET 5.0+ this should lead to a smaller installation footprint and greater compatibility (e.g. with Apple M1 chips). Any significant change in a core component comes with the risk of incompatibility, however - so again, please let us know if you encounter any issues.

Version 4.0.0, released 2022-02-17

New features

  • Add support for Virtual Dataproc cluster running on GKE cluster (commit 462556b)

Breaking changes

  • ClusterConfig.GkeClusterConfig has been removed
  • GkeClusterConfig.NamespacedGkeDeploymentTarget has been removed (along with the corresponding nested type)

Version 3.4.0, released 2022-01-17

New features

Version 3.2.0, released 2021-08-19

  • Commit ac367e2: feat: Regenerate all APIs to support self-signed JWTs

Version 3.1.0, released 2021-04-29

  • Commit d429843:
    • feat: The new start and stop cluster methods.
    • feat: The ability to specify a metastore config in a cluster.
    • feat: The ability to specify a (BETA) GKE cluster when creating a Dataproc cluster.
    • feat: The ability to configure the behavior for private IPv6 cluster networking.
    • feat: The ability to specify node affinity groups for clusters.
    • feat: The ability to specify shielded VM configurations for clusters.
    • feat: Support for service-account based secure multi-tenancy.
    • feat: The ability to specify cluster labels for picking which cluster should run a job.
    • feat: Components for DOCKER, DRUID, FLINK, HBASE, RANGER, and SOLR
    • feat: The ability to specify a DAG timeout for workflows.

Version 3.0.0, released 2020-11-17

  • Commit 0ca05f5: chore: Regenerate all APIs using protoc 3.13 and Grpc.Tools 2.31
  • Commit baae3ab: docs: change relative URLs to absolute URLs to fix broken links.
  • Commit 0ceb9e8: feat: Additional fields for the ClusterConfig and InstanceGroupConfig messages.
  • Commit 9724a7a: fix!: fix LRO annotations for method DiagnoseCluster.
  • Commit 6bde7a3: docs: Regenerate all APIs with service comments in client documentation
  • Commit f83bdf1: fix: Apply timeouts to RPCs without retry
  • Commit bdd321b: docs: change relative URLs to absolute URLs to fix broken links.
  • Commit 947a573: docs: Regenerate all clients with more explicit documentation

Please note the breaking change compared with 2.1.0, in terms of long-running operation response/metadata types.

Version 2.1.0, released 2020-05-04

  • Commit cdd7342: docs: change relative URLs to absolute URLs to fix broken links.
  • Commit e644610:
    • Adds Dataproc Jobs.SubmitJobAsOperation RPC
    • Adds SparkR and Presto job types to WorkflowTemplates
    • Adds new Optional Components
    • Clarifies usage of some APIs
  • Commit edebc2b: fix Dataproc: add missing REQUIRED annotation.
  • Commit bd045c2: Adds resource name overloads for autoscaling policy operations

Version 2.0.0, released 2020-03-17

  • Commit c120b77:
    • Feature: SparkR and Presto job support
    • Feature: Lifecycle config support
    • Feature: Reservation affinity support
  • Commit 5ae3789: Breaking changes around resource names, due to removing RegionOrLocationName

Note that the breaking change here was expected; RegionOrLocationName didn't represent the name of a real resource, and we now have better options for handling parents of resources with multiple patterns.

Version 2.0.0-beta01, released 2020-02-18

This is the first prerelease targeting GAX v3. Please see the breaking changes guide for details of changes to both GAX and code generation.

Additional changes:

Version 1.1.0, released 2019-12-09

Version 1.0.0, released 2019-07-10

Initial GA release.