Version history

Version 4.0.0, released 2022-02-17

New features

  • Add support for Virtual Dataproc cluster running on GKE cluster (commit 462556b)

Breaking changes

  • ClusterConfig.GkeClusterConfig has been removed
  • GkeClusterConfig.NamespacedGkeDeploymentTarget has been removed (along with the corresponding nested type)

Version 3.4.0, released 2022-01-17

New features

Version 3.2.0, released 2021-08-19

  • Commit ac367e2: feat: Regenerate all APIs to support self-signed JWTs

Version 3.1.0, released 2021-04-29

  • Commit d429843:
    • feat: The new start and stop cluster methods.
    • feat: The ability to specify a metastore config in a cluster.
    • feat: The ability to specify a (BETA) GKE cluster when creating a Dataproc cluster.
    • feat: The ability to configure the behavior for private IPv6 cluster networking.
    • feat: The ability to specify node affinity groups for clusters.
    • feat: The ability to specify shielded VM configurations for clusters.
    • feat: Support for service-account based secure multi-tenancy.
    • feat: The ability to specify cluster labels for picking which cluster should run a job.
    • feat: Components for DOCKER, DRUID, FLINK, HBASE, RANGER, and SOLR
    • feat: The ability to specify a DAG timeout for workflows.

Version 3.0.0, released 2020-11-17

  • Commit 0ca05f5: chore: Regenerate all APIs using protoc 3.13 and Grpc.Tools 2.31
  • Commit baae3ab: docs: change relative URLs to absolute URLs to fix broken links.
  • Commit 0ceb9e8: feat: Additional fields for the ClusterConfig and InstanceGroupConfig messages.
  • Commit 9724a7a: fix!: fix LRO annotations for method DiagnoseCluster.
  • Commit 6bde7a3: docs: Regenerate all APIs with service comments in client documentation
  • Commit f83bdf1: fix: Apply timeouts to RPCs without retry
  • Commit bdd321b: docs: change relative URLs to absolute URLs to fix broken links.
  • Commit 947a573: docs: Regenerate all clients with more explicit documentation

Please note the breaking change compared with 2.1.0, in terms of long-running operation response/metadata types.

Version 2.1.0, released 2020-05-04

  • Commit cdd7342: docs: change relative URLs to absolute URLs to fix broken links.
  • Commit e644610:
    • Adds Dataproc Jobs.SubmitJobAsOperation RPC
    • Adds SparkR and Presto job types to WorkflowTemplates
    • Adds new Optional Components
    • Clarifies usage of some APIs
  • Commit edebc2b: fix Dataproc: add missing REQUIRED annotation.
  • Commit bd045c2: Adds resource name overloads for autoscaling policy operations

Version 2.0.0, released 2020-03-17

  • Commit c120b77:
    • Feature: SparkR and Presto job support
    • Feature: Lifecycle config support
    • Feature: Reservation affinity support
  • Commit 5ae3789: Breaking changes around resource names, due to removing RegionOrLocationName

Note that the breaking change here was expected; RegionOrLocationName didn't represent the name of a real resource, and we now have better options for handling parents of resources with multiple patterns.

Version 2.0.0-beta01, released 2020-02-18

This is the first prerelease targeting GAX v3. Please see the breaking changes guide for details of changes to both GAX and code generation.

Additional changes:

Version 1.1.0, released 2019-12-09

Version 1.0.0, released 2019-07-10

Initial GA release.