Changelog

PyPI History

5.3.0 (2023-01-23)

Features

  • Add SPOT to Preemptibility enum (8d5e6d8)

Bug Fixes

  • Add context manager return types (8d5e6d8)

Documentation

  • Add documentation for enums (8d5e6d8)

5.2.0 (2023-01-10)

Features

5.1.0 (2023-01-07)

Features

  • Add support for google.cloud.dataproc.__version__ (b3b13c4)

  • Add typing to proto.Message based class attributes (b3b13c4)

  • Added node groups API protos (b3b13c4)

Bug Fixes

  • Add dict typing for client_options (b3b13c4)

  • deps: Require google-api-core >=1.34.0, >=2.11.0 (b3b13c4)

  • Drop usage of pkg_resources (b3b13c4)

  • Fix timeout default values (b3b13c4)

Documentation

  • samples: Snippetgen handling of repeated enum field (b3b13c4)

  • samples: Snippetgen should call await on the operation coroutine before calling result (b3b13c4)

5.0.3 (2022-10-07)

Bug Fixes

5.0.2 (2022-10-03)

Bug Fixes

5.0.1 (2022-08-11)

Bug Fixes

  • deps: allow protobuf < 5.0.0 (#456) (a446937)

  • deps: require proto-plus >= 1.22.0 (a446937)

5.0.0 (2022-07-19)

⚠ BREAKING CHANGES

  • Move yarn_config into a oneof

  • Remove temp_bucket from VirtualClusterConfig, as its value was not used

Features

Bug Fixes

  • deps: require google-api-core>=1.32.0,>=2.8.0 (#400) (61a23fa)

  • Move yarn_config into a oneof (61a23fa)

  • Remove temp_bucket from VirtualClusterConfig, as its value was not used (61a23fa)

  • require python 3.7+ (#442) (9862ff7)

4.0.3 (2022-06-03)

Bug Fixes

Documentation

  • fix changelog header to consistent size (#424) (00162f0)

4.0.2 (2022-04-06)

Bug Fixes

4.0.1 (2022-03-05)

Bug Fixes

  • deps: require google-api-core>=1.31.5, >=2.3.2 (#357) (3c66f42)

  • deps: require proto-plus>=1.15.0 (3c66f42)

4.0.0 (2022-02-26)

⚠ BREAKING CHANGES

  • add support for Virtual Dataproc cluster running on GKE cluster (#344)

Features

  • add support for Virtual Dataproc cluster running on GKE cluster (#344) (116077b)

Bug Fixes

  • move GkeClusterConfig to google.cloud.dataproc_v1.types.shared (116077b)

  • remove namespaced_gke_deployment_target (116077b)

3.3.0 (2022-02-18)

Features

Bug Fixes

  • resolve DuplicateCredentialArgs error when using credentials_file (452460f)

Documentation

3.2.0 (2022-01-17)

Features

  • add Spark runtime versioning for Spark batches (#318) (f2e35d9)

  • auto-diagnostic of failed Spark batches (f2e35d9)

  • custom image containers for Spark batches (f2e35d9)

  • local SSD NVME interface support for GCE clusters (f2e35d9)

3.1.1 (2021-11-01)

Bug Fixes

  • deps: drop packaging dependency (d4919c0)

  • deps: require google-api-core >= 1.28.0 (d4919c0)

Documentation

  • list oneofs in docstring (d4919c0)

3.1.0 (2021-10-26)

Features

  • add context manager support in client (#285) (b54fb76)

  • add Dataproc Serverless for Spark Batches API (#290) (f0ed26c)

  • Add support for dataproc BatchController service (#291) (24a6f7d)

  • add support for python 3.10 (#289) (229f919)

3.0.0 (2021-10-04)

Features

  • delete deprecated Dataproc v1beta2 API client (3bdeaa7)

Bug Fixes

  • add ‘dict’ annotation type to ‘request’ (be5c115)

  • improper types in pagers generation (1ae784b)

Miscellaneous Chores

Documentation

2.6.0 (2021-09-21)

Features

  • delete deprecated Dataproc v1beta2 API client (#253) (b0db6da)

Documentation

2.5.0 (2021-07-24)

Features

Bug Fixes

  • Attribute error Name while executing the sample code (#205) (cb0328f)

  • deps: pin ‘google-{api,cloud}-core’, ‘google-auth’ to allow 2.x versions (#227) (5acfcd0)

  • disable always_use_jwt_access (#215) (a57e253)

  • enable self signed jwt for grpc (#233) (7df4fef)

Documentation

  • omit mention of Python 2.7 in ‘CONTRIBUTING.rst’ (#1127) (#201) (feea064)

  • add Samples section to CONTRIBUTING.rst (#228) (3e248c2)

2.4.0 (2021-05-20)

Features

  • add ‘from_service_account_info’ factory to clients (6525f86)

  • support self-signed JWT flow for service accounts (5137a6f)

  • update the Dataproc V1 API client library (5137a6f)

Bug Fixes

  • add async client to %name_%version/init.py (5137a6f)

  • fix sphinx identifiers (6525f86)

  • use correct retry deadlines (#122) (6525f86)

2.3.1 (2021-03-27)

Bug Fixes

  • (samples) fixing samples for new machine types (#150) (3343665)

Documentation

2.3.0 (2021-03-01)

Features

  • v1beta1: BREAKING CHANGE: remove DOCKER/FLINK from Component enum; adds HBASE (#108) (ee093a8)

Bug Fixes

  • remove gRPC send/recv limits; expose client transport (#117) (6f27109)

2.2.0 (2020-11-16)

Features

2.0.2 (2020-09-16)

Documentation

2.0.1 (2020-09-14)

Documentation

  • remove example usage from README (#77) (66c7af1)

2.0.0 (2020-08-10)

⚠ BREAKING CHANGES

  • migrate to use microgen (#71)

Features

1.1.1 (2020-08-10)

Documentation

  • change relative URLs to absolute URLs to fix broken links (#65) (65c2771)

1.1.0 (2020-07-31)

Features

  • add support for temp_bucket, endpoint_config in clusters; add preemptibility for instance group configs (#60) (a80fc72)

1.0.1 (2020-07-16)

Bug Fixes

  • correct protobuf type for diagnose_cluster, update retry configs (#55) (822315e)

1.0.0 (2020-06-17)

Features

0.8.1 (2020-06-05)

Bug Fixes

  • increase timeout for ClusterController in v1 (#36) (3137bee)

0.8.0 (2020-05-19)

Features

  • add SparkR and Presto jobs to WorkflowTemplates; add new optional components; add submit_job_as_operation to v1 (via synth) (#21) (1cf10b6)

0.7.0 (2020-03-05)

Features

  • add lifecycle config and reservation affinity support to v1 (via synth) (#10) (bb36194)

0.6.1

11-12-2019 08:24 PST

Documentation

  • Add python 2 sunset banner to documentation. (#9036)

0.6.0

11-07-2019 16:34 PST

Implementation Changes

  • Tweak proto annotations (via synth). (#9466)

  • Remove send/recv msg size limit (via synth). (#8951)

New Features

  • Add V1 autoscaling policy support; annotate protos (via synth). (#9402)

Documentation

  • Fix intersphinx reference to requests. (#9294)

  • Remove CI for gh-pages, use googleapis.dev for api_core refs. (#9085)

  • Remove compatibility badges from READMEs. (#9035)

  • Update intersphinx mapping for requests. (#8805)

0.5.0

07-24-2019 16:02 PDT

Implementation Changes

  • Allow kwargs to be passed to create_channel (via synth). (#8387)

New Features

  • Add ‘client_options’ support, update list method docstrings (via synth). (#8505)

Dependencies

  • Bump minimum version for google-api-core to 1.14.0. (#8709)

Documentation

  • Link to googleapis.dev documentation in READMEs. (#8705)

  • Add compatibility check badges to READMEs. (#8288)

Internal / Testing Changes

  • Pin black version (via synth). (#8579)

  • Add docs job to publish to googleapis.dev. (#8464)

  • Declare encoding as utf-8 in pb2 files (via synth). (#8349)

  • Add disclaimer to auto-generated template files (via synth). (#8311)

  • Supress checking ‘cov-fail-under’ in nox default session (via synth). (#8237)

0.4.0

05-30-2019 05:52 PDT

Implementation Changes

  • Update docs/conf.py, add routing header to method metadata, fix docstrings (via synth). (#7924)

New Features

  • Add new service features for v1, including autoscaling (via synth). (#8152)

  • Add new service features for v1beta2, including autoscaling (via synth). (#8119)

Documentation

  • Add nox session docs (#7429)

  • Add clarifying comment to blacken nox target. (#7388)

Internal / Testing Changes

  • Re-add import of ‘operations.proto’ to V1 ‘clusters.proto’ (via synth). (#8188)

  • Add empty lines (via synth). (#8054)

  • Remove classifier for Python 3.4 for end-of-life. (#7535)

  • Copy lintified proto files (via synth). (#7465)

0.3.1

02-15-2019 12:36 PST

Implementation Changes

  • Remove unused message exports. (#7266)

  • Protoc-generated serialization update.. (#7079)

  • Trivial housekeeping change to .proto files. (#7067)

Documentation

  • Updated client library documentation URLs. (#7307)

  • Pick up stub docstring fix in GAPIC generator. (#6967)

Internal / Testing Changes

  • Copy proto files alongside protoc versions.

  • Add protos as an artifact to library (#7205)

  • Update copyright headers

0.3.0

12-17-2018 18:20 PST

Implementation Changes

  • Import iam.policy from google.api_core. (#6741)

  • Update cluster_controller_client GAPIC config (via synth). (#6659)

  • Add ‘WorkflowTemplateServiceClient’, optional args; update timeouts (via synth). (#6655)

  • Pick up enum fixes in the GAPIC generator. (#6609)

  • Pick up fixes in GAPIC generator. (#6493)

  • Fix client_info bug, update docstrings. (#6408)

  • Re-generate library using dataproc/synth.py (#6056)

  • Re-generate library using dataproc/synth.py (#5975)

  • Re-generate library using dataproc/synth.py (#5949)

Dependencies

  • Bump minimum api_core version for all GAPIC libs to 1.4.1. (#6391)

Documentation

  • Document Python 2 deprecation (#6910)

  • Update Dataproc docs URL (#6455)

  • Docs: fix GAX fossils (#6264)

  • Docs: normalize use of support level badges (#6159)

  • Dataproc: harmonize / DRY ‘README.rst’ / ‘docs/index.rst’. (#6019)

Internal / Testing Changes

  • Update noxfile.

  • Blacken all gen’d libs (#6792)

  • Omit local deps (#6701)

  • Run black at end of synth.py (#6698)

  • Unblack dataproc gapic and protos.

  • Run Black on Generated libraries (#6666)

  • Add templates for flake8, coveragerc, noxfile, and black. (#6642)

  • Add synth metadata. (#6563)

  • Use new Nox (#6175)

0.2.0

New Features

  • Regenerate v1 endpoint. Add v1beta2 endpoint (#5717)

0.1.2

Implementation Changes

  • Avoid overwriting ‘module’ of messages from shared modules. (#5364)

Internal / Testing Changes

  • Modify system tests to use prerelease versions of grpcio (#5304)

  • Add Test runs for Python 3.7 and remove 3.4 (#5295)

  • Re-enable lint for tests, remove usage of pylint (#4921)

0.1.1

Dependencies

  • Update dependency range for api-core to include v1.0.0 releases (#4944)

Testing and internal changes

  • Re-enable lint for tests, remove usage of pylint (#4921)

  • Normalize all setup.py files (#4909)