Changelog

PyPI History

5.14.0 (2024-10-23)

Features

  • [google-cloud-dataproc] Add ProvisioningModelMix to support mixing of spot and standard instances for secondary workers (#13169) (3fe76c8)

  • Add support for configuration of bootdisk IOPS and throughput when (3fe76c8)

5.13.0 (2024-09-30)

Features

  • add support for Spark Connect sessions in Dataproc Serverless for Spark (0d35003)

Documentation

  • update docs for filter field in ListSessionsRequest (0d35003)

5.12.0 (2024-09-16)

Features

  • [google-cloud-dataproc] Add FLINK metric source for Dataproc Metric Source (2402404)

  • [google-cloud-dataproc] Add kms key input for create cluster API (2402404)

  • [google-cloud-dataproc] add resource reference for KMS keys and fix comments (2402404)

  • [google-cloud-dataproc] Add unreachable output field for LIST batch templates API (2402404)

  • [google-cloud-dataproc] Add unreachable output field for LIST jobs API (2402404)

  • [google-cloud-dataproc] Add unreachable output field for LIST workflow template API (2402404)

  • [google-cloud-dataproc] Allow flink and trino job support for workflow templates API (2402404)

  • [google-cloud-dataproc] Allow flink job support for jobs (2402404)

5.11.0 (2024-09-03)

Features

  • add optional parameters (tarball-access) in DiagnoseClusterRequest (127e5c0)

5.10.2 (2024-07-30)

Bug Fixes

  • Retry and timeout values do not propagate in requests during pagination (ba1064f)

5.10.1 (2024-07-08)

Bug Fixes

5.10.0 (2024-06-27)

Features

  • [google-cloud-dataproc] add the cohort and auto tuning configuration to the batch’s RuntimeConfig (#12823) (bbd627b)

5.9.3 (2024-03-05)

Bug Fixes

5.9.2 (2024-02-22)

Bug Fixes

  • [Many APIs] fix ValueError in test__validate_universe_domain (#12282) (b985096)

  • deps: [Many APIs] Require google-api-core>=1.34.1 (#12306) (1e787f2)

5.9.1 (2024-02-06)

Bug Fixes

  • Add google-auth as a direct dependency (c721248)

  • Add staticmethod decorator to _get_client_cert_source and _get_api_endpoint (c721248)

  • Resolve AttributeError ‘Credentials’ object has no attribute ‘universe_domain’ (c721248)

5.9.0 (2024-02-01)

Features

  • [google-cloud-dataproc] add session and session_template controllers (#12228) (aefb948)

  • Allow users to explicitly configure universe domain (#12239) (8004d15)

5.8.0 (2023-12-07)

Features

  • Add support for python 3.12 (b96013d)

  • Introduce compatibility with native namespace packages (b96013d)

Bug Fixes

  • Require proto-plus >= 1.22.3 (b96013d)

  • Use retry_async instead of retry in async client (b96013d)

5.7.0 (2023-11-02)

Features

  • support required_registration_fraction for secondary workers (#11970) (52d4558)

5.6.0 (2023-09-15)

Features

  • Add optional parameters (tarball_gcs_dir, diagnosis_interval, jobs, yarn_application_ids) in DiagnoseClusterRequest (#560) (59b00aa)

5.5.1 (2023-09-13)

Documentation

5.5.0 (2023-08-23)

Features

  • Support min_num_instances for primary worker and InstanceFlexibilityPolicy for secondary worker (#555) (8ab7c71)

5.4.3 (2023-08-02)

Documentation

5.4.2 (2023-07-04)

Bug Fixes

  • Add async context manager return types (#539) (7c081a6)

5.4.1 (2023-03-23)

Documentation

  • Fix formatting of request arg in docstring (#528) (c7806f5)

5.4.0 (2023-02-17)

Features

  • Add support for new Dataproc features (67bc8a2)

  • Add TrinoJob (67bc8a2)

  • Add UsageMetrics (67bc8a2)

  • Add UsageSnapshot (67bc8a2)

  • Enable “rest” transport in Python for services supporting numeric enums (#519) (f1a9ba7)

5.3.0 (2023-01-23)

Features

  • Add SPOT to Preemptibility enum (8d5e6d8)

Bug Fixes

  • Add context manager return types (8d5e6d8)

Documentation

  • Add documentation for enums (8d5e6d8)

5.2.0 (2023-01-10)

Features

5.1.0 (2023-01-07)

Features

  • Add support for google.cloud.dataproc.__version__ (b3b13c4)

  • Add typing to proto.Message based class attributes (b3b13c4)

  • Added node groups API protos (b3b13c4)

Bug Fixes

  • Add dict typing for client_options (b3b13c4)

  • deps: Require google-api-core >=1.34.0, >=2.11.0 (b3b13c4)

  • Drop usage of pkg_resources (b3b13c4)

  • Fix timeout default values (b3b13c4)

Documentation

  • samples: Snippetgen handling of repeated enum field (b3b13c4)

  • samples: Snippetgen should call await on the operation coroutine before calling result (b3b13c4)

5.0.3 (2022-10-07)

Bug Fixes

5.0.2 (2022-10-03)

Bug Fixes

5.0.1 (2022-08-11)

Bug Fixes

  • deps: allow protobuf < 5.0.0 (#456) (a446937)

  • deps: require proto-plus >= 1.22.0 (a446937)

5.0.0 (2022-07-19)

⚠ BREAKING CHANGES

  • Move yarn_config into a oneof

  • Remove temp_bucket from VirtualClusterConfig, as its value was not used

Features

Bug Fixes

  • deps: require google-api-core>=1.32.0,>=2.8.0 (#400) (61a23fa)

  • Move yarn_config into a oneof (61a23fa)

  • Remove temp_bucket from VirtualClusterConfig, as its value was not used (61a23fa)

  • require python 3.7+ (#442) (9862ff7)

4.0.3 (2022-06-03)

Bug Fixes

Documentation

  • fix changelog header to consistent size (#424) (00162f0)

4.0.2 (2022-04-06)

Bug Fixes

4.0.1 (2022-03-05)

Bug Fixes

  • deps: require google-api-core>=1.31.5, >=2.3.2 (#357) (3c66f42)

  • deps: require proto-plus>=1.15.0 (3c66f42)

4.0.0 (2022-02-26)

⚠ BREAKING CHANGES

  • add support for Virtual Dataproc cluster running on GKE cluster (#344)

Features

  • add support for Virtual Dataproc cluster running on GKE cluster (#344) (116077b)

Bug Fixes

  • move GkeClusterConfig to google.cloud.dataproc_v1.types.shared (116077b)

  • remove namespaced_gke_deployment_target (116077b)

3.3.0 (2022-02-18)

Features

Bug Fixes

  • resolve DuplicateCredentialArgs error when using credentials_file (452460f)

Documentation

3.2.0 (2022-01-17)

Features

  • add Spark runtime versioning for Spark batches (#318) (f2e35d9)

  • auto-diagnostic of failed Spark batches (f2e35d9)

  • custom image containers for Spark batches (f2e35d9)

  • local SSD NVME interface support for GCE clusters (f2e35d9)

3.1.1 (2021-11-01)

Bug Fixes

  • deps: drop packaging dependency (d4919c0)

  • deps: require google-api-core >= 1.28.0 (d4919c0)

Documentation

  • list oneofs in docstring (d4919c0)

3.1.0 (2021-10-26)

Features

  • add context manager support in client (#285) (b54fb76)

  • add Dataproc Serverless for Spark Batches API (#290) (f0ed26c)

  • Add support for dataproc BatchController service (#291) (24a6f7d)

  • add support for python 3.10 (#289) (229f919)

3.0.0 (2021-10-04)

Features

  • delete deprecated Dataproc v1beta2 API client (3bdeaa7)

Bug Fixes

  • add ‘dict’ annotation type to ‘request’ (be5c115)

  • improper types in pagers generation (1ae784b)

Miscellaneous Chores

Documentation

2.6.0 (2021-09-21)

Features

  • delete deprecated Dataproc v1beta2 API client (#253) (b0db6da)

Documentation

2.5.0 (2021-07-24)

Features

Bug Fixes

  • Attribute error Name while executing the sample code (#205) (cb0328f)

  • deps: pin ‘google-{api,cloud}-core’, ‘google-auth’ to allow 2.x versions (#227) (5acfcd0)

  • disable always_use_jwt_access (#215) (a57e253)

  • enable self signed jwt for grpc (#233) (7df4fef)

Documentation

  • omit mention of Python 2.7 in ‘CONTRIBUTING.rst’ (#1127) (#201) (feea064)

  • add Samples section to CONTRIBUTING.rst (#228) (3e248c2)

2.4.0 (2021-05-20)

Features

  • add ‘from_service_account_info’ factory to clients (6525f86)

  • support self-signed JWT flow for service accounts (5137a6f)

  • update the Dataproc V1 API client library (5137a6f)

Bug Fixes

  • add async client to %name_%version/init.py (5137a6f)

  • fix sphinx identifiers (6525f86)

  • use correct retry deadlines (#122) (6525f86)

2.3.1 (2021-03-27)

Bug Fixes

  • (samples) fixing samples for new machine types (#150) (3343665)

Documentation

2.3.0 (2021-03-01)

Features

  • v1beta1: BREAKING CHANGE: remove DOCKER/FLINK from Component enum; adds HBASE (#108) (ee093a8)

Bug Fixes

  • remove gRPC send/recv limits; expose client transport (#117) (6f27109)

2.2.0 (2020-11-16)

Features

2.0.2 (2020-09-16)

Documentation

2.0.1 (2020-09-14)

Documentation

  • remove example usage from README (#77) (66c7af1)

2.0.0 (2020-08-10)

⚠ BREAKING CHANGES

  • migrate to use microgen (#71)

Features

1.1.1 (2020-08-10)

Documentation

  • change relative URLs to absolute URLs to fix broken links (#65) (65c2771)

1.1.0 (2020-07-31)

Features

  • add support for temp_bucket, endpoint_config in clusters; add preemptibility for instance group configs (#60) (a80fc72)

1.0.1 (2020-07-16)

Bug Fixes

  • correct protobuf type for diagnose_cluster, update retry configs (#55) (822315e)

1.0.0 (2020-06-17)

Features

0.8.1 (2020-06-05)

Bug Fixes

  • increase timeout for ClusterController in v1 (#36) (3137bee)

0.8.0 (2020-05-19)

Features

  • add SparkR and Presto jobs to WorkflowTemplates; add new optional components; add submit_job_as_operation to v1 (via synth) (#21) (1cf10b6)

0.7.0 (2020-03-05)

Features

  • add lifecycle config and reservation affinity support to v1 (via synth) (#10) (bb36194)

0.6.1

11-12-2019 08:24 PST

Documentation

  • Add python 2 sunset banner to documentation. (#9036)

0.6.0

11-07-2019 16:34 PST

Implementation Changes

  • Tweak proto annotations (via synth). (#9466)

  • Remove send/recv msg size limit (via synth). (#8951)

New Features

  • Add V1 autoscaling policy support; annotate protos (via synth). (#9402)

Documentation

  • Fix intersphinx reference to requests. (#9294)

  • Remove CI for gh-pages, use googleapis.dev for api_core refs. (#9085)

  • Remove compatibility badges from READMEs. (#9035)

  • Update intersphinx mapping for requests. (#8805)

0.5.0

07-24-2019 16:02 PDT

Implementation Changes

  • Allow kwargs to be passed to create_channel (via synth). (#8387)

New Features

  • Add ‘client_options’ support, update list method docstrings (via synth). (#8505)

Dependencies

  • Bump minimum version for google-api-core to 1.14.0. (#8709)

Documentation

  • Link to googleapis.dev documentation in READMEs. (#8705)

  • Add compatibility check badges to READMEs. (#8288)

Internal / Testing Changes

  • Pin black version (via synth). (#8579)

  • Add docs job to publish to googleapis.dev. (#8464)

  • Declare encoding as utf-8 in pb2 files (via synth). (#8349)

  • Add disclaimer to auto-generated template files (via synth). (#8311)

  • Supress checking ‘cov-fail-under’ in nox default session (via synth). (#8237)

0.4.0

05-30-2019 05:52 PDT

Implementation Changes

  • Update docs/conf.py, add routing header to method metadata, fix docstrings (via synth). (#7924)

New Features

  • Add new service features for v1, including autoscaling (via synth). (#8152)

  • Add new service features for v1beta2, including autoscaling (via synth). (#8119)

Documentation

  • Add nox session docs (#7429)

  • Add clarifying comment to blacken nox target. (#7388)

Internal / Testing Changes

  • Re-add import of ‘operations.proto’ to V1 ‘clusters.proto’ (via synth). (#8188)

  • Add empty lines (via synth). (#8054)

  • Remove classifier for Python 3.4 for end-of-life. (#7535)

  • Copy lintified proto files (via synth). (#7465)

0.3.1

02-15-2019 12:36 PST

Implementation Changes

  • Remove unused message exports. (#7266)

  • Protoc-generated serialization update.. (#7079)

  • Trivial housekeeping change to .proto files. (#7067)

Documentation

  • Updated client library documentation URLs. (#7307)

  • Pick up stub docstring fix in GAPIC generator. (#6967)

Internal / Testing Changes

  • Copy proto files alongside protoc versions.

  • Add protos as an artifact to library (#7205)

  • Update copyright headers

0.3.0

12-17-2018 18:20 PST

Implementation Changes

  • Import iam.policy from google.api_core. (#6741)

  • Update cluster_controller_client GAPIC config (via synth). (#6659)

  • Add ‘WorkflowTemplateServiceClient’, optional args; update timeouts (via synth). (#6655)

  • Pick up enum fixes in the GAPIC generator. (#6609)

  • Pick up fixes in GAPIC generator. (#6493)

  • Fix client_info bug, update docstrings. (#6408)

  • Re-generate library using dataproc/synth.py (#6056)

  • Re-generate library using dataproc/synth.py (#5975)

  • Re-generate library using dataproc/synth.py (#5949)

Dependencies

  • Bump minimum api_core version for all GAPIC libs to 1.4.1. (#6391)

Documentation

  • Document Python 2 deprecation (#6910)

  • Update Dataproc docs URL (#6455)

  • Docs: fix GAX fossils (#6264)

  • Docs: normalize use of support level badges (#6159)

  • Dataproc: harmonize / DRY ‘README.rst’ / ‘docs/index.rst’. (#6019)

Internal / Testing Changes

  • Update noxfile.

  • Blacken all gen’d libs (#6792)

  • Omit local deps (#6701)

  • Run black at end of synth.py (#6698)

  • Unblack dataproc gapic and protos.

  • Run Black on Generated libraries (#6666)

  • Add templates for flake8, coveragerc, noxfile, and black. (#6642)

  • Add synth metadata. (#6563)

  • Use new Nox (#6175)

0.2.0

New Features

  • Regenerate v1 endpoint. Add v1beta2 endpoint (#5717)

0.1.2

Implementation Changes

  • Avoid overwriting ‘module’ of messages from shared modules. (#5364)

Internal / Testing Changes

  • Modify system tests to use prerelease versions of grpcio (#5304)

  • Add Test runs for Python 3.7 and remove 3.4 (#5295)

  • Re-enable lint for tests, remove usage of pylint (#4921)

0.1.1

Dependencies

  • Update dependency range for api-core to include v1.0.0 releases (#4944)

Testing and internal changes

  • Re-enable lint for tests, remove usage of pylint (#4921)

  • Normalize all setup.py files (#4909)