Send feedback
Stay organized with collections
Save and categorize content based on your preferences.
Version 4.51.0 keyboard_arrow_down
Changelog
4.51.0 (2024-11-18)
4.50.0 (2024-10-28)
Features
Add ProvisioningModelMix to support mixing of spot and standard instances for secondary workers (492696e )
4.49.0 (2024-10-09)
4.47.0 (2024-09-26)
Features
add resource reference for KMS keys and fix comments (3ec9def )
add support for new Dataproc features (3ec9def )
add support for new Dataproc features (3ec9def )
add support for Spark Connect sessions in Dataproc Serverless for Spark (9a8ad80 )
4.46.0 (2024-09-11)
4.45.0 (2024-08-21)
4.44.0 (2024-07-31)
4.43.0 (2024-06-27)
Features
add the cohort and auto tuning configuration to the batch's RuntimeConfig (666a3ac )
4.42.0 (None)
4.41.0 (2024-05-23)
4.40.0 (2024-05-08)
4.39.0 (2024-04-25)
4.38.0 (2024-04-04)
4.36.0 (2024-03-28)
4.35.0 (2024-03-22)
4.34.0 (2024-03-06)
4.33.0 (2024-02-20)
4.32.0 (2024-02-09)
4.31.0 (2024-01-23)
4.30.0 (2024-01-10)
4.29.0 (2023-12-12)
4.28.0 (2023-12-04)
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.20.0 (#10093 ) (91a4e4e )
4.27.0 (2023-11-06)
Features
support required_registration_fraction for secondary workers (#10031 ) (bb0964c )
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-config to v1.6.1 (#10014 ) (7b1b742 )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.19.0 (#10018 ) (d9b705a )
4.26.0 (2023-10-25)
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-config to v1.6.0 (#9969 ) (9e2be39 )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.18.0 (#9984 ) (9814dc0 )
4.25.0 (2023-10-11)
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-config to v1.5.8 (#9941 ) (f818d26 )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.17.0 (#9942 ) (2cc7888 )
4.24.0 (2023-09-28)
4.22.0 (2023-09-27)
Features
add optional parameters (tarball_gcs_dir, diagnosis_interval, jobs, yarn_application_ids) in DiagnoseClusterRequest (#9836 ) (47f4031 )
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.0 (#9866 ) (aa36b2c )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.16.1 (#9881 ) (8a29511 )
4.21.0 (2023-09-11)
Features
support min_num_instances for primary worker and InstanceFlexibilityPolicy for secondary worker (#9775 ) (6e23c3a )
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.15.0 (#9809 ) (09dbd85 )
4.20.0 (2023-08-08)
Features
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.14.0 (#9722 ) (c7011db )
4.19.0 (2023-07-21)
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-config to v1.5.7 (#9651 ) (c88d623 )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.13.1 (#9655 ) (affebee )
4.18.0 (2023-07-11)
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.13.0 (#9622 ) (3ac3050 )
4.17.0 (2023-06-23)
Dependencies
deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.12.0 (#9577 ) (9e9812a )
4.2.0 (2022-10-24)Features
[analyticsdata] add subject_to_thresholding field to ResponseMetadata type (#8545 ) (8fdc6c1 )
[dataproc] add support for Dataproc metric configuration (#8433 ) (56a23e9 )
add tokens_per_project_per_hour field to PropertyQuota type (8fdc6c1 )
create release please configuration (41b97e6 )
Bug Fixes
deps: update dependency com.google.api.grpc:grpc-google-cloud-dataproc-v1 to v4.0.3 (#8308 ) (7c0b478 )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.2 (#8325 ) (01f492b )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.4 (#8528 ) (bd36199 )deps: update dependency com.google.cloud:libraries-bom to v26.1.1 (#8254 ) (e4760da )owl-bot-staging should not be commited (#8337 ) (c9bb4a9 )
Dependencies
4.1.0 (2022-10-17)Features
[analyticsdata] add subject_to_thresholding field to ResponseMetadata type (#8545 ) (8fdc6c1 )
[dataproc] add support for Dataproc metric configuration (#8433 ) (56a23e9 )
add tokens_per_project_per_hour field to PropertyQuota type (8fdc6c1 )
create release please configuration (41b97e6 )
Bug Fixes
deps: update dependency com.google.api.grpc:grpc-google-cloud-dataproc-v1 to v4.0.3 (#8308 ) (7c0b478 )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.2 (#8325 ) (01f492b )deps: update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.4 (#8528 ) (bd36199 )deps: update dependency com.google.cloud:libraries-bom to v26.1.1 (#8254 ) (e4760da )owl-bot-staging should not be commited (#8337 ) (c9bb4a9 )
Dependencies
4.0.8 (2022-10-06)Dependencies
Update dependency com.google.cloud:google-cloud-storage to v2.13.0 (#955 ) (1e7e031 )
4.0.7 (2022-10-05)Documentation
[owlbot-java] samples do not need deploy plugin and deps upgrade (#1583 ) (#926 ) (3395143 )
Dependencies
Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.4 (#952 ) (42e0c36 )
4.0.6 (2022-09-21)Dependencies
Update dependency com.google.cloud:google-cloud-storage to v2.12.0 (#916 ) (8c6efdd )
4.0.5 (2022-09-16)Dependencies
Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.3 (#915 ) (60c1eeb )
4.0.4 (2022-09-09)Dependencies
Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.2 (#910 ) (687be30 )
4.0.3 (2022-09-06)Dependencies
Update dependency com.google.cloud (d1b284a )
4.0.2 (2022-08-09)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v3 (#892 ) (6eded42 )
update dependency com.google.cloud:google-cloud-storage to v2.10.0 (#894 ) (5b958b6 )
update dependency com.google.cloud:google-cloud-storage to v2.11.0 (#895 ) (213a20c )
update dependency com.google.cloud:google-cloud-storage to v2.11.1 (#896 ) (c530fb6 )
update dependency com.google.cloud:google-cloud-storage to v2.11.2 (#897 ) (b47b000 )
4.0.1 (2022-07-13)Bug Fixes
4.0.0 (2022-07-01)⚠ BREAKING CHANGES
Remove temp_bucket from VirtualClusterConfig, as its value was not used
Features
Enable REST transport for most of Java and Go clients (dd6bebb )
Bug Fixes
Move yarn_config into a oneof (dd6bebb )
Remove temp_bucket from VirtualClusterConfig, as its value was not used (dd6bebb )
update gapic-generator-java with mock service generation fixes (#833 ) (dd6bebb )
3.1.2 (2022-06-23)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.13.0 (#870 ) (de2c213 )
3.1.1 (2022-05-25)Dependencies
update dependency com.google.cloud:google-cloud-storage to v2.7.0 (#862 ) (29cd497 )
3.1.0 (2022-05-23)Features
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.11.0 (#853 ) (00cdc4e )
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.12.0 (#855 ) (b5d889e )
update dependency com.google.cloud:google-cloud-storage to v2.6.1 (#840 ) (fd91c06 )
3.0.4 (2022-04-15)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.10.0 (#836 ) (cdd75d5 )
3.0.3 (2022-04-01)Dependencies
update dependency com.google.cloud:google-cloud-storage to v2.6.0 (#824 ) (72500fd )
3.0.2 (2022-03-29)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.9.0 (#820 ) (7c2e28d )
update dependency com.google.cloud:google-cloud-storage to v2.5.1 (#818 ) (ec6c607 )
3.0.1 (2022-03-09)Dependencies
update dependency com.google.cloud:google-cloud-storage to v2.4.5 (#811 ) (9deba24 )
3.0.0 (2022-03-03)⚠ BREAKING CHANGES
add support for Virtual Dataproc cluster running on GKE cluster (#795)
Features
add support for Virtual Dataproc cluster running on GKE cluster (#795 ) (71aa406 )
Dependencies
update actions/github-script action to v6 (#790 ) (de5ac7b )
update actions/setup-java action to v3 (#798 ) (a054ce8 )
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.8.0 (#804 ) (4b4092b )
update dependency com.google.cloud:google-cloud-storage to v2.4.0 (#782 ) (4754aa0 )
update dependency com.google.cloud:google-cloud-storage to v2.4.4 (#800 ) (bfab095 )
2.3.2 (2022-02-03)Dependencies
java: update actions/github-script action to v5 (#1339 ) (#777 ) (2477ea5 )update dependency com.google.cloud:google-cloud-shared-dependencies to v2.7.0 (#779 ) (6040385 )
update dependency com.google.cloud:google-cloud-storage to v2.2.3 (#765 ) (d4f4a2e )
update dependency com.google.cloud:google-cloud-storage to v2.3.0 (#775 ) (b538d4d )
2.3.1 (2022-01-07)Bug Fixes
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.6.0 (#760 ) (04a07b6 )
update dependency com.google.cloud:google-cloud-storage to v2.2.2 (#748 ) (e5cd53a )
2.3.0 (2021-12-03)Features
Add support for dataproc BatchController service (#719 ) (4556a3f )
Bug Fixes
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.5.0 (#737 ) (e0ea4e9 )
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.5.1 (#743 ) (8efd821 )
update dependency com.google.cloud:google-cloud-storage to v2.2.0 (#729 ) (dc2a3b4 )
update dependency com.google.cloud:google-cloud-storage to v2.2.1 (#738 ) (9449a98 )
2.2.2 (2021-10-20)Dependencies
update dependency com.google.cloud:google-cloud-storage to v2.1.9 (#721 ) (376b0bf )
2.2.1 (2021-10-19)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.4.0 (#716 ) (2ae9ae0 )
update dependency com.google.cloud:google-cloud-storage to v2.1.6 (#701 ) (dc7de22 )
update dependency com.google.cloud:google-cloud-storage to v2.1.7 (#709 ) (dda0313 )
update dependency com.google.cloud:google-cloud-storage to v2.1.8 (#715 ) (91cfd37 )
2.2.0 (2021-09-22)Features
delete deprecated Dataproc v1beta2 API client (#651 ) (1415252 )
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.3.0 (#696 ) (e0e66e1 )
update dependency com.google.cloud:google-cloud-storage to v2.1.4 (#693 ) (d83fee0 )
update dependency com.google.cloud:google-cloud-storage to v2.1.5 (#697 ) (fcd23bf )
2.1.4 (2021-09-16)Dependencies
update dependency com.google.cloud:google-cloud-storage to v2.1.3 (#688 ) (35f38a3 )
2.1.3 (2021-09-14)Dependencies
update dependency com.google.cloud:google-cloud-storage to v2.1.2 (#684 ) (75390d1 )
2.1.2 (2021-09-14)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.2.1 (#679 ) (31ab3b9 )
2.1.1 (2021-09-03)Dependencies
update dependency com.google.cloud:google-cloud-storage to v2.1.1 (#663 ) (461cb95 )
2.1.0 (2021-08-31)Features
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.2.0 (#658 ) (313dab9 )
update dependency com.google.cloud:google-cloud-storage to v2.1.0 (#652 ) (3cc8f67 )
2.0.2 (2021-08-24)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.1.0 (#646 ) (f150209 )
update dependency com.google.cloud:google-cloud-storage to v2.0.2 (#645 ) (ca43a5b )
2.0.1 (2021-08-12)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2.0.1 (#635 ) (bc5162a )
update dependency com.google.cloud:google-cloud-storage to v2.0.1 (#636 ) (12c182b )
2.0.0 (2021-08-09)⚠ BREAKING CHANGES
release gapic-generator-java v2.0.0
Features
release gapic-generator-java v2.0.0 (ff1784f )
1.5.4 (2021-08-09)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v2 (#625 ) (6c7c935 )
update dependency com.google.cloud:google-cloud-storage to v1.118.0 (#604 ) (e2fb23c )
update dependency com.google.cloud:google-cloud-storage to v2 (#629 ) (2541ee5 )
1.5.3 (2021-07-05)Bug Fixes
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v1.4.0 (#593 ) (55fb5f4 )
update dependency com.google.cloud:google-cloud-storage to v1.117.1 (#592 ) (c6e3f76 )
1.5.2 (2021-06-04)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v1.3.0 (#572 ) (525af16 )
1.5.1 (2021-06-02)Dependencies
update dependency com.google.cloud:google-cloud-storage to v1.115.0 (#565 ) (9183a22 )
1.5.0 (2021-05-31)Features
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v1.2.0 (#553 ) (2fe5a5d )
1.4.3 (2021-05-14)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v1.1.0 (#544 ) (67fcadd )
update dependency com.google.cloud:google-cloud-storage to v1.114.0 (#545 ) (94c963c )
1.4.2 (2021-04-26)Dependencies
update dependency com.google.cloud:google-cloud-storage to v1.113.16 (#526 ) (779d5b5 )
1.4.1 (2021-04-23)Bug Fixes
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.21.1 (#515 ) (863dbc9 )
update dependency com.google.cloud:google-cloud-shared-dependencies to v1 (#524 ) (95606d8 )
update dependency com.google.cloud:google-cloud-storage to v1.113.15 (#510 ) (917ea60 )
1.4.0 (2021-04-09)Features
update the Dataproc V1 API client library (#497 ) (3c78a97 )
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.21.0 (#500 ) (bc31368 )
update dependency com.google.cloud:google-cloud-storage to v1.113.14 (#479 ) (81b26b1 )
1.3.0 (2021-03-11)Features
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.20.1 (#475 ) (42f464a )
update dependency com.google.cloud:google-cloud-storage to v1.113.13 (#465 ) (096f64a )
1.2.1 (2021-02-26)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.20.0 (#458 ) (ed4e9eb )
1.2.0 (2021-02-22)Features
v1beta2: remove DOCKER/FLINK enums from Component, add fields to ClusterConfig, InstanceGroupConfig, WorkflowTemplate, WorkflowMetadata (#411 ) (e8025d4 )
Documentation
generate sample code in the Java microgenerator (#437 ) (bb35671 )
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.18.0 (#422 ) (69a78e1 )
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.19.0 (#448 ) (db549f9 )
update dependency com.google.cloud:google-cloud-storage to v1.113.9 (#416 ) (d7503e7 )
1.1.10 (2020-12-16)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.17.0 (#404 ) (6e73894 )
1.1.9 (2020-12-14)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.16.1 (#399 ) (2234430 )
1.1.8 (2020-12-02)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.16.0 (#388 ) (71f7650 )
1.1.7 (2020-11-17)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.15.0 (#370 ) (8b7cb8a )
update dependency com.google.cloud:google-cloud-storage to v1.113.4 (#368 ) (26d4171 )
1.1.6 (2020-10-31)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.14.1 (#358 ) (6a5c477 )
1.1.5 (2020-10-28)Dependencies
update dependency com.google.cloud:google-cloud-storage to v1.113.2 (#346 ) (59ffe90 )
1.1.4 (2020-10-21)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.13.0 (#334 ) (6b9af6c )
1.1.3 (2020-10-19)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.12.1 (#326 ) (31a6573 )
1.1.2 (2020-10-08)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.10.2 (#311 ) (44ac709 )
1.1.1 (2020-09-23)Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.10.0 (#298 ) (7f2088c )
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.9.0 (#278 ) (73d38d9 )
1.1.0 (2020-08-10)Features
Additional fields for the ClusterConfig and InstanceGroupConfig messages. (#253 ) (9f43c64 )
Bug Fixes
fix LRO annotations for method DiagnoseCluster. (#250 ) (50f0ad0 )
migrate to grpc_service_config (#248 ) (bef1b0d )
Dependencies
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.8.2 (#244 ) (f5d3415 )
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.8.3 (#247 ) (b2cb7c6 )
update dependency com.google.cloud:google-cloud-shared-dependencies to v0.8.6 (#259 ) (96f955a )
1.0.0 (2020-06-17)Features
promote to GA (#226 ) (3edcdfc )
deps: adopt flatten plugin and google-cloud-shared-dependencies (#228 ) (31a94aa )
Dependencies
update dependency com.google.protobuf:protobuf-java to v3.12.2 (#192 ) (7762282 )
update dependency io.grpc:grpc-bom to v1.30.0 (#209 ) (141db4b )
Bug Fixes
fix LRO polling and workflow template timeouts (#213 ) (c8ebb39 )
Bug Fixes
dataproc/v1 raise timeouts in gapic v2 (#207 ) (0295e36 )
Documentation
change relative URLs to absolute URLs to fix broken links. (#202 ) (8e2f707 )
Dependencies
update dependency com.google.api:api-common to v1.9.1 (#195 ) (6fe7813 )
update dependency com.google.api:api-common to v1.9.2 (#204 ) (dbae656 )
update dependency com.google.api.grpc:proto-google-common-protos to v1.18.0 (#178 ) (a70d3a5 )
update dependency com.google.cloud:google-cloud-core to v1.93.5 (#196 ) (8867d5a )
update dependency com.google.protobuf:protobuf-java to v3.12.0 (#187 ) (aa7379c )
update dependency io.grpc:grpc-bom to v1.29.0 (#170 ) (6e256fd )
update dependency org.threeten:threetenbp to v1.4.4 (#172 ) (8514a2e )
Dependencies
update dependency com.google.guava:guava-bom to v29 (#147 ) (dae5b3d )
Features
v1: add Jobs.SubmitJobAsOperation, SparkR and Presto job types to WorkflowTemplates (#137 ) (ac18c87 )
Dependencies
update core dependencies (#91 ) (2e8fce0 )
update dependency com.google.cloud:google-cloud-core to v1.93.4 (#127 ) (9dd5f1a )
update dependency org.threeten:threetenbp to v1.4.3 (#111 ) (3d7178b )
⚠ BREAKING CHANGES
Please use AutoscalingPolicyName$Builder.setLocation(String)
Bug Fixes
AutoscalingPolicyName now uses locations instead of regions (#118 ) (48110e6 )
Dependencies
update dependency com.google.api:api-common to v1.9.0 (#113 ) (34b0ec6 )
Features
add LifecycleConfig, ReservationAffinity, SparkRJob, PrestoJob to v1 (ce4bd91 )
Dependencies
update core dependencies (#89 ) (0698b62 )
update dependency com.google.cloud:google-cloud-core to v1.92.5 (574c5c5 )
update dependency com.google.protobuf:protobuf-java to v3.11.4 (86b32ba )
update dependency io.grpc:grpc-bom to v1.27.1 (cb1e4b7 )
Documentation
regen: update sample code to set total timeout, add API client header test (9d7dddc )regen: updated docs from proto comments (#87 ) (b541715 )
Features
add AutoscalingPolicyServiceClient (#66 ) (b612d8e )
Dependencies
update core dependencies (#47 ) (4a7e1de )
update core dependencies (#65 ) (521d6a2 )
update dependency com.google.guava:guava-bom to v28.2-android (#45 ) (231844e )
update dependency com.google.protobuf:protobuf-java to v3.11.3 (#67 ) (5321a0f )
update dependency org.threeten:threetenbp to v1.4.1 (d2af17b )
Documentation
regen: fix javadoc return annotation (#60 ) (28ff392 )
Dependencies
Documentation
regen: updated javadocs from protoc update (#34 ) (a87d161 )regen: updated javadocs from protos (#40 ) (f174b99 )
Features
make repo releasable, add parent/bom (#1 ) (e186726 )
Dependencies
update dependency com.google.cloud:google-cloud-core to v1.91.3 (#22 ) (97c2a37 )
update dependency com.google.protobuf:protobuf-java to v3.11.0 (#23 ) (da12d98 )
update dependency com.google.protobuf:protobuf-java to v3.11.1 (#27 ) (243abd1 )
update gax.version to v1.50.1 (#5 ) (c8aab8a )
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-12-18 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-12-18 UTC."],[],[]]
