Cloud Storage release notes

This page documents production updates to Cloud Storage. You can periodically check this page for announcements about new or updated features, bug fixes, known issues, and deprecated functionality.

You can see the latest product updates for all of Google Cloud on the Google Cloud page, browse and filter all release notes in the Google Cloud console, or programmatically access release notes in BigQuery.

To get the latest product updates delivered to you, add the URL of this page to your feed reader, or add the feed URL directly.

November 14, 2024

Bucket IP filtering for Cloud Storage is now available in Preview. With bucket IP filtering, you can restrict access to a bucket based on the source IP address of the request and secure your data from unauthorized access.

November 07, 2024

You can now restore soft-deleted buckets. If you delete a bucket with an active soft delete policy, Cloud Storage retains the bucket for the specified soft delete retention duration, during which the bucket can be restored to a live state. To learn more about the bucket restore feature, see Use soft-deleted buckets.

November 04, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.14.0 (2024-10-29)

Features

• Add support for restore token (#2548) (8241e91)
• Adds integration tests for Universe Domain configuration (#2538) (53db6ba)
• Adds integration tests for Universe Domain configuration with (53db6ba)
• storage: Add support for 'skipIfExists' option for downloadMany (#2526) (729efb2)

Go

Changes for storage/internal/apiv2

1.46.0 (2024-10-31)

Features

• storage: Add grpc metrics experimental options (#10984) (5b7397b)

Bug Fixes

• storage: Skip only specific transport tests. (#11016) (d40fbff)
• storage: Update google.golang.org/api to v0.203.0 (8bb87d5)
• storage: WARNING: On approximately Dec 1, 2024, an update to Protobuf will change service registration function signatures to use an interface instead of a concrete type in generated .pb.go files. This change is expected to affect very few if any users of this client library. For more information, see https://togithub.com/googleapis/google-cloud-go/issues/11020. (2b8ca4b)

Miscellaneous Chores

• storage/internal: Remove notification, service account, and hmac RPCS. These API have been migrated to Storage Control and are available via the JSON API. (#11008) (e0759f4)

October 29, 2024

Data Access logs are now compatible with all authenticated browser downloads.

• When an authenticated browser download occurs outside of the Google Cloud console, a resulting Data Access log has its principalEmail and callerIp fields redacted.

October 28, 2024

Additional functionality is now available for the Object Retention Lock and Bucket Lock features:

• You can now enable Object Retention Lock on existing buckets using the Console.

• Enabling Object Retention Lock on a bucket will cause a lien to be placed, at best effort, on the project containing the bucket.

• Buckets can now have Bucket Lock and Object Versioning enabled at the same time.

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-storage

2.44.1 (2024-10-25)

Dependencies

• Update sdk-platform-java dependencies (#2795) (aeb86e5)

2.44.0 (2024-10-23)

Features

• Promote gRPC transport to GA (#2766) (41fd72a)

Bug Fixes

• deps: Update the Java code generator (gapic-generator-java) to 2.47.0 (c517798)
• Fix createFrom resumable upload retry offset calculation (#2771) (1126cdc), closes #2770
• Update gRPC ReadObject retry to avoid double retry (#2765) (1fc57b9)

Dependencies

• Update dependency com.google.apis:google-api-services-storage to v1-rev20241008-2.0.0 (#2776) (0545b5e)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.38.0 (#2787) (a470e88)
• Update gcr.io/cloud-devrel-public-resources/storage-testbench docker tag to v0.48.0 (#2781) (8fa013e)
• Update gcr.io/cloud-devrel-public-resources/storage-testbench docker tag to v0.49.0 (#2782) (a7baffb)
• Update googleapis/sdk-platform-java action to v2.48.0 (#2786) (2893e61)

You can now use the Google Cloud console to get soft delete recommendations for buckets. Soft delete recommendations help you determine when it's best to enable or disable the soft delete feature on a bucket based on impact to cost and security.

October 23, 2024

Announced billing changes for BigQuery users who are accessing Cloud Storage will now take effect February 1, 2025. These changes were originally set to take effect November 1, 2024.

October 22, 2024

Connecting to Cloud Storage using gRPC is generally available (GA). You can use gRPC to interact with Cloud Storage.

You can now emit client-side metrics for gRPC. To learn which metrics are supported and how to emit them, see Use gRPC client-side metrics.

October 21, 2024

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for storage/internal/apiv2

1.45.0 (2024-10-17)

Features

• storage/internal: Adds support for restore token (70d82fe)
• storage: Adding bucket-specific dynamicDelay (#10987) (a807a7e)
• storage: Dynamic read request stall timeout (#10958) (a09f00e)

Documentation

• storage: Remove preview wording from NewGRPCClient (#11002) (40c3a5b)

October 15, 2024

Hierarchical namespace for Cloud Storage buckets is generally available (GA). With hierarchical namespace, you can store your data in a logical file system structure.

October 14, 2024

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-storage

2.43.2 (2024-10-08)

Bug Fixes

• Plumb list blobs match glob option for grpc transport (#2759) (207abd1)

Dependencies

• Update dependency com.google.api:gapic-generator-java to v2.47.0 (#2750) (9041f24)
• Update dependency com.google.apis:google-api-services-storage to v1-rev20240924-2.0.0 (#2719) (7b19831)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.37.0 (#2751) (003d6fa)
• Update googleapis/sdk-platform-java action to v2.47.0 (#2749) (befa415)

October 07, 2024

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for storage/internal/apiv2

1.44.0 (2024-10-03)

Features

• storage/dataflux: Add dataflux interface (#10748) (cb7b0a1)
• storage/dataflux: Add range_splitter #10748 (#10899) (d49da26)
• storage/dataflux: Add worksteal algorithm to fast-listing (#10913) (015b52c)
• storage/internal: Add managed folder to testIamPermissions method (2f0aec8)
• storage/transfermanager: Add option to StripPrefix on directory download (#10894) (607534c)
• storage/transfermanager: Add SkipIfExists option (#10893) (7daa1bd)
• storage/transfermanager: Checksum full object downloads (#10569) (c366c90)
• storage: Add direct google access side-effect imports by default (#10757) (9ad8324)
• storage: Add full object checksum to reader.Attrs (#10538) (245d2ea)
• storage: Add support for Go 1.23 iterators (84461c0)
• storage: Add update time in bucketAttrs (#10710) (5f06ae1), refs #9361
• storage: GA gRPC client (#10859) (c7a55a2)
• storage: Introduce gRPC client-side metrics (#10639) (437bcb1)
• storage: Support IncludeFoldersAsPrefixes for gRPC (#10767) (65bcc59)

Bug Fixes

• storage/transfermanager: Correct Attrs.StartOffset for sharded downloads (#10512) (01a5cbb)
• storage: Add retryalways policy to encryption test (#10644) (59cfd12), refs #10567
• storage: Add unknown host to retriable errors (#10619) (4ec0452)
• storage: Bump dependencies (2ddeb15)
• storage: Bump google.golang.org/grpc@v1.64.1 (8ecc4e9)
• storage: Check for grpc NotFound error in HMAC test (#10645) (3c8e88a)
• storage: Disable grpc metrics using emulator (#10870) (35ad73d)
• storage: Retry gRPC DEADLINE_EXCEEDED errors (#10635) (0018415)
• storage: Update dependencies (257c40b)
• storage: Update google.golang.org/api to v0.191.0 (5b32644)

Performance Improvements

• storage: GRPC zerocopy codec (#10888) (aeba28f)

Documentation

• storage/internal: Clarify possible objectAccessControl roles (2f0aec8)
• storage/internal: Update dual-region bucket link (2f0aec8)

September 30, 2024

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-storage

2.43.1 (2024-09-26)

Bug Fixes

• Add managed folder to testIamPermissions method (556dd95)
• deps: Update the Java code generator (gapic-generator-java) to 2.46.0 (556dd95)
• Remove server unimplemented GrpcStorageImpl#{get,list,create,delete,Update}HmacKey (#2717) (06f7292)
• Remove server unimplemented GrpcStorageImpl#{get,list,create,delete}Notification (#2710) (310c9b2)
• Remove server unimplemented GrpcStorageImpl#getServiceAccount (#2718) (51076a8)
• Update grpc based ReadObject rpcs to remove race condition between cancellation and message handling (#2708) (2c7f088)
• Update grpc upload error diagnostics to be tolerant of receiving an error if no request has been sent (#2732) (fff72d5)
• Update GrpcStorageOptions to attempt direct path by default (#2715) (9de9a92)

Dependencies

• Update dependency com.google.cloud:sdk-platform-java-config to v3.36.0 (#2721) (11f09fe)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.36.1 (#2738) (eb320e1)
• Update googleapis/sdk-platform-java action to v2.46.1 (#2736) (795f2c3)

September 25, 2024

Cross-bucket replication is now available in Cloud Storage. You can use cross-bucket replication to copy new and updated objects asynchronously from a source bucket to a destination bucket. For more information on how to use cross-bucket replication, see Using cross-bucket replication.

September 24, 2024

Cloud Storage is now enabled for use with Cloud KMS Autokey.

Using keys generated by Autokey can help you consistently align with industry standards and recommended practices for data security, including the HSM protection level, separation of duties, key rotation, location, and key specificity. Keys requested using Autokey function identically to other Cloud HSM keys with the same settings.

For more information, see Customer-managed encryption keys. To learn more about Cloud KMS Autokey, see Autokey overview.

September 23, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.13.0 (2024-09-17)

Features

• storage: Add support for 'fields' query parameter to getFiles (#2521) (f78fe92)

Bug Fixes

• retry: Export RETRYABLE_ERR_FN_DEFAULT (#2517) (db890fd)

Java

Changes for google-cloud-storage

2.43.0 (2024-09-13)

Features

• Allow specifying an expected object size for resumable operations. (#2661) (3405611), closes #2511

Bug Fixes

• Close pending zero-copy responses when Storage#close is called (#2696) (1855308)
• GitHub workflow vulnerable to script injection (#2663) (9151ac2)
• Make ParallelCompositeUploadBlobWriteSessionConfig.ExecutorSupplier#cachedPool a singleton (#2691) (1494809)

Dependencies

• Promote storage-v2 artifacts to beta (9d22597)
• Update dependency com.google.apis:google-api-services-storage to v1-rev20240819-2.0.0 (#2665) (3df1000)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.35.0 (#2698) (1dd51c3)

In order to set a bucket to store Cloud Storage usage logs and storage logs, the bucket must now reside within the same organization as the bucket being logged.

• If the bucket being logged is not associated with an organization, then the bucket storing the logs must reside within the same project instead.

You can now use hierarchical namespace with Cloud Storage FUSE. To learn more about how mounting buckets with hierarchical namespace enabled can help improve performance, see Mount buckets with hierarchical namespace enabled.

September 11, 2024

You can now specify United States regions when using regional endpoints.

September 09, 2024

You can now use the Google Cloud console to do the following:

• Create buckets with hierarchical namespace enabled. To learn more, see Create a bucket.

• Create and manage folders in buckets with hierarchical namespace enabled. To learn more, see Create and manage folders.

• Rename and move folders. To learn more, see Rename and move folders.

August 26, 2024

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-storage

2.42.0 (2024-08-19)

Features

• Enable grpc.lb.locality label for client-side metrics (#2659) (b681ee0)

Bug Fixes

• Update modified field handling for blob and bucket with json transport to properly clear fields (#2664) (e2f5537), closes #2662

Dependencies

• Update dependency com.google.cloud:sdk-platform-java-config to v3.34.0 (#2673) (453c29a)
• Update gcr.io/cloud-devrel-public-resources/storage-testbench docker tag to v0.45.0 (#2667) (1f66dff)

August 12, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.12.1 (2024-08-07)

Bug Fixes

• deps: Update fast-xml-parser to 4.4.1 due to security vulnerability (#2505) (b97d474)

Python

Changes for google-cloud-storage

2.18.2 (2024-08-08)

Bug Fixes

• Add regression test for range read retry issue and bump dependency to fix (#1338) (0323647)

2.18.1 (2024-08-05)

Bug Fixes

• Properly escape URL construction for XML MPU API (#1333) (bf4d0e0)

August 05, 2024

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-storage

2.41.0 (2024-07-31)

Features

• Enable gRPC client open telemetry metrics reporting (#2590) (d153228)

Bug Fixes

• Add UnknownHostException to set of retriable exception (#2651) (18de9fc)
• Update grpc resumable upload error categorization to be more tolerant (#2644) (95697dd)
• Update Storage#readAllBytes to respect shouldReturnRawInputStream option (#2635) (dc883cc)
• Update TransferManager downloads to reduce in memory buffering (#2630) (fc2fd75)
• Use fast calculation for totalRemaining number of bytes from multiple ByteBuffers (#2633) (758b3dd)

Dependencies

• Update dependency com.google.apis:google-api-services-storage to v1-rev20240625-2.0.0 (#2616) (b22babb)
• Update dependency com.google.apis:google-api-services-storage to v1-rev20240706-2.0.0 (#2634) (1ccaa0c)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.33.0 (#2647) (8196259)
• Update dependency net.jqwik:jqwik to v1.9.0 (#2608) (a20eb66)
• Update dependency org.junit.vintage:junit-vintage-engine to v5.10.3 (#2604) (8c79f39)
• Update junit-platform.version to v5.10.3 (#2605) (a532ee4)

You can now use parallel downloads with Cloud Storage FUSE to accelerate read performance of large files over 1 GB in size. When enabled, parallel downloads use multiple workers to download a file in parallel, accelerating file reads. For more information, see Improve read performance using parallel downloads.

August 01, 2024

Beginning November 1, 2024, BigQuery users will start seeing charges for Cloud Storage usage as per pricing documentation, which was not metered before due to a billing bug.

• Retrieval fees for Nearline, Coldline, and Archive storage classes will be charged per existing pricing documentation and retrieval SKUs.

• Inter Region Network Data Transfer fees will be charged when a BigQuery job in one location reads data stored in a Cloud Storage bucket in a different location. These charges are covered by GCP Storage Data Transfer SKUs and Network Data Transfer GCP Inter Region SKUs. Network Data Transfer GCP Multi-region SKUs are not applicable to this change.

• Refer to the announcement for more information.

July 31, 2024

You can now use list caching with Cloud Storage FUSE, which is a cache for directory and file list, or ls, responses that improves list operation speeds. To learn more about list caching and how to enable it, see the Cloud Storage FUSE caching overview page.

You can now use the Google Cloud console to set a default soft delete retention duration. For more information, see Use tags to set a default soft delete retention duration for new buckets.

July 29, 2024

A weekly digest of client library updates from across the Cloud SDK.

Python

Changes for google-cloud-storage

2.18.0 (2024-07-09)

Features

• Add OpenTelemetry Tracing support as a preview feature (#1288) (c2ab0e0)

Bug Fixes

• Allow Protobuf 5.x (#1317) (152b249)
• Correct notification error message (#1290) (1cb977d), closes #1289

July 23, 2024

You can now use tags to set a default soft delete retention duration on newly created buckets in your organization. To learn how to customize a default soft delete retention duration, see Set a default soft delete retention duration.

July 22, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.12.0 (2024-07-15)

Features

• Add function to allow user to set destination in transfer manager (#2497) (dc1e488)

July 15, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.11.3 (2024-07-09)

Bug Fixes

• Error serialization in resumable-upload.ts (#2493) (c2e555c)
• Handle unhandled error in startResumableUpload_ (#2495) (d5257ba)
• Make CreateBucketRequest extend from BucketMetadata to allow all… (#2489) (013a5a4)

July 11, 2024

You can now specify Frankfurt (europe-west3) and Zürich (europe-west6) as a predefined dual-region pairing. For more information, see Predefined dual-regions.

July 08, 2024

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for storage/internal/apiv2

1.43.0 (2024-07-03)

Features

• storage/transfermanager: Add DownloadDirectory (#10430) (0d0e5dd)
• storage/transfermanager: Automatically shard downloads (#10379) (05816f9)

Bug Fixes

• storage/transfermanager: WaitAndClose waits for Callbacks to finish (#10504) (0e81002), refs #10502
• storage: Allow empty soft delete on Create (#10394) (d8bd2c1), refs #10380
• storage: Bump google.golang.org/api@v0.187.0 (8fa9e39)
• storage: Retry broken pipe error (#10374) (2f4daa1), refs #9178

Documentation

• storage/control: Remove allowlist note from Folders RPCs (d6c543c)

You can now specify London (europe-west2) and Frankfurt (europe-west3) as a predefined dual-region pairing. For more information, see Predefined dual-regions.

July 02, 2024

You can now disable soft delete for multiple buckets at a time or for all buckets in a project. To learn more, see Bulk disable soft delete.

July 01, 2024

A weekly digest of client library updates from across the Cloud SDK.

Java

Changes for google-cloud-storage

2.40.1 (2024-06-26)

Bug Fixes

• Add a workaround to make sure grpc clients' hosts always match their universe domain (#2588) (87bf737)
• Include x-goog-user-project on resumable upload puts for grpc transport (#2586) (6f2f504)
• Update grpc bidi resumable uploads to validate ack'd object size (#2570) (5c9cecf)
• Update grpc finalize on close resumable uploads to validate ack'd object size (#2572) (55a6d15)
• Update grpc single-shot uploads to validate ack'd object size (#2567) (65c8808)

Dependencies

• Update dependency com.google.apis:google-api-services-storage to v1-rev20240524-2.0.0 (#2565) (d193243)
• Update dependency com.google.apis:google-api-services-storage to v1-rev20240621-2.0.0 (#2596) (73b8753)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.32.0 (#2597) (25940a4)

Documentation

• Add Hierarchical Namespace Bucket and Folders samples (#2583) (3030081), closes #2569
• Remove allowlist note from Folders RPCs (#2593) (82161de)
• Update DeleteObject Sample to be clearer on object versioning behavior (#2595) (79b7cf0)

June 28, 2024

You can now specify the Frankfurt, Germany (europe-west3) and Paris, France (europe-west9) regions when using regional endpoints.

June 18, 2024

Hierarchical namespace for Cloud Storage buckets is now available in Preview. With hierarchical namespace, you can store your data in a logical file system structure.

Renaming a folder in a bucket with hierarchical namespace enabled using command line is not supported.

June 17, 2024

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for storage/internal/apiv2

1.42.0 (2024-06-10)

Features

• storage: Add new package transfermanager. This package is intended for parallel uploads and downloads, and is in preview. It is not stable, and is likely to change. (#10045) (cde5cbb)
• storage: Add bucket HierarchicalNamespace (#10315) (b92406c), refs #10146
• storage: Add BucketName to BucketHandle (#10127) (203cc59)

Bug Fixes

• storage: Set invocation headers on xml reads (#10250) (c87e1ab)

Documentation

• storage: Update autoclass doc (#10135) (e4b2737)

Python

Changes for google-cloud-storage

2.17.0 (2024-05-22)

Features

• Support HNS enablement in bucket metadata (#1278) (add3c01)
• Support page_size in bucket.list_blobs (#1275) (c52e882)

Bug Fixes

• Remove deprecated methods in samples and tests (#1274) (4db96c9)

Documentation

• Reference Storage Control in readme (#1254) (3d6d369)
• Update DEFAULT_RETRY_IF_GENERATION_SPECIFIED docstrings (#1234) (bdd426a)

June 10, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.11.2 (2024-06-07)

Bug Fixes

• Support uint8array in file.save (#2480) (1477fe1)

Java

Changes for google-cloud-storage

2.40.0 (2024-06-06)

Features

• Promote google-cloud-storage-control to GA (#2575) (129f188)

Bug Fixes

• Reduce Java 21 Virtual Thread Pinning in IO operations (#2553) (498fd0b)

Dependencies

• Update dependency com.google.cloud:sdk-platform-java-config to v3.31.0 (#2571) (67ce3d6)
• Update dependency net.jqwik:jqwik to v1.8.5 (#2563) (88f7d86)

Documentation

• Managed Folders samples (#2562) (5ffc1f2)
• Update javadoc for createFrom (#2522) (dc31e95)

June 06, 2024

Cloud Storage now offers a new pre-defined dual region, EUROPE-WEST2 (London) and EUROPE-WEST1 (Belgium). To learn more about Cloud Storage pre-defined dual regions, see the Bucket locations page.

May 27, 2024

Cloud Storage FUSE now offers the following features:

• You now have the option to disable authentication on custom endpoints using the --anonymous-access flag. For more information about the new global option, see the Cloud Storage FUSE CLI options page.
• Cloud Storage FUSE now supports Rocky Linux versions 8.9 or later. For more information, see Cloud Storage FUSE instructions on how to configure the package manager.
• The Cloud Storage FUSE max-conns-per-host flag has been updated to offer a default value which specifies no limit on TCP connections except for limitations set by your machine's specifications. For more information, see the Cloud Storage FUSE CLI page.

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.11.1 (2024-05-21)

Bug Fixes

• Add missing projectIdentifier to GetServiceAccountOptions (#2468) (d49e9d2)
• Allow files in directories to be downloaded onto local machine (#2199) (9f62429)
• Do not set customEndpoint if apiEndpoint === default (#2460) (b4dbd73)
• Improve GetFilesResponse interface (#2466) (918db28)

Java

Changes for google-cloud-storage

2.39.0 (2024-05-22)

Features

• Plumb PartNamingStrategy for Parallel Composite Uploads in Transfer Manager (#2547) (79d721d)

Bug Fixes

• Update GapicUnbufferedChunkedResumableWritableByteChannel to be tolerant of non-quantum writes (#2537) (1701fde)

Dependencies

• Update dependency com.google.cloud:sdk-platform-java-config to v3.30.1 (#2550) (e9807ec)
• Update dependency org.graalvm.buildtools:native-maven-plugin to v0.10.2 (#2552) (a207829)

May 20, 2024

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for storage/internal/apiv2

1.41.0 (2024-05-13)

Features

• storage/control: Make Managed Folders operations public (264a6dc)
• storage: Support for soft delete policies and restore (#9520) (985deb2)

Bug Fixes

• storage/control: An existing resource pattern value projects/{project}/buckets/{bucket}/managedFolders/{managedFolder=**} to resource definition storage.googleapis.com/ManagedFolder is removed (3e25053)
• storage: Add internaloption.WithDefaultEndpointTemplate (3b41408)
• storage: Bump x/net to v0.24.0 (ba31ed5)
• storage: Disable gax retries for gRPC (#9747) (bbfc0ac)
• storage: More strongly match regex (#9706) (3cfc8eb), refs #9705
• storage: Retry net.OpError on connection reset (#10154) (54fab10), refs #9478
• storage: Wrap error when MaxAttempts is hit (#9767) (9cb262b), refs #9720

Documentation

• storage/control: Update storage control documentation and add PHP for publishing (1d757c6)

May 13, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.11.0 (2024-05-03)

Features

• Add ability to enable hierarchical namespace on buckets (#2453) (4e5726f)

Java

Changes for google-cloud-storage

2.38.0 (2024-05-09)

Features

• Promoted google-cloud-storage-control to beta (#2531) (09f7191)

Bug Fixes

• Add strict client side response validation for gRPC chunked resumable uploads (#2527) (c1d1f4a)
• An existing resource pattern value projects/{project}/buckets/{bucket}/managedFolders/{managedFolder=**} to resource definition storage.googleapis.com/ManagedFolder is removed (#2524) (7d7f526)
• deps: Update the Java code generator (gapic-generator-java) to 2.39.0 (#2501) (518d4be)
• ParallelCompositeUpload in Transfer Manager hangs when encountering OOM (#2526) (67a7c6b)
• Update grpc WriteObject response handling to provide context when a failure happens (#2532) (170a3f5)
• Update GzipReadableByteChannel to be tolerant of one byte reads (#2512) (87b63f4)
• Update StorageOptions to carry forward fields that aren't part of ServiceOptions (#2521) (b84654e)

Dependencies

• Update dependency com.google.cloud:sdk-platform-java-config to v3.30.0 (#2523) (3e573f7)
• Update dependency info.picocli:picocli to v4.7.6 (#2535) (f26888a)

Documentation

• Add in Transfer Manager chunked upload/download samples (#2518) (d1f6bcc)
• Update readme to include gradle instructions for storage control (#2503) (50ac93b)
• Update TransportCompatibility annotation for Storage#blobWriteSession (#2520) (b7d673c)

April 29, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.10.2 (2024-04-26)

Bug Fixes

• Use correct indices for file.from and fix tests to verify names (#2449) (d4240fa)

7.10.1 (2024-04-22)

Bug Fixes

• Change copyoptions type (#2439) (2ebd7ac)
• Expand types of custom metadata within FileMetadata (#2442) (1d434a9)

April 23, 2024

Default replication monitoring for multi-region and dual-region buckets in the Google Cloud console is now available for the following graphs:

• Percent of minutes out of RPO
• Percent of objects out of target
• Meeting RPO

April 22, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.10.0 (2024-04-15)

Features

• Add ability to create a File object from URL (#2432) (1b71fcc)
• Allow setting contentEncoding during compose (#2431) (6e81e05)

Bug Fixes

• Destroy pipeline streams when returned stream errors (#2437) (fe1ac65)
• Remove extraneous mime-types package in favor of mime (#2435) (63a71f2)

Java

Changes for google-cloud-storage

2.37.0 (2024-04-19)

Features

• Adds a ZeroCopy response marshaller for grpc ReadObject handling (#2489) (8c7404d)
• Port BufferToDiskThenUpload to work with HttpStorageOptions (#2473) (d84e255)
• Port DefaultBlobWriteSessionConfig to work with HttpStorageOptions (#2472) (e5772a4)
• Port ParallelCompositeUploadBlobWriteSessionConfig to work with HttpStorageOptions (#2474) (3bf6026)
• Transfer Manager ParallelCompositeUploads (#2494) (8b54549)

Bug Fixes

• Ensure all BlobWriteSession types conform to the semantics specified in BlobWriteSession (#2482) (d47afcf)
• Fix BidiBlobWriteSessionConfigs to respect preconditions (#2481) (955d78a)
• Update ApiaryUnbufferedWritableByteChannel to be graceful of non-quantum aligned write calls (#2493) (f548335)
• Update BidiBlobWriteSessionConfig to respect a provided bufferSize (#2471) (e1fb857)
• Update grpc handling of IAM Policy etag to account for base64 encoding (#2499) (032f2f2)
• Update Grpc Retry Conformance after new additions to testbench (#2309) (09043c5)

Dependencies

• Update dependency com.google.apis:google-api-services-storage to v1-rev20240319-2.0.0 (#2460) (9c2ee90)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.28.1 (#2467) (c12f329)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.29.0 (#2502) (7ed8446)
• Update gcr.io/cloud-devrel-public-resources/storage-testbench docker tag to v0.43.0 (#2459) (2dc4748)
• Update gcr.io/cloud-devrel-public-resources/storage-testbench docker tag to v0.44.0 (#2497) (9b0253c)

Documentation

• Add summary and reference docs for Storage Control API to readme (#2485) (70fd088)
• Create Samples for transfer manager (#2492) (e2030b2)

April 05, 2024

Custom constraints for Cloud Storage are now available. You can use custom constraints to enforce policies on Cloud Storage resources, such as a policy that enforces all buckets to have Object Versioning enabled.

April 03, 2024

Managed folders are now available in the Google Cloud Console.

You can now use managed folders in your Cloud Storage buckets using the Cloud Console. You can create, list, move, and delete your managed folders in the Console, as well as set IAM policies. To learn more, see Create and manage managed folders.

April 01, 2024

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for storage/internal/apiv2

1.40.0 (2024-03-29)

Features

• storage: Implement io.WriterTo in Reader (#9659) (8264a96)
• storage: New storage control client (#9631) (1f4d279)

Bug Fixes

• storage: Retry errors from last recv on uploads (#9616) (b6574aa)
• storage: Update protobuf dep to v1.33.0 (30b038d)

Performance Improvements

• storage: Remove protobuf's copy of data on unmarshalling (#9526) (81281c0)

Google Cloud Storage now offers Dual-region Google Egress Bandwidth quotas per dual-region location. See Bandwidth usage in Cloud Storage.

March 29, 2024

The Storage Control API is now available for use. The Storage Control API lets you perform metadata-specific, control plane, and long-running operations. To learn more about the Storage Control API and operations you can perform, see Storage Control API overview.

March 25, 2024

A weekly digest of client library updates from across the Cloud SDK.

Node.js

Changes for @google-cloud/storage

7.9.0 (2024-03-18)

Features

• Add ability to configure and utilize soft-delete and restore (#2425) (7da5a7d)

Java

Changes for google-cloud-storage

2.36.1 (2024-03-20)

Dependencies

• Update dependency com.google.apis:google-api-services-storage to v1-rev20240311-2.0.0 (#2446) (27b4780)
• Update dependency com.google.cloud:sdk-platform-java-config to v3.28.1 (#2450) (bf35a9a)

Python

Changes for google-cloud-storage

2.16.0 (2024-03-18)

Features

• Add support for soft delete (#1229) (3928aa0)
• Support includeFoldersAsPrefixes (#1223) (7bb8065)

March 18, 2024

You can now use the GCS FUSE file cache feature, a client-based read cache that lets repeat file reads to be served from a faster cache storage of your choice. To learn more about caching, see GCS FUSE caching documentation.

A weekly digest of client library updates from across the Cloud SDK.

Go

Changes for storage/internal/apiv2

1.39.1 (2024-03-11)

Bug Fixes

• storage: Add object validation case and test (#9521) (386bef3)

Java

Changes for google-cloud-storage

2.36.0 (2024-03-15)

Features

• Add Custom Part Metadata Decorator to ParallelCompositeUploadConfig (#2434) (43b8006)
• Add hierarchical namespace and folders features (#2445) (8074fff)
• Add soft delete feature (#2403) (989f36f)

Bug Fixes

• Fix name digest for noprefix (#2448) (12c9db8)
• Missing serialVersionUID of serializable classes (#2344) (736865b)

Dependencies

• Update dependency com.google.apis:google-api-services-storage to v1-rev20240307-2.0.0 (#2442) (1352203)
• Update dependency net.jqwik:jqwik to v1.8.4 (#2447) (110b80c)
• Update gcr.io/cloud-devrel-public-resources/storage-testbench docker tag to v0.42.0 (#2441) (80745d4)

March 12, 2024

You can now view granular bucket-level cost data in the Cloud Billing Detailed data export.

January 31, 2024

Cloud Storage is now available in Johannesburg, South Africa (africa-south1 region).

January 22, 2024

You can now work with the Object Retention Lock feature within the Cloud Console.

January 15, 2024

Newly created organizations now have the uniformBucketLevelAccess constraint enabled by default.

• This lets you build your organization resources in a secure posture from Day 0.
• You can opt out of this constraint. To opt out, contact your organization administrator.

December 07, 2023

Cloud Storage FUSE now provides the ability to configure log rotation.

December 04, 2023

The restrict unencrypted HTTP requests organization policy constraint is now generally available (GA). This constraint blocks all unencrypted HTTP access to Cloud Storage resources.

November 21, 2023

The Object Retention Lock feature is now available.

• Using this feature, you can place a retention configuration on individual objects.

• A retention configuration defines a date prior to which the object cannot be deleted or overwritten.

• A retention configuration can optionally be locked to prevent the retention date from being shortened or removed.

November 20, 2023

Regional endpoints are now available in Preview. Regional endpoints let you run your workloads in a manner that complies with data residency and data sovereignty requirements, where your request traffic is routed directly to the region specified in the endpoint.

November 14, 2023

New bandwidth quotas are now in effect.

• Bandwidth quotas are now variable and based in part on a project's billing account history. Previously, the same default value applied to all projects.
• For most projects, egress bandwidth quotas either remain unchanged or have increased.
• You can view your project's egress bandwidth quotas in the Console.

November 03, 2023

The Autoclass feature can now be enabled for existing buckets.

• Previously, Autoclass could only be enabled when creating a new bucket.
• Enabling Autoclass on an existing bucket incurs additional charges.

October 27, 2023

Turbo replication performance monitoring in the Google Cloud console has been moved and expanded.

• Monitoring graphs have been moved from a bucket's Configuration tab to its Observability tab.

• A new, real-time Maximum delay in turbo replication graph is also available in the Observability tab.

October 26, 2023

Managed folders are now available in Preview. When using managed folders, you can organize your objects by group and set IAM policies that offer more granular access control over data segments within a bucket.

October 16, 2023

Changes to the Autoclass feature that were announced on July 17, 2023 begin taking effect today.

October 12, 2023

The Node.js and Python client libraries now have parallelized upload and download options, improving their performance.

• Both client libraries have improved bulk uploads, bulk downloads, large object uploads, and large object downloads.

September 28, 2023

Beginning Oct 30, 2023, Cloud Storage will change how it enforces egress bandwidth quotas.

• Instead of using the same default value for all projects, egress bandwidth quotas will depend on each project's history, such whether the billing account is in good standing.
• For most projects, egress bandwidth quotas will either remain unchanged or will increase.
• Once this change takes effect, you can view your project's egress bandwidth quotas in the Console.

September 26, 2023

You can now control the mounting behavior of Cloud Storage FUSE by using a configuration file instead of global options.

Cloud Storage FUSE is now available for use on ARM64-based machines.

September 20, 2023

The gcloud CLI now supports setting a user-defined prefix for naming temporary components of a parallel composite upload.

September 19, 2023

Cloud Storage is now available in Dammam, Saudi Arabia (me-central2 region).

September 15, 2023

Manifest files are now available in Storage Insights. A manifest file is generated when an inventory report is split into shards. You can use the manifest file to easily locate the shards you want to download.

September 14, 2023

The following dual-region pairs are now generally available:

• Montréal and Toronto, Canada
• Sydney and Melbourne, Australia

August 23, 2023

The Storage Object User role (roles/storage.objectUser) is now available. This role allows you to create, view, list, update, and delete objects and their metadata, without granting access to the object's ACLs.

August 22, 2023

Cloud Storage is now available in Berlin, Germany (europe-west10 region).

August 01, 2023

You can now use locational endpoints to perform operations in a manner that's compliant with International Traffic in Arms Regulations (ITAR).

July 18, 2023

The gcloud storage command-line tool has changed some of the metadata it returns for buckets and objects, as well as changed the format of some metadata names it returns.

• To output metadata in the form used prior to July 18, 2023, include the flag --raw in your list and describe commands for objects and buckets.

gcloud storage GA release 1.3 is now available.

• The 1.3 release adds support for the rsync command, which synchronizes content between a source and destination.
• The 1.3 release also adds support for generating signed URLs, managing HMAC keys, calculating bucket sizes and calculating hashes.

July 17, 2023

Beginning October 16, 2023, the Autoclass feature will change its storage class transition behavior.

• By default, new buckets with Autoclass enabled will only transition objects between the Standard and Nearline storage classes.

• However, you can continue to create buckets that transition objects between all storage classes by choosing to opt-in.

Beginning October 16, 2023, the Autoclass feature and the matchesStorageClass condition for Object Lifecycle Management will be incompatible.

• You will not be able to modify any other bucket metadata for affected buckets until either the matchesStorageClass condition is removed or the Autoclass feature is disabled.

Beginning October 16, 2023, the following pricing changes apply to buckets that use the Autoclass feature:

• Each storage class transition from Coldline or Archive storage to Standard storage will change from being free to being charged as a Class A operation at the Standard storage rate.

• Each Class B operation, such as reading object data, will change from being charged at the rate of the object's storage class at the time of the operation to being charged at the Standard storage rate.

• After October 30, 2023, billing for objects in Autoclass buckets will use Autoclass-specific SKUs.

July 07, 2023

Custom audit logging for Cloud Storage is now generally available (GA). In addition to using the Cloud Storage JSON API, you can now attach custom information to audit logs for requests by using the following tools:

• The gcloud or gsutil command-line tools
• The Cloud Storage client libraries
• The Cloud Storage XML API
• Signed URLs

June 28, 2023

You can now have a maximum of 10 HMAC keys per service account.

June 26, 2023

Cloud Storage FUSE is now generally available.

June 23, 2023

Objects created using XML API multipart uploads can now be copied and rewritten normally.

• Previously, you had to perform an object composition on such objects before the output could be copied or rewritten.

May 26, 2023

You can now add custom object metadata in the final request of a JSON API resumable upload by using the X-Goog-Meta- header.

May 11, 2023

Custom audit logging for Cloud Storage is now available in Preview.

• JSON API requests now support user-defined headers that are prefixed with x-goog-custom-audit-.
• Cloud Audit Logs can subsequently include these headers as part of your request's audit log entry.

April 17, 2023

The Storage Insights inventory reports feature is now generally available. Inventory reports provide an overview of metadata for all objects in a bucket.

On July 17, 2023, the gcloud storage command-line tool will change some of the metadata it returns for buckets and objects, as well as change the format of some metadata names it returns.

• To continue outputting metadata in its current form, you should include the flag --raw in your list and describe commands for objects and buckets.

April 05, 2023

Cloud Storage FUSE is now available in Preview. You can use Cloud Storage FUSE to mount and access storage buckets as local file systems.

• Get started with mounting buckets using Cloud Storage FUSE.
• Learn about integrations between Cloud Storage FUSE and other Google Cloud products.

April 01, 2023

All announced pricing changes for Cloud Storage are now in effect.

March 30, 2023

Cloud Storage is now available in Doha, Qatar (me-central1 region).

March 23, 2023

Cloud Storage is now available in Turin, Italy (europe-west12 region).

Objects smaller than 128KiB stored in buckets with Autoclass enabled are no longer managed by Autoclass.

• Such objects are not subject to the Autoclass management fee and are statically set to Standard Storage.
• Any such objects in Autoclass buckets that are currently stored in a different storage class are being transitioned to Standard Storage automatically and free of charge.

March 20, 2023

The following US regions are now available for dual-region storage:

• Los Angeles (us-west2)
• Salt Lake City (us-west3)

The following EU regions are now available for dual-region storage:

• Warsaw (europe-central2)
• Madrid (europe-southwest1)
• Frankfurt (europe-west3)
• Milan (europe-west8)
• Paris (europe-west9)

March 17, 2023

Expanded Cloud Storage monitoring dashboards are now generally available (GA).

• Available metrics include server and client error rates, write request counts, network ingress rates, and network egress rates.
• Dashboards can be filtered by bucket location.
• Dashboards are customizable, including the ability to set up alerts.

March 07, 2023

In buckets with turbo replication enabled, objects uploaded using XML API multipart uploads are now included in the turbo replication RPO.

February 21, 2023

You can now attach a maximum of 50 tag bindings to a storage bucket.

February 02, 2023

The Autoclass feature will stop managing Cloud Storage objects smaller than 128KiB after March 6, 2023.

• Affected objects will be transitioned to the Standard storage class at no cost to customers and without requiring any action from customers.

• Affected objects will always remain in Standard storage and will not be subject to the Autoclass Management Fee.

• The change is occurring because the Autoclass Management Fee typically outweighs storage fee savings for such small objects.

January 31, 2023

The issue for gsutil commands that use the -m global flag, which was documented on January 19, 2023, has been fixed in the most recent versions of the Cloud SDK and gsutil.

January 19, 2023

Some gsutil commands that use the -m global flag, such as cp and rsync, are currently failing if the requester does not have the storage.buckets.get permission.

• If you installed gsutil as part of the Cloud SDK, you can work around this issue by reverting to an earlier version. To do so, run the command gcloud components update --version=413.0.0

• If you installed gsutil as a standalone tool, you can work around this issue by reverting to version 5.17

January 18, 2023

gcloud storage GA release 1.2 is now available.

• The 1.2 release adds support for managing access with IAM and ACLs at the bucket and object level.
• The 1.2 release also adds support for managing the Autoclass and turbo replication features.

November 16, 2022

The following regions are now generally available for dual-region storage:

• Mumbai (asia-south1)
• Delhi (asia-south2)
• Columbus (us-east5)
• Dallas (us-south1)
• Las Vegas (us-west4)

Turbo replication is now available for all dual-region combinations.

November 10, 2022

You can now use the Google Cloud console to get role recommendations and policy insights for buckets. Role recommendations and policy insights help you understand and manage permission usage for your buckets.

November 09, 2022

Expanded Cloud Storage monitoring dashboards are now available in Preview.

• Available metrics include server and client error rates, write request counts, network ingress rates, and network egress rates.
• Dashboards can be filtered by bucket location.
• Dashboards are customizable, including the ability to set up alerts.

In addition to the project-wide dashboard, per-bucket dashboards are available in a new Observability tab in the Bucket Details for each bucket.

November 08, 2022

The Autoclass feature is now available.

• When enabled, Autoclass transitions the storage classes of your objects automatically based on their access patterns.
• Currently, Autoclass can only be enabled at the time of bucket creation.

gcloud storage GA release 1.1 is now available.

• The 1.1 release adds more support for managing bucket settings, including lifecycle configurations, CORS configurations, and labels.

October 27, 2022

Bucket tags are now generally available (GA).

October 21, 2022

New public dataset stored in Cloud Storage.

• Data for ERA5 are now hosted publicly in Cloud Storage.

September 28, 2022

New buckets created using the Cloud Console now have public access prevention enabled by default.

• During the bucket creation process, you can choose to change this setting.

September 13, 2022

Cloud Storage is now available in Tel Aviv, Israel (me-west1 region).

gcloud storage is now in GA

• gcloud storage provides faster uploading and downloading performance when compared to the gsutil command line tool.

August 24, 2022

The restrict authentication types organization policy constraint is now generally available (GA). This constraint allows you to restrict the authentication types that can be used in requests for Cloud Storage resources.

August 02, 2022

Customer-managed encryption key (CMEK) organization policy constraints are now generally available (GA).

• constraints/gcp.restrictNonCmekServices allows you to control which resources require the use of CMEK.
• constraints/gcp.restrictCmekCryptoKeyProjects allows you to control the projects from which a Cloud KMS key can be used to validate requests.
• You can use both constraints together to enforce the use of CMEK from allowed projects.

New commands are now available gcloud alpha storage.

• Commands include the ability to create buckets, view metadata for buckets and objects, and edit metadata for buckets and objects.
• Note that all Cloud Storage gcloud commands continue to be in Preview.

August 01, 2022

Bucket tags are now available in Preview. You can apply tags to buckets for fine-grained access control.

July 28, 2022

Configurable dual-region storage is generally available (GA).

June 27, 2022

Object Lifecycle Management now supports new conditions and a new action.

• The MatchesPrefix and MatchesSuffix conditions allow you to restrict lifecycle actions to objects with specific prefixes and suffixes.

• The AbortIncompleteMultipartUpload action allows you to remove abandoned XML API multipart uploads.

The XML API now supports setting a default Cloud KMS key on a bucket when creating the bucket.

June 06, 2022

Cloud Storage is now available in Dallas, Texas (us-south1 region).

June 02, 2022

Turbo replication is generally available (GA).

May 24, 2022

Cloud Storage is now available in Columbus, Ohio (us-east5 region).

May 23, 2022

JSON copy requests and XML copy requests now return a permanent error on timeouts for objects larger than 2.5 GiB and a retryable error on timeouts for objects smaller than 2.5 GiB.

May 10, 2022

Cloud Storage is now available in Madrid, Spain (europe-southwest1 region).

May 06, 2022

Us-east4 is now available for dual-region storage. This feature is now in Preview.

May 02, 2022

Cloud Storage is now available in Paris, France (europe-west9 region).

April 20, 2022

Cloud Storage is now available in Milan, Italy (europe-west8 region).

April 05, 2022

With dual-region storage, users can now specify two regions within the same continent to create a dual-region of their choosing. This feature is now in Preview.

March 25, 2022

Customer-managed encryption key (CMEK) organization policy constraints are now available in Preview.

• constraints/gcp.restrictNonCmekServices allows you to control which resources require the use of CMEK.
• constraints/gcp.restrictCmekCryptoKeyProjects allows you to control the projects from which a Cloud KMS key can be used to validate requests.
• You can use both constraints together to enforce the use of CMEK from allowed projects.

March 14, 2022

On October 1, 2022, certain prices in Cloud Storage will be changing. For a list of pricing changes, see the announcement.

February 24, 2022

The restrict authentication types organizational constraint is now in Preview.

• The constraint allows you to restrict the authentication types that can be used in requests for Cloud Storage resources.

January 27, 2022

The Storage Object Admin IAM role now correctly includes all storage.multipartUploads permissions.

December 15, 2021

Public Access Prevention is now in GA.

orgpolicy.policy.get permission is now included in certain Cloud Storage IAM roles.

• This permission is now included in the following roles when they're set at the project-level: Storage Object Creator, Storage Object Admin, Storage HMAC Key Admin, and Storage Admin.
• This permission allows principals to know the organizational policy constraints that a project is subject to.

November 19, 2021

Public access prevention^Preview now uses inherited in place of unspecified.

• Name change more clearly expresses how the state of public access prevention is determined for affected buckets.

November 16, 2021

Santiago region (southamerica-west1) launched.

New location for storing your data.

November 01, 2021

List Object V2 is generally available (GA).

October 13, 2021

Cloud EKM keys can now be used to encrypt Cloud Storage data.

• Cloud EKM keys encrypt your Cloud Storage data in the same way as other customer-managed encryption keys.

October 12, 2021

Objects uploaded using XML API multipart uploads cannot be rewritten or copied within Cloud Storage.

October 05, 2021

Turbo replication is a premium feature designed to provide inter-region replication for newly written objects within 15 minutes.

This feature is now available in Preview.

September 27, 2021

Cloud Storage now more effectively batches Cloud KMS requests.

• No changes to how you use Cloud Storage.
• When working with objects encrypted with Cloud KMS keys, you may see improved performance in your high intensity workloads, a decrease in the number of Cloud KMS audit logs, and a reduction in Cloud KMS charges.
• These improvements apply to objects written to and rewritten within Cloud Storage using Cloud KMS keys after September 2021.

September 22, 2021

Object listing is no longer impacted when performing large-scale object deletion.

• Previously, object listing performance could be degraded for up to several days when deleting millions of objects at once in a bucket.

September 20, 2021

Object Versioning can now be managed in the Cloud Console.

• You can enable and disable Object Versioning using the Cloud Console.

• You can list, restore, copy, move, and delete versioned objects from within the Cloud Console.

August 03, 2021

Toronto region (northamerica-northeast2) launched.

• New location for storing your data.

August 01, 2021

Cloud Storage now has bandwidth quotas for egress to other Google services.

July 20, 2021

gcloud alpha storage commands are now available.

• These commands provide faster uploading and downloading performance over the gsutil command line tool.

July 12, 2021

XML API multipart uploads is now in GA.

List object V2 for the XML API^Preview launched.

• List object V2 provides improved interoperability with Amazon S3 tools and libraries.

July 01, 2021

Public access prevention^Preview launched.

• Enforcing public access prevention prevents data in your organization or project from being accidentally exposed to the public.

June 29, 2021

Delhi region (asia-south2) launched.

• New location for storing your data.

June 21, 2021

Melbourne region (australia-southeast2) launched.

• New location for storing your data.

May 14, 2021

XML API multipart uploads^Preview launched.

April 27, 2021

You can now compose objects using source objects that were encrypted with Cloud KMS keys.

March 29, 2021

Cloud CDN, external HTTP(S) Load Balancing, and Cloud Storage services use BoringSSL, and are not affected by the recent OpenSSL security advisory that relates to CA certificate checks (CVE-2021-3450) and TLS renegotiation (CVE-2021-3449).

March 24, 2021

Warsaw region (europe-central2) launched.

• New location for storing your data.

September 28, 2020

Tokyo+Osaka dual-region (asia1) launched.

• New location for storing your data.

September 08, 2020

New conditions available for Object Lifecycle Management:

• Noncurrent time conditions allow you to define lifecycle actions based on when an object became noncurrent.
• Custom time conditions allow you to define lifecycle actions based on a custom time that you define for objects.

Custom time metadata is now available for objects.

• Custom time metadata allows you to associate an arbitrary date and time with objects.

July 20, 2020

Detailed audit logging mode launched.

June 08, 2020

Jakarta region (asia-southeast2) launched.

• New location for storing your data.

May 18, 2020

The V4 signing process is now in GA.

• The V4 signing process is an improved method for creating signatures using RSA or HMAC keys.

April 20, 2020

Las Vegas region (us-west4) launched.

• New location for storing your data.

February 28, 2020

IAM Conditions for Cloud Storage is now in GA.

February 24, 2020

Salt Lake City region (us-west3) launched.

• New location for storing your data.

January 24, 2020

Seoul region (asia-northeast3) launched.

• New location for storing your data.

January 08, 2020

Archive Storage now available.

• New storage class for storing your long-term, rarely accessed data.

December 13, 2019

IAM Conditions^BETA for Cloud Storage is now available.

• IAM Conditions allows you to grant permissions for a specified period of time, or to a subset of objects in your buckets.
• See Using IAM Conditions on buckets for step-by-step instructions.

November 18, 2019

Uniform bucket-level access is now in GA.

November 15, 2019

JSON API requests should now be made through the storage.googleapis.com endpoint.

• New preferred request endpoint for the JSON API.

New display for bucket lists in the Google Cloud Console.

• The Name column is now always visible in the bucket list.
• The column selector now appears as an icon ().

November 07, 2019

The name of the Bucket Policy Only feature is now changed to uniform bucket-level access.

• The organization policy and API fields referring to Bucket Policy Only are still supported, but we recommend using the equivalent uniform bucket-level access organization policy and API fields.

October 29, 2019

HMAC keys for service accounts are now in GA.

• Use the XML API to manage your HMAC keys for service accounts.

September 06, 2019

New Stackdriver metric available to check for ACL usage.

• Use Stackdriver to determine if enabling Bucket Policy Only would break your workflow.

August 14, 2019

Multi-Regional Storage and Regional Storage are now Standard Storage.

• Combining these into a single Standard Storage class separates your storage class considerations from your location considerations.

August 09, 2019

HMAC keys for service accounts^BETA are now available.

• Use HMAC keys to create signed requests for the XML API.
• Creating HMAC keys for service accounts replaces the need to have HMAC keys for user accounts.

June 28, 2019

Dual-regions are now in GA.

June 20, 2019

You can now inspect buckets for sensitive information using Cloud Data Loss Prevention in the Google Cloud Console.

• See Inspect a Cloud Storage location for step-by-step instructions.

June 18, 2019

Improved object interaction in the Google Cloud Console.

• Object downloads can be performed using the more options menu associated with each object.
• Clicking on an object's name opens a page dedicated to details about the object.

June 17, 2019

Object composition cannot be performed if any of the source objects are encrypted with customer-managed encryption keys.

May 30, 2019

Improved workflow for creating new buckets in the Google Cloud Console.

• See the Creating storage buckets guide for step-by-step instructions.
• Estimate your bucket's monthly costs during the bucket creation process.

April 18, 2019

Osaka region (asia-northeast2) launched.

• New location for storing your data.

The C++ Cloud Storage Client Library is now in GA.

• See the list of Cloud Storage guides for code samples that use the client library.

April 05, 2019

V4 signing process^BETA launched.

• The V4 signing process is an improved method for creating signed requests using RSA or HMAC signatures.
• Use the process to create signed URLs.

March 11, 2019

Zürich region (europe-west6) launched.

• New location for storing your data.

March 01, 2019

Price reduction for storing Coldline Storage data in regional locations.

• Data storage rate is now as low as $0.004/GB/month.

February 15, 2019

Bucket Policy Only^BETA launched.

• Bucket Policy Only unifies your access controls by disabling object-level ACLs.
• You can set an organizational policy that helps to enforce the use of Bucket Policy Only in your buckets.

February 13, 2019

The C++ Cloud Storage Client Library is now in BETA.

• See the list of Cloud Storage guides for code samples that use the client library.

January 24, 2019

Bucket updates - such as editing lifecycle policies, adding bucket labels, or enabling bucket features - no longer require the updater to have the storage.buckets.setIamPolicy permission.

December 20, 2018

Customer-Managed Encryption Keys can now be used with data stored in the eur4 and nam4 bucket locations.

October 22, 2018

Hong Kong region (asia-east2) launched.

• New location for storing your data.

Limit change for object composition.

• There is no longer a limit to the rate at which objects can be composed.

October 19, 2018

Retention policies and object holds are now available.

• Retention policies allow you to set a minimum age that objects must reach before they can be deleted or overwritten.
• You can lock your policy so that it can not be removed or reduced.
• You can place holds on your objects as another way to prevent unintended deletion or overwrite.

October 11, 2018

Dual-regions^BETA launched.

• Data stored in a dual-regional location have copies stored in two specific locations.

Geo-redundancy expanded in multi-regional locations.

• All data stored in multi-regional locations are now geo-redundant, regardless of storage class.

October 09, 2018

C++ Cloud Storage Client Library^ALPHA

• See the list of Cloud Storage guides for code samples that use the client library.

August 15, 2018

Cloud Key Management Service keys with Cloud Storage is now in GA.

July 18, 2018

Improved security in the Google Cloud Platform Console.

• Objects can no longer be made public through one-click actions. See Making data public for updated guides.
• Public access columns for buckets and objects show you when the general public has access to your resources.

July 10, 2018

Los Angeles region (us-west2) launched.

• New location for storing your data.

June 21, 2018

Limit changes for object composition.

• There is no longer a limit to the number of components in a composite object.
• The composition rate is now measured by the number of source objects, instead of the number of components within those source objects.
• Copying a composite object is no longer considered when determining a project's composition rate.

June 11, 2018

Finland region (europe-north1) launched.

• New location for storing your data.

May 29, 2018

New query parameter in JSON API object listing.

• The optional query parameter includeTrailingDelimiter can now be used in your JSON API object listing requests.

May 07, 2018

Customer-Managed Encryption Keys^BETA.

• Cloud Key Management Service keys with Cloud Storage allow you to manage the encryption keys used on your Cloud Storage objects.
• Google Cloud Platform Console functionality for the feature is fully available starting April 20.

February 07, 2018

Changed endpoint for batch requests to the JSON API.

• When making HTTP batch requests to the JSON API, users should utilize the www.googleapis.com/batch/storage/v1 endpoint instead of the www.googleapis.com/batch endpoint.

February 01, 2018

Price reduction for Nearline Storage and Coldline Storage in select regions.

• Nearline Storage price reductions apply to the following regions: Northern Virginia, London, and Frankfurt.
• Coldline Storage price reductions apply to the following regions: London, Frankfurt, Mumbai, and Sydney.
• Details regarding Cloud Storage pricing can be found on the Pricing page.

January 10, 2018

Montréal region (northamerica-northeast1) launched.

• New location for storing your data.

Netherlands region (europe-west4) launched.

• New location for storing your data.

January 04, 2018

The Cloud Pub/Sub Notifications for Cloud Storage feature can now have up to 10 different notification configurations send notifications for the same event.

November 14, 2017

Requester Pays feature is now available.

• When enabled on a bucket, users accessing the bucket or its contents must specify a project to bill for charges that arise from their request.
• Callers can specify a billing project on requests to buckets both with and without Requester Pays enabled.

The Cloud Pub/Sub Notifications for Cloud Storage feature is now in GA.

The resource attribute of Cloud Pub/Sub Notifications for Cloud Storage is now deprecated. It does not appear for new subscriptions and will not appear in any subscription after June 1, 2018.

October 31, 2017

Mumbai region (asia-south1) launched.

• New location for storing your data.

September 18, 2017

Bucket metadata PATCH requests to the JSON API require the storage.buckets.setIamPolicy permission if the requester has storage.buckets.getIamPolicy permission. This is true even for patches that do not change ACLs or IAM permissions.

See IAM permissions for JSON and IAM permissions for gsutil for affected methods and commands.

September 05, 2017

São Paulo region (southamerica-east1) launched.

• New location for storing your data.

August 14, 2017

You can now control Object Lifecycle Management from the Storage Console.

August 01, 2017

Frankfurt region (europe-west3) launched.

• New location for storing your data.

June 20, 2017

Sydney region (australia-southeast1) launched.

• New location for storing your data.

June 06, 2017

New public dataset stored in Cloud Storage.

• Data for NEXRAD are now hosted publicly in Cloud Storage.

London region (europe-west2) launched.

• New location for storing your data.

May 31, 2017

Identity and Access Management (IAM) policies are now GA for buckets. Policies applied at the bucket level can be used to control access to individual buckets as well as all the objects within them.

May 24, 2017

Attempts to access a non-existent object returns a 403 error instead of a 404 error if the requester lacks object listing permission for the associated bucket.

May 09, 2017

Northern Virginia region (us-east4) launched.

• New location for storing your data.

April 26, 2017

The Cloud Storage Client Libraries for the Cloud Storage API is now in GA.

April 11, 2017

Singapore region (asia-southeast1) launched.

• New location for storing your data.

April 06, 2017

Labels can now be used with your buckets in order to better organize all of your Google Cloud Platform resources.

March 27, 2017

Cloud Pub/Sub Notifications for Cloud Storage^BETA

• Track changes to objects in your buckets through notifications sent to Cloud Pub/Sub.
• You can set the event types that generate notifications as well as the information contained within notifications.

December 07, 2016

The per-object storage class feature is now in GA.

November 07, 2016

asia-northeast1 region launched.

• New location for storing your data.

October 20, 2016

Coldline, a new archival storage class, is now available.

• The Coldline Storage class provides low price, immediately accessible data storage for your backup, archival and disaster recovery needs.
• Ideal for data that intends to be accessed less than once a year.

Standard Storage class is now Multi-Regional Storage and Regional Storage.

• The Multi-Regional Storage class provides the same price and performance along with geo-redundant copies of your data and a 99.95% availability SLA.
• The Regional Storage class provides the same performance at a reduced price.

Per-object storage classes^BETA

• Users can set the storage class at the object level.
• Users can configure lifecycle management to automatically change the storage class of an object when designated criteria are met.

October 04, 2016

Public datasets stored in Cloud Storage

• Datasets for the Landsat and Sentinel-2 missions are now hosted publicly in Cloud Storage.
• Read about the Landsat dataset
• Read about the Sentinel-2 dataset

September 26, 2016

Alpha release for bucket-level IAM.

• Access to this feature is currently by request/invite only. Apply IAM permissions to individual buckets in your projects.

August 29, 2016

Improved upload experience in the Storage Console.

• Users can retry failed uploads.
• The upload drawer persists when navigating to other parts of the Storage Console.
• Users are immediately notified when an upload starts and ends.

August 03, 2016

Nearline latency times reduced.

• Buckets created in the Nearline storage class now have the same sub-second latency as other storage class buckets.

August 01, 2016

Object generation numbers no longer have ordering guarantees.

• Generation numbers associated with Cloud Storage objects no longer increase monotonically or have ordering guarantees between generations.
• Generation numbers continue to be unique resource identifiers.
• See the announcement.

July 20, 2016

us-west1 region launched.

• New location for storing your data.

June 24, 2016

X-Goog-Content-Length-Range custom header available.

• New header for XML and JSON.
• Allows for checking the size of content sent to Cloud Storage.

June 13, 2016

On-Demand I/O for Nearline-class buckets no longer necessary.

• Buckets created in the Nearline storage class now have throughput and QPS that automatically scale with your needs, at no extra cost.