- Resource: Subscription
- PushConfig
- OidcToken
- PubsubWrapper
- NoWrapper
- BigQueryConfig
- State
- CloudStorageConfig
- TextConfig
- AvroConfig
- State
- ExpirationPolicy
- DeadLetterPolicy
- RetryPolicy
- State
- AnalyticsHubSubscriptionInfo
- Methods
Resource: Subscription
A subscription resource. If none of pushConfig
, bigqueryConfig
, or cloudStorageConfig
is set, then the subscriber will pull and ack messages using API methods. At most one of these fields may be set.
JSON representation |
---|
{ "name": string, "topic": string, "pushConfig": { object ( |
Fields | |
---|---|
name |
Required. Name of the subscription. Format is |
topic |
Required. The name of the topic from which this subscription is receiving messages. Format is |
pushConfig |
Optional. If push delivery is used with this subscription, this field is used to configure it. |
bigqueryConfig |
Optional. If delivery to BigQuery is used with this subscription, this field is used to configure it. |
cloudStorageConfig |
Optional. If delivery to Google Cloud Storage is used with this subscription, this field is used to configure it. |
ackDeadlineSeconds |
Optional. The approximate amount of time (on a best-effort basis) Pub/Sub waits for the subscriber to acknowledge receipt before resending the message. In the interval after the message is delivered and before it is acknowledged, it is considered to be outstanding. During that time period, the message will not be redelivered (on a best-effort basis). For pull subscriptions, this value is used as the initial value for the ack deadline. To override this value for a given message, call For push delivery, this value is also used to set the request timeout for the call to the push endpoint. If the subscriber never acknowledges the message, the Pub/Sub system will eventually redeliver the message. |
retainAckedMessages |
Optional. Indicates whether to retain acknowledged messages. If true, then messages are not expunged from the subscription's backlog, even if they are acknowledged, until they fall out of the |
messageRetentionDuration |
Optional. How long to retain unacknowledged messages in the subscription's backlog, from the moment a message is published. If A duration in seconds with up to nine fractional digits, ending with ' |
labels |
Optional. See Creating and managing labels. An object containing a list of |
enableMessageOrdering |
Optional. If true, messages published with the same |
expirationPolicy |
Optional. A policy that specifies the conditions for this subscription's expiration. A subscription is considered active as long as any connected subscriber is successfully consuming messages from the subscription or is issuing operations on the subscription. If |
filter |
Optional. An expression written in the Pub/Sub filter language. If non-empty, then only |
deadLetterPolicy |
Optional. A policy that specifies the conditions for dead lettering messages in this subscription. If deadLetterPolicy is not set, dead lettering is disabled. The Pub/Sub service account associated with this subscriptions's parent project (i.e., service-{project_number}@gcp-sa-pubsub.iam.gserviceaccount.com) must have permission to subscriptions.acknowledge() messages on this subscription. |
retryPolicy |
Optional. A policy that specifies how Pub/Sub retries message delivery for this subscription. If not set, the default retry policy is applied. This generally implies that messages will be retried as soon as possible for healthy subscribers. RetryPolicy will be triggered on NACKs or acknowledgement deadline exceeded events for a given message. |
detached |
Optional. Indicates whether the subscription is detached from its topic. Detached subscriptions don't receive messages from their topic and don't retain any backlog. |
enableExactlyOnceDelivery |
Optional. If true, Pub/Sub provides the following guarantees for the delivery of a message with a given value of
Note that subscribers may still receive multiple copies of a message when |
topicMessageRetentionDuration |
Output only. Indicates the minimum duration for which a message is retained after it is published to the subscription's topic. If this field is set, messages published to the subscription's topic in the last A duration in seconds with up to nine fractional digits, ending with ' |
state |
Output only. An output-only field indicating whether or not the subscription can receive messages. |
analyticsHubSubscriptionInfo |
Output only. Information about the associated Analytics Hub subscription. Only set if the subscritpion is created by Analytics Hub. |
PushConfig
Configuration for a push delivery endpoint.
JSON representation |
---|
{ "pushEndpoint": string, "attributes": { string: string, ... }, // Union field |
Fields | |
---|---|
pushEndpoint |
Optional. A URL locating the endpoint to which messages should be pushed. For example, a Webhook endpoint might use |
attributes |
Optional. Endpoint configuration attributes that can be used to control different aspects of the message delivery. The only currently supported attribute is If not present during the The only supported values for the
For example: An object containing a list of |
Union field authentication_method . An authentication method used by push endpoints to verify the source of push requests. This can be used with push endpoints that are private by default to allow requests only from the Pub/Sub system, for example. This field is optional and should be set only by users interested in authenticated push. authentication_method can be only one of the following: |
|
oidcToken |
Optional. If specified, Pub/Sub will generate and attach an OIDC JWT token as an |
Union field wrapper . The format of the delivered message to the push endpoint is defined by the chosen wrapper. When unset, PubsubWrapper is used. wrapper can be only one of the following: |
|
pubsubWrapper |
Optional. When set, the payload to the push endpoint is in the form of the JSON representation of a PubsubMessage (https://cloud.google.com/pubsub/docs/reference/rpc/google.pubsub.v1#pubsubmessage). |
noWrapper |
Optional. When set, the payload to the push endpoint is not wrapped. |
OidcToken
Contains information needed for generating an OpenID Connect token.
JSON representation |
---|
{ "serviceAccountEmail": string, "audience": string } |
Fields | |
---|---|
serviceAccountEmail |
Optional. Service account email used for generating the OIDC token. For more information on setting up authentication, see Push subscriptions. |
audience |
Optional. Audience to be used when generating OIDC token. The audience claim identifies the recipients that the JWT is intended for. The audience value is a single case-sensitive string. Having multiple values (array) for the audience field is not supported. More info about the OIDC JWT token audience here: https://tools.ietf.org/html/rfc7519#section-4.1.3 Note: if not specified, the Push endpoint URL will be used. |
PubsubWrapper
This type has no fields.
The payload to the push endpoint is in the form of the JSON representation of a PubsubMessage (https://cloud.google.com/pubsub/docs/reference/rpc/google.pubsub.v1#pubsubmessage).
NoWrapper
Sets the data
field as the HTTP body for delivery.
JSON representation |
---|
{ "writeMetadata": boolean } |
Fields | |
---|---|
writeMetadata |
Optional. When true, writes the Pub/Sub message metadata to |
BigQueryConfig
Configuration for a BigQuery subscription.
JSON representation |
---|
{
"table": string,
"useTopicSchema": boolean,
"writeMetadata": boolean,
"dropUnknownFields": boolean,
"state": enum ( |
Fields | |
---|---|
table |
Optional. The name of the table to which to write data, of the form {projectId}.{datasetId}.{tableId} |
useTopicSchema |
Optional. When true, use the topic's schema as the columns to write to in BigQuery, if it exists. |
writeMetadata |
Optional. When true, write the subscription name, messageId, publishTime, attributes, and orderingKey to additional columns in the table. The subscription name, messageId, and publishTime fields are put in their own columns while all other message properties (other than data) are written to a JSON object in the attributes column. |
dropUnknownFields |
Optional. When true and useTopicSchema is true, any fields that are a part of the topic schema that are not part of the BigQuery table schema are dropped when writing to BigQuery. Otherwise, the schemas must be kept in sync and any messages with extra fields are not written and remain in the subscription's backlog. |
state |
Output only. An output-only field that indicates whether or not the subscription can receive messages. |
useTableSchema |
Optional. When true, use the BigQuery table's schema as the columns to write to in BigQuery. |
serviceAccountEmail |
Optional. The service account to use to write to BigQuery. The subscription creator or updater that specifies this field must have |
State
Possible states for a BigQuery subscription.
Enums | |
---|---|
STATE_UNSPECIFIED |
Default value. This value is unused. |
ACTIVE |
The subscription can actively send messages to BigQuery |
PERMISSION_DENIED |
Cannot write to the BigQuery table because of permission denied errors. This can happen if - Pub/Sub SA has not been granted the appropriate BigQuery IAM permissions - bigquery.googleapis.com API is not enabled for the project (instructions) |
NOT_FOUND |
Cannot write to the BigQuery table because it does not exist. |
SCHEMA_MISMATCH |
Cannot write to the BigQuery table due to a schema mismatch. |
IN_TRANSIT_LOCATION_RESTRICTION |
Cannot write to the destination because enforceInTransit is set to true and the destination locations are not in the allowed regions. |
CloudStorageConfig
Configuration for a Cloud Storage subscription.
JSON representation |
---|
{ "bucket": string, "filenamePrefix": string, "filenameSuffix": string, "filenameDatetimeFormat": string, "maxDuration": string, "maxBytes": string, "maxMessages": string, "state": enum ( |
Fields | |
---|---|
bucket |
Required. User-provided name for the Cloud Storage bucket. The bucket must be created by the user. The bucket name must be without any prefix like "gs://". See the bucket naming requirements. |
filenamePrefix |
Optional. User-provided prefix for Cloud Storage filename. See the object naming requirements. |
filenameSuffix |
Optional. User-provided suffix for Cloud Storage filename. See the object naming requirements. Must not end in "/". |
filenameDatetimeFormat |
Optional. User-provided format string specifying how to represent datetimes in Cloud Storage filenames. See the datetime format guidance. |
maxDuration |
Optional. The maximum duration that can elapse before a new Cloud Storage file is created. Min 1 minute, max 10 minutes, default 5 minutes. May not exceed the subscription's acknowledgement deadline. A duration in seconds with up to nine fractional digits, ending with ' |
maxBytes |
Optional. The maximum bytes that can be written to a Cloud Storage file before a new file is created. Min 1 KB, max 10 GiB. The maxBytes limit may be exceeded in cases where messages are larger than the limit. |
maxMessages |
Optional. The maximum number of messages that can be written to a Cloud Storage file before a new file is created. Min 1000 messages. |
state |
Output only. An output-only field that indicates whether or not the subscription can receive messages. |
serviceAccountEmail |
Optional. The service account to use to write to Cloud Storage. The subscription creator or updater that specifies this field must have |
Union field output_format . Defaults to text format. output_format can be only one of the following: |
|
textConfig |
Optional. If set, message data will be written to Cloud Storage in text format. |
avroConfig |
Optional. If set, message data will be written to Cloud Storage in Avro format. |
TextConfig
This type has no fields.
Configuration for writing message data in text format. Message payloads will be written to files as raw text, separated by a newline.
AvroConfig
Configuration for writing message data in Avro format. Message payloads and metadata will be written to files as an Avro binary.
JSON representation |
---|
{ "writeMetadata": boolean, "useTopicSchema": boolean } |
Fields | |
---|---|
writeMetadata |
Optional. When true, write the subscription name, messageId, publishTime, attributes, and orderingKey as additional fields in the output. The subscription name, messageId, and publishTime fields are put in their own fields while all other message properties other than data (for example, an orderingKey, if present) are added as entries in the attributes map. |
useTopicSchema |
Optional. When true, the output Cloud Storage file will be serialized using the topic schema, if it exists. |
State
Possible states for a Cloud Storage subscription.
Enums | |
---|---|
STATE_UNSPECIFIED |
Default value. This value is unused. |
ACTIVE |
The subscription can actively send messages to Cloud Storage. |
PERMISSION_DENIED |
Cannot write to the Cloud Storage bucket because of permission denied errors. |
NOT_FOUND |
Cannot write to the Cloud Storage bucket because it does not exist. |
IN_TRANSIT_LOCATION_RESTRICTION |
Cannot write to the destination because enforceInTransit is set to true and the destination locations are not in the allowed regions. |
SCHEMA_MISMATCH |
Cannot write to the Cloud Storage bucket due to an incompatibility between the topic schema and subscription settings. |
ExpirationPolicy
A policy that specifies the conditions for resource expiration (i.e., automatic resource deletion).
JSON representation |
---|
{ "ttl": string } |
Fields | |
---|---|
ttl |
Optional. Specifies the "time-to-live" duration for an associated resource. The resource expires if it is not active for a period of A duration in seconds with up to nine fractional digits, ending with ' |
DeadLetterPolicy
Dead lettering is done on a best effort basis. The same message might be dead lettered multiple times.
If validation on any of the fields fails at subscription creation/updation, the create/update subscription request will fail.
JSON representation |
---|
{ "deadLetterTopic": string, "maxDeliveryAttempts": integer } |
Fields | |
---|---|
deadLetterTopic |
Optional. The name of the topic to which dead letter messages should be published. Format is The operation will fail if the topic does not exist. Users should ensure that there is a subscription attached to this topic since messages published to a topic with no subscriptions are lost. |
maxDeliveryAttempts |
Optional. The maximum number of delivery attempts for any message. The value must be between 5 and 100. The number of delivery attempts is defined as 1 + (the sum of number of NACKs and number of times the acknowledgement deadline has been exceeded for the message). A NACK is any call to subscriptions.modifyAckDeadline with a 0 deadline. Note that client libraries may automatically extend ack_deadlines. This field will be honored on a best effort basis. If this parameter is 0, a default value of 5 is used. |
RetryPolicy
A policy that specifies how Pub/Sub retries message delivery.
Retry delay will be exponential based on provided minimum and maximum backoffs. https://en.wikipedia.org/wiki/Exponential_backoff.
RetryPolicy will be triggered on NACKs or acknowledgement deadline exceeded events for a given message.
Retry Policy is implemented on a best effort basis. At times, the delay between consecutive deliveries may not match the configuration. That is, delay can be more or less than configured backoff.
JSON representation |
---|
{ "minimumBackoff": string, "maximumBackoff": string } |
Fields | |
---|---|
minimumBackoff |
Optional. The minimum delay between consecutive deliveries of a given message. Value should be between 0 and 600 seconds. Defaults to 10 seconds. A duration in seconds with up to nine fractional digits, ending with ' |
maximumBackoff |
Optional. The maximum delay between consecutive deliveries of a given message. Value should be between 0 and 600 seconds. Defaults to 600 seconds. A duration in seconds with up to nine fractional digits, ending with ' |
State
Possible states for a subscription.
Enums | |
---|---|
STATE_UNSPECIFIED |
Default value. This value is unused. |
ACTIVE |
The subscription can actively receive messages |
RESOURCE_ERROR |
The subscription cannot receive messages because of an error with the resource to which it pushes messages. See the more detailed error state in the corresponding configuration. |
AnalyticsHubSubscriptionInfo
Information about an associated Analytics Hub subscription (https://cloud.google.com/bigquery/docs/analytics-hub-manage-subscriptions).
JSON representation |
---|
{ "listing": string, "subscription": string } |
Fields | |
---|---|
listing |
Optional. The name of the associated Analytics Hub listing resource. Pattern: "projects/{project}/locations/{location}/dataExchanges/{data_exchange}/listings/{listing}" |
subscription |
Optional. The name of the associated Analytics Hub subscription resource. Pattern: "projects/{project}/locations/{location}/subscriptions/{subscription}" |
Methods |
|
---|---|
|
Acknowledges the messages associated with the ack_ids in the AcknowledgeRequest . |
|
Creates a subscription to a given topic. |
|
Deletes an existing subscription. |
|
Detaches a subscription from this topic. |
|
Gets the configuration details of a subscription. |
|
Gets the access control policy for a resource. |
|
Lists matching subscriptions. |
|
Modifies the ack deadline for a specific message. |
|
Modifies the PushConfig for a specified subscription. |
|
Updates an existing subscription by updating the fields specified in the update mask. |
|
Pulls messages from the server. |
|
Seeks an existing subscription to a point in time or to a given snapshot, whichever is provided in the request. |
|
Sets the access control policy on the specified resource. |
|
Returns permissions that a caller has on the specified resource. |