Applications define task queues in a configuration file called
For Java apps, this file is stored in the application's
WEB-INF directory. You can use
queue.xml to configure
This configuration file is optional for push queues, which have a
Pull queues must be specifically configured in
The following a basic example that defines a named queue and overrides the default processing rate:
<queue-entries> <queue> <name>my-push-queue</name> <rate>1/s</rate> </queue> </queue-entries>
The following is a more complex example of a
queue.xml configuration that
demonstrates setting up task retries and modifying the default processing rate.
<queue-entries> <queue> <name>fooqueue</name> <rate>1/s</rate> <retry-parameters> <task-retry-limit>7</task-retry-limit> <task-age-limit>2d</task-age-limit> </retry-parameters> </queue> <queue> <name>barqueue</name> <rate>1/s</rate> <retry-parameters> <min-backoff-seconds>10</min-backoff-seconds> <max-backoff-seconds>200</max-backoff-seconds> <max-doublings>0</max-doublings> </retry-parameters> </queue> <queue> <name>bazqueue</name> <rate>1/s</rate> <retry-parameters> <min-backoff-seconds>10</min-backoff-seconds> <max-backoff-seconds>200</max-backoff-seconds> <max-doublings>3</max-doublings> </retry-parameters> </queue> </queue-entries>
queue.xml file is a XML file whose root element is
This directive contains zero or more named queues specified within
elements. Each queue definition can specify the following elements:
Experimental. Creates an access control list (ACL) for Pull Queues using the Task Queue REST API. The ACL is composed of the specified email addresses. Accepts email addresses only from a Google Account. Enter each email address on its own line as follows:
<queue-entries> <queue> <name>pull-queue</name> <mode>pull</mode> <acl> <!-- can list, get, lease, delete, and update tasks --> <user-email>firstname.lastname@example.org</user-email> <!-- can insert tasks --> <writer-email>email@example.com</writer-email> <!-- can insert tasks, in addition to rights granted by being a user_email above --> <writer-email>firstname.lastname@example.org</writer-email> </acl> </queue> </queue-entries>
For more information, see Defining Pull Queues.
Optional. If you don't specify <bucket-size> for a queue, the default value is 5. We recommend that you set this to larger value because the default size may be too small for many use cases: the recommended size is the processing rate divided by 5 (rate/5).
Task queues use a "token bucket" algorithm for dequeueing tasks. The bucket size limits how fast the queue is processed when many tasks are in the queue and the rate is high. The maximum value for bucket size is 500. This allows you to have a high rate so processing starts shortly after a task is enqueued, but still limit resource usage when many tasks are enqueued in a short period of time.
For more information on the algorithm, see the Wikipedia article on token buckets.
Optional. Sets the maximum number of tasks that can be executed simultaneously from the specified queue. The value is an integer. By default, the limit is 1000 tasks per queue.
Restricting the number of concurrent tasks gives you more control over the queue's rate of execution and can prevent too many tasks from running at once. It can also prevent datastore contention and make resources available for other queues or online processing.
The name of the queue. This is
the name you specify when you call
A queue name can contain uppercase and lowercase letters, numbers, and hyphens. The maximum length for a queue name is 100 characters.
All apps have a push queue named default. This queue has a preset rate
of 5 tasks per second, but you can change this rate by defining a
default queue in
How often tasks are processed on this queue. The value is a number
followed by a slash and a unit of time, where the unit is
If the number is
Optional. Configures retry attempts for failed tasks. This addition allows you to specify the maximum number of times to retry failed tasks in a specific queue. You can also set a time limit for retry attempts and control the interval between attempts.
The retry parameters can contain the following subelements:
Optional. A string naming a service/version, a frontend version, or a backend, on which to execute all of the tasks enqueued onto this queue.
The string is prepended to the domain name of your app when
constructing the HTTP request for a task. For example, if your app ID
If target is unspecified, then tasks are invoked on the same version of the application where they were enqueued. So, if you enqueued a task from the default application version without specifying a target on the queue, the task is invoked in the default application version. Note that if the default application version changes between the time that the task is enqueued and the time that it executes, then the task will run in the new default version.
If you are using services along with a dispatch file, your task's HTTP request might be intercepted and re-routed to another service.
The following elements can be specified for all queues within an app,
set inside the
<queue-entries> root element:
Optional. A string that overrides the default quota storage limit that is available for taskqueue storage (100M). For example:
<queue-entries> <total-storage-limit>1.2G</total-storage-limit> <queue> <name>fooqueue</name> </queue> </queue-entries>
This quota is part of the application's total storage quota (including the datastore and blobstore quota).
If no suffix is specified, the number that you specify is interpreted as bytes. The following suffixes are supported: