BigQuery response too large to return

Problem

BigQuery saves all the query results to either a permanent or temporary table. For queries that are written to a temporary table there is a 10 GB limit on the maximum response size. If that 10 GB limit is exceeded, then the query will fail with the below error message:

Response too large to return. Consider setting allowLargeResults to true in your job configuration

Environment

  • BigQuery
  • BigQuery API services

Solution

In standard SQL, we can override this limitation by specifying a destination table for the query results.

In legacy SQL, we can override this limitation by specifying a destination table and by setting the allowLargeResults option. Refer to the public documentation for specific syntax.

Cause

Queries writing to temporary tables have a 10 GB limitation on the maximum response size.