Load a DataFrame to BigQuery with pandas-gbq
Stay organized with collections
Save and categorize content based on your preferences.
Use the pandas-gbq package to load a DataFrame to BigQuery.
Code sample
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["\u003cp\u003eThis content demonstrates how to use the \u003ccode\u003epandas-gbq\u003c/code\u003e package to load a pandas DataFrame into a BigQuery table.\u003c/p\u003e\n"],["\u003cp\u003eYou must set up Application Default Credentials to authenticate with BigQuery before running the provided code.\u003c/p\u003e\n"],["\u003cp\u003eThe code sample requires you to set your Google Cloud Platform project ID and the destination table ID within BigQuery.\u003c/p\u003e\n"],["\u003cp\u003eThe example creates a sample DataFrame containing string, integer, float, boolean, and date data types before using the pandas_gbq library to push the data to a BigQuery table.\u003c/p\u003e\n"],["\u003cp\u003eFor additional usage of the google cloud libraries, you can explore the Google Cloud Sample Browser for more code.\u003c/p\u003e\n"]]],[],null,["# Load a DataFrame to BigQuery with pandas-gbq\n\nUse the pandas-gbq package to load a DataFrame to BigQuery.\n\nCode sample\n-----------\n\n### Python\n\n\nBefore trying this sample, follow the Python setup instructions in the\n[BigQuery quickstart using\nclient libraries](/bigquery/docs/quickstarts/quickstart-client-libraries).\n\n\nFor more information, see the\n[BigQuery Python API\nreference documentation](/python/docs/reference/bigquery/latest).\n\n\nTo authenticate to BigQuery, set up Application Default Credentials.\nFor more information, see\n\n[Set up authentication for client libraries](/bigquery/docs/authentication#client-libs).\n\n import pandas\n import pandas_gbq\n\n # TODO: Set project_id to your Google Cloud Platform project ID.\n # project_id = \"my-project\"\n # TODO: Set table_id to the full destination table ID (including the\n # dataset ID).\n # table_id = 'my_dataset.my_table'\n\n df = pandas.DataFrame(\n {\n \"my_string\": [\"a\", \"b\", \"c\"],\n \"my_int64\": [1, 2, 3],\n \"my_float64\": [4.0, 5.0, 6.0],\n \"my_bool1\": [True, False, True],\n \"my_bool2\": [False, True, False],\n \"my_dates\": pandas.date_range(\"now\", periods=3),\n }\n )\n\n pandas_gbq.to_gbq(df, table_id, project_id=project_id)\n\nWhat's next\n-----------\n\n\nTo search and filter code samples for other Google Cloud products, see the\n[Google Cloud sample browser](/docs/samples?product=bigquery)."]]