Class ReadRowsIterable (0.8.0)

Version 0.8.0

• 2.27.0 (latest)
• 2.26.0
• 2.25.0
• 2.24.0
• 2.23.0
• 2.22.0
• 2.21.0
• 2.20.0
• 2.19.1
• 2.18.1
• 2.17.0
• 2.16.2
• 2.15.0
• 2.14.2
• 2.13.2
• 2.12.0
• 2.11.0
• 2.10.1
• 2.9.1
• 2.8.0
• 2.7.0
• 2.6.3
• 2.5.0
• 2.4.0
• 2.3.0
• 2.2.1
• 2.1.0
• 2.0.1
• 1.1.2
• 1.0.0
• 0.8.0
• 0.7.0
• 0.6.0

ReadRowsIterable(reader, read_session)

An iterable of rows from a read session.

Parameters

Name	Description
reader	google.cloud.bigquery_storage_v1beta1.reader.ReadRowsStream A read rows stream.
read_session	google.cloud.bigquery_storage_v1beta1.types.ReadSession A read session. This is required because it contains the schema used in the stream messages.

Inheritance

builtins.object > ReadRowsIterable

Properties

pages

A generator of all pages in the stream.

Returns

Type	Description
types.GeneratorType[google.cloud.bigquery_storage_v1beta1.ReadRowsPage]	A generator of pages.

total_rows

int: Number of estimated rows in the current stream.

May change over time.

Methods

__iter__

__iter__()

Iterator for each row in all pages.

to_arrow

to_arrow()

Create a pyarrow.Table of all rows in the stream.

This method requires the pyarrow library and a stream using the Arrow format.

Returns

Type	Description
pyarrow.Table	A table of all rows in the stream.

to_dataframe

to_dataframe(dtypes=None)

Create a pandas.DataFrame of all rows in the stream.

This method requires the pandas libary to create a data frame and the fastavro library to parse row messages.

Warning: DATETIME columns are not supported. They are currently parsed as strings in the fastavro library.

Parameter

Name	Description
dtypes	Map[str, Union[str, pandas.Series.dtype]] Optional. A dictionary of column names pandas dtypes. The provided dtype is used when constructing the series for the column specified. Otherwise, the default pandas behavior is used.

Returns

Type	Description
pandas.DataFrame	A data frame of all rows in the stream.