Class ReadRowsIterable (2.24.0)

Version 2.24.0

• 2.27.0 (latest)
• 2.26.0
• 2.25.0
• 2.24.0
• 2.23.0
• 2.22.0
• 2.21.0
• 2.20.0
• 2.19.1
• 2.18.1
• 2.17.0
• 2.16.2
• 2.15.0
• 2.14.2
• 2.13.2
• 2.12.0
• 2.11.0
• 2.10.1
• 2.9.1
• 2.8.0
• 2.7.0
• 2.6.3
• 2.5.0
• 2.4.0
• 2.3.0
• 2.2.1
• 2.1.0
• 2.0.1
• 1.1.2
• 1.0.0
• 0.8.0
• 0.7.0
• 0.6.0

ReadRowsIterable(reader, read_session=None)

An iterable of rows from a read session.

Parameters
Name	Description
reader	google.cloud.bigquery_storage_v1.reader.ReadRowsStream A read rows stream.
read_session	Optional[ReadSession] DEPRECATED. This argument was used to specify the schema of the rows in the stream, but now the first message in a read stream contains this information.

Properties

pages

A generator of all pages in the stream.

Returns
Type	Description
types.GeneratorType[google.cloud.bigquery_storage_v1.ReadRowsPage]	A generator of pages.

Methods

__iter__

__iter__()

Iterator for each row in all pages.

to_arrow

to_arrow()

Create a pyarrow.Table of all rows in the stream.

This method requires the pyarrow library and a stream using the Arrow format.

Returns
Type	Description
pyarrow.Table	A table of all rows in the stream.

to_dataframe

to_dataframe(dtypes=None)

Create a pandas.DataFrame of all rows in the stream.

This method requires the pandas libary to create a data frame and the fastavro library to parse row messages.

Warning: DATETIME columns are not supported. They are currently parsed as strings in the fastavro library.

Parameter
Name	Description
dtypes	Map[str, Union[str, pandas.Series.dtype]] Optional. A dictionary of column names pandas dtypes. The provided dtype is used when constructing the series for the column specified. Otherwise, the default pandas behavior is used.

Returns
Type	Description
pandas.DataFrame	A data frame of all rows in the stream.