[
https://issues.apache.org/jira/browse/AIRFLOW-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387075#comment-16387075
]
Diane Ivy commented on AIRFLOW-2118:
------------------------------------
[~Yuyin.Yang] This seems to fixed in the latest version since it no longer uses
the gbq_parse_data.
> get_pandas_df does always pass a list of rows to be parsed
> ----------------------------------------------------------
>
> Key: AIRFLOW-2118
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2118
> Project: Apache Airflow
> Issue Type: Bug
> Components: contrib, hooks
> Affects Versions: 1.9.0
> Environment: pandas-gbp 0.3.1
> Reporter: Diane Ivy
> Assignee: Diane Ivy
> Priority: Minor
> Labels: easyfix
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> While trying to parse the pages in get_pandas_df if only one page is returned
> it starts popping off each row and then the gbq_parse_data works incorrectly.
> {{while len(pages) > 0:}}
> {{ page = pages.pop()}}
> {{ dataframe_list.append(gbq_parse_data(schema, page))}}
> Possible solution:
> {{from google.cloud import bigquery}}
> {{if isinstance(pages[0], bigquery.table.Row):}}
> {{ pages = [pages]}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
