[
https://issues.apache.org/jira/browse/BEAM-11587?focusedWorklogId=750574&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-750574
]
ASF GitHub Bot logged work on BEAM-11587:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Mar/22 22:27
Start Date: 30/Mar/22 22:27
Worklog Time Spent: 10m
Work Description: svetakvsundhar commented on pull request #17159:
URL: https://github.com/apache/beam/pull/17159#issuecomment-1083695799
R: @TheNeuralBit
Hi Brian,
As we discussed, on testing this function, we'll need OAuth since we are
reading from a BQ table, and thus it might make more sense to write an
integration test for this. Currently to unit test this, we can
1) Write a mock schema and test the code after that (skipping getting the
schema from a BQ table). We could ensure usertypes.__annotations is giving us
what we expect it to.
2) I can write the other function (WritetoBQ) in this PR, and use it to help
with the unit testing.
Let me know your thoughts, I think 1) might be a good option for the unit
test purpose.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 750574)
Time Spent: 2h 10m (was: 2h)
> Support pd.read_gbq and DataFrame.to_gbq
> ----------------------------------------
>
> Key: BEAM-11587
> URL: https://issues.apache.org/jira/browse/BEAM-11587
> Project: Beam
> Issue Type: New Feature
> Components: dsl-dataframe, io-py-gcp, sdk-py-core
> Reporter: Brian Hulette
> Assignee: Svetak Vihaan Sundhar
> Priority: P3
> Labels: dataframe-api
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> We should support
> [read_gbq|https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_gbq.html]
> andÂ
> [to_gbq|https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.to_gbq.html]
> in the DataFrame API when gcp extras are installed.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
