[
https://issues.apache.org/jira/browse/BEAM-1909?focusedWorklogId=105014&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-105014
]
ASF GitHub Bot logged work on BEAM-1909:
----------------------------------------
Author: ASF GitHub Bot
Created on: 23/May/18 07:40
Start Date: 23/May/18 07:40
Worklog Time Spent: 10m
Work Description: DannyLee12 opened a new pull request #5435: [BEAM-1909]
Fixes BigQuery read transform fails for DirectRunner when querying non-US
regions
URL: https://github.com/apache/beam/pull/5435
Added a fix to the Issue metioned above.
Includes
---
- Add regex to get projectid, datasetid and table id from both legacy and
standard sql when project is provided
- Add regex to get datasetId and tableId from both legacy and standardsql
when project is NOT provided.
- Add ability to use project attribute that already existed on
BigQuerySource class
- If project is not provided at all, do not break the existing
distributions. Therefore, nothing happens and the tables are created in
location=None. This defaults back to US on directRunner but *should* work when
running in dataflow.
Cavets
---
- I have not updated the unit tests, if required, please point me in the
right direction.
- I can post screen shots of all 6 test cases as required. these are:
1. legacysql project provided in FROM clause
1. legacysql project not provided in From clause but provided as an argument
1. legacysql project not provided at all.
1. Same 3 for standard sql
------------------------
Follow this checklist to help us incorporate your contribution quickly and
easily:
It will help us expedite review of your Pull Request if you tag someone
(e.g. `@username`) to look at it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 105014)
Time Spent: 40m (was: 0.5h)
> BigQuery read transform fails for DirectRunner when querying non-US regions
> ---------------------------------------------------------------------------
>
> Key: BEAM-1909
> URL: https://issues.apache.org/jira/browse/BEAM-1909
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Chamikara Jayalath
> Priority: Major
> Time Spent: 40m
> Remaining Estimate: 0h
>
> See:
> http://stackoverflow.com/questions/42135002/google-dataflow-cannot-read-and-write-in-different-locations-python-sdk-v0-5-5/42144748?noredirect=1#comment73621983_42144748
> This should be fixed by creating the temp dataset and table in the correct
> region.
> cc: [~sb2nov]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
