GitHub user ubunatic opened a pull request:
https://github.com/apache/beam/pull/2582
[BEAM-1909] BigQuery read transform fails for DirectRunner when querying
non-US regions
**Note**: This is an updated and condensed PR for the original PR:
https://github.com/apache/beam/pull/2509
**Description**:
I partially (!) fixed the issue by getting the location of the source
table. Then I use this location as location of the created temp dataset. The
added parameters are optional and should not break anything.
**Tests**: I tested with an US and EU dataset as source in a
`DirectRunner`, i.e., using a `BigQuerySource` with `table=<some-table>`.
**What's missing**: It does not work for a `BigQuerySource` with
`query=<some-query>`.
The corresponding Jira issue should not yet be closed.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ubunatic/beam
set-temp-table-region-for-table-source
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/2582.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2582
----
commit 615f6fad7930819748c5fec3a2b313f137ef8c6f
Author: Uwe Jugel <[email protected]>
Date: 2017-04-12T12:56:50Z
add temp dataset location for non-query BigQuerySource
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
