GitHub user azurezyq opened a pull request:
https://github.com/apache/beam/pull/3995
Add custom gcs temp location support to BigQueryIO.
BigQueryIO currently writes temp files to PipelineOptions.tempLocation,
which is not ValueProvider-wrapped. Which makes the generated dataflow
templates cannot be used across projects.
In this PR, a new method withCustomGcsTempLocation() is introduced to solve
the problem.
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/azurezyq/beam template
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3995.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3995
----
commit 1b7446d9794b1c9bcc3528e229693f7b78cb6fd5
Author: Yunqing Zhou <[email protected]>
Date: 2017-10-13T22:52:18Z
Add custom tempLocation support to BigQueryIO.
commit e9a74589eeadbd48c4ef3bef03f036141ab28a1d
Author: Yunqing Zhou <[email protected]>
Date: 2017-10-14T01:21:21Z
rename it from customTempLocation to customGcsLocation
commit 08ee48b6702d28813dc216bca3fb8d35a07b024d
Author: Yunqing Zhou <[email protected]>
Date: 2017-10-14T01:42:45Z
fix valueprovider bug
----
---
