GitHub user reuvenlax opened a pull request:
https://github.com/apache/beam/pull/3863
[Beam-2858] Ensure that file deletion happens consistently, and only after
table loads are completed
We do this by adding a GroupByKey between the BQ load and the file
deletion. Once the @StableReplay proposal is implemented, we will replace with
a solution that uses that instead.
R: @jkff
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/reuvenlax/incubator-beam BEAM-2858
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3863.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3863
----
commit c203331efdd24551e5f7270c55507791fdc9367b
Author: Reuven Lax <[email protected]>
Date: 2017-09-19T17:10:18Z
Fix bug.
commit 6cfacb8a6324d9b5a69c7d1dae82e6c1581d85af
Author: Reuven Lax <[email protected]>
Date: 2017-09-19T17:17:51Z
Some fixups.
----
---
