This is an automated email from the ASF dual-hosted git repository.
tvalentyn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 5656e26 Merge pull request #16003 from [BEAM-13268] Change
autosharding big query inserts to happen in parallel for a bundle.
add c26edbc [BEAM-12818] Write windowed file output to a consistent
subdirectory of the temporary directory and with hash prefix. This ensures
that files have distributed prefix that is common across pipeline executions
and thus can reuse GCS autoscaling of the file metadata.
add d3544f0 [BEAM-12818] Write windowed temporary files to consistent
temporary directory and with hash prefix #15416
No new revisions were added by this update.
Summary of changes:
.../java/org/apache/beam/sdk/io/FileBasedSink.java | 100 ++++++++++++++-------
.../java/org/apache/beam/sdk/io/WriteFiles.java | 19 ++--
.../org/apache/beam/sdk/io/FileBasedSinkTest.java | 11 ++-
.../java/org/apache/beam/sdk/io/SimpleSink.java | 4 -
4 files changed, 86 insertions(+), 48 deletions(-)
