Kyle Winkelman created BEAM-6713:
------------------------------------
Summary: FileIO and TextIO Unable to alter WriteFiles
maxNumWritersPerBundle
Key: BEAM-6713
URL: https://issues.apache.org/jira/browse/BEAM-6713
Project: Beam
Issue Type: Improvement
Components: sdk-java-core
Reporter: Kyle Winkelman
When attempting to run a batch workflow with a FileIO.write() I was getting job
failures due to WriteFiles.DEFAULT_MAX_NUM_WRITERS_PER_BUNDLE causing a
significant amount of data to be shuffled. My issues would be solved by
increasing this and luckily WriteFiles already has withMaxNumWritersPerBundle
but unfortunately FileIO and TextIO do not.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
