[
https://issues.apache.org/jira/browse/BEAM-6713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kyle Winkelman updated BEAM-6713:
---------------------------------
Summary: FileIO and TextIO unable to alter WriteFiles maxNumWritersPerBundl
(was: FileIO and TextIO Unable to alter WriteFiles maxNumWritersPerBundle)
> FileIO and TextIO unable to alter WriteFiles maxNumWritersPerBundl
> ------------------------------------------------------------------
>
> Key: BEAM-6713
> URL: https://issues.apache.org/jira/browse/BEAM-6713
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Kyle Winkelman
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> When attempting to run a batch workflow with a FileIO.write() I was getting
> job failures due to WriteFiles.DEFAULT_MAX_NUM_WRITERS_PER_BUNDLE causing a
> significant amount of data to be shuffled. My issues would be solved by
> increasing this and luckily WriteFiles already has withMaxNumWritersPerBundle
> but unfortunately FileIO and TextIO do not.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
