[ https://issues.apache.org/jira/browse/BEAM-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Halperin resolved BEAM-814. ---------------------------------- Resolution: Fixed Fix Version/s: 0.5.0 > Improve performance when staging files > -------------------------------------- > > Key: BEAM-814 > URL: https://issues.apache.org/jira/browse/BEAM-814 > Project: Beam > Issue Type: Improvement > Components: runner-dataflow > Reporter: Daniel Halperin > Assignee: Daniel Halperin > Priority: Minor > Fix For: 0.5.0 > > > Right now, {{PackageUtil}} hashes/compresses/sizes files, checks if they have > already been staged, and uploads them if not, completely serially. > There is some low-hanging fruit to parallelize this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)