[
https://issues.apache.org/jira/browse/BEAM-3408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17145302#comment-17145302
] Beam JIRA Bot commented on BEAM-3408: ------------------------------------- This issue was marked "stale-P2" and has not received a public comment in 14 days. It is now automatically moved to P3. If you are still affected by it, you can comment and move it back to P2. > PackageUtil should retry check for whether file is already staged > ----------------------------------------------------------------- > > Key: BEAM-3408 > URL: https://issues.apache.org/jira/browse/BEAM-3408 > Project: Beam > Issue Type: Bug > Components: runner-dataflow > Reporter: Henning Rohde > Priority: P3 > > The code to stage files retries the upload, but the existence (and size) > check is attempted only once: > https://github.com/apache/beam/blob/dc3a664e3b4b4f63500954aae25dce0cb5f8b314/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/util/PackageUtil.java#L193 > This causes post-commit tests to fail sometimes: > https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/org.apache.beam$beam-runners-google-cloud-dataflow-java/4632/testReport/junit/org.apache.beam.sdk.io/BoundedReadFromUnboundedSourceTest/testDedup/ > https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/org.apache.beam$beam-runners-google-cloud-dataflow-java/4636/testReport/junit/org.apache.beam.sdk.transforms/ViewTest/testEmptyMultimapSideInput/ > We should retry this check as well. -- This message was sent by Atlassian Jira (v8.3.4#803005)
