Daniel Halperin created BEAM-747: ------------------------------------ Summary: Text checksum verifier is not resilient to eventually consistent filesystems Key: BEAM-747 URL: https://issues.apache.org/jira/browse/BEAM-747 Project: Beam Issue Type: Bug Components: testing Affects Versions: Not applicable Reporter: Daniel Halperin Assignee: Mark Liu
Example 1: https://builds.apache.org/job/beam_PreCommit_MavenVerify/3934/org.apache.beam$beam-examples-java/console Here it looks like we need to retry listing files, at least a little bit, if none are found. They did show up: {code} gsutil ls gs://temp-storage-for-end-to-end-tests/WordCountIT-2016-10-13-12-37-02-467/output/results\* gs://temp-storage-for-end-to-end-tests/WordCountIT-2016-10-13-12-37-02-467/output/results-00000-of-00003 gs://temp-storage-for-end-to-end-tests/WordCountIT-2016-10-13-12-37-02-467/output/results-00001-of-00003 gs://temp-storage-for-end-to-end-tests/WordCountIT-2016-10-13-12-37-02-467/output/results-00002-of-00003 {code} Example 2: -- This message was sent by Atlassian JIRA (v6.3.4#6332)