[ https://issues.apache.org/jira/browse/BEAM-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ahmet Altay updated BEAM-7689: ------------------------------ Affects Version/s: 2.5.0 2.6.0 2.7.0 2.8.0 2.9.0 2.10.0 2.11.0 2.12.0 2.13.0 > Temporary directory for WriteOperation may not be unique in FileBaseSink > ------------------------------------------------------------------------ > > Key: BEAM-7689 > URL: https://issues.apache.org/jira/browse/BEAM-7689 > Project: Beam > Issue Type: Bug > Components: io-java-files > Affects Versions: 2.5.0, 2.6.0, 2.7.0, 2.8.0, 2.9.0, 2.10.0, 2.11.0, > 2.12.0, 2.13.0 > Reporter: Heejong Lee > Assignee: Heejong Lee > Priority: Blocker > Fix For: 2.14.0 > > Time Spent: 3h 40m > Remaining Estimate: 0h > > Temporary directory for WriteOperation in FileBasedSink is generated from a > second-granularity timestamp (yyyy-MM-dd_HH-mm-ss) and unique increasing > index. Such granularity is not enough to make temporary directories unique > between different jobs. When two jobs share the same temporary directory, > output file may not be produced in one job since the required temporary file > can be deleted from another job. -- This message was sent by Atlassian Jira (v8.3.4#803005)