[ https://issues.apache.org/jira/browse/BEAM-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amit Sela resolved BEAM-1052. ----------------------------- Resolution: Fixed Fix Version/s: 0.4.0-incubating > UnboundedSource splitId uniqueness breaks if more than one source is used. > -------------------------------------------------------------------------- > > Key: BEAM-1052 > URL: https://issues.apache.org/jira/browse/BEAM-1052 > Project: Beam > Issue Type: Bug > Components: runner-spark > Reporter: Amit Sela > Assignee: Aviem Zur > Fix For: 0.4.0-incubating > > > We use a "running-id" to identify source splits, but we reiterate for each > source evaluated. > Spark already assigns a unique id per InputDStream, it would be unique enough > if we replace {{MicrobatchSource}} hash code with one containing both the > running-id and the InputDStream id. -- This message was sent by Atlassian JIRA (v6.3.4#6332)