Ankur Goenka created BEAM-7736:
----------------------------------

             Summary: Retried work is messed up the SDKHarness work assignment
                 Key: BEAM-7736
                 URL: https://issues.apache.org/jira/browse/BEAM-7736
             Project: Beam
          Issue Type: Bug
          Components: runner-dataflow
            Reporter: Ankur Goenka


The retried work is silently skipped in 
[https://github.com/apache/beam/blob/f7cbf88f550c8918b99a13af4182d6efa07cd2b5/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/StreamingDataflowWorker.java#L2010]
 

This result into skipping of worker release work the corresponding duplicate 
work item and causes result into incorrect worker allocation for new work 
items. 

 

This does not impact the correctness of the job but it can have an impact on a 
long running streaming job with multiple SDKHarness like in case of python 
streaming.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to