scwhittle opened a new issue, #23881:
URL: https://github.com/apache/beam/issues/23881

   ### What happened?
   
   Full stack trace (ocr from image so may be slightly off):
   "java.lang.IllegalArgumentException: Work completed and work remaining must 
be greater than or equal to zero but were 3.332476747E9
   and -1.666238373E9.
   Consumer Registry.java:434)
   }
   at org.apache.beam.sdk.transforms.splittabledofn. Restriction Tracker 
$Progress. from (RestrictionTracker.java:189)
   at org.apache.beam.fn.harness.FnApiDoFnRunner.scale Progress 
(FnApiDoFnRunner.java:1183) at org.apache.beam.fn.harness. 
FnApiDoFnRunner.getProgress (FnApiDoFnRunner.java:1157)
   at org.apache.beam.fn.harness.FnApiDoFnRunner.access$1700 
(FnApiDoFnRunner.java:145)
   at org.apache.beam.fn.harness. 
FnApiDoFnRunner$SplittableFnDataReceiver.getProgress (FnApiDoFnRunner.java:1143)
   at org.apache.beam.fn.harness.data.PCollectionConsumer 
Registry$SplittingMetricTrackingFnDataReceiver.getProgress (PCollection at 
org.apache.beam.fn.harness. BeamFnDataReadRunner.trySplit 
(BeamFnDataReadRunner.java:266)
   at org.apache.beam.fn.harness.control. ProcessBundleHandler.trySplit 
(ProcessBundleHandler.java:728)
   at org.apache.beam.fn.harness.control. 
BeamFnControlClient.delegateOnInstruction 
RequestType(BeamFnControlClient.java:151) at 
org.apache.beam.fn.harness.control. 
BeamFnControlClient$InboundObserver.lambda$onNext$0 
(BeamFnControlClient.java:116)
   at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   at java.lang.Thread.run(Thread.java:750)
   
   Since the input progress was constructed successfully and thus has positive 
fields it seems that windowCurrentIndex >= windowStopIndex must be true, 
causing the work remaining to be multipled by a negative value.  It seems this 
may be possible due to a race between windowCurrentIndex being incremented to 
windowStopIndex and the tracker/window being set to null preventing getProgress 
from running.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: sdk-java-harness


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to