ppl122 opened a new issue, #31914: URL: https://github.com/apache/beam/issues/31914
### What happened? My pipeline on GCP time to time log an exception, for last 24 hours it was 1_000 times: ` java.lang.IllegalStateException: Expected output stream to be empty but had <ByteString@6ea215ba size=33 contents="\002\030bison casino\002\000\b0.00\b0.00\f1.0000"> at org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.base.Preconditions.checkState ( org/apache.beam.vendor.guava.v32_1_2_jre.com.google.common.base/Preconditions.java:601 ) at org.apache.beam.runners.dataflow.worker.WindmillSink$WindmillStreamWriter.encode ( org/apache.beam.runners.dataflow.worker/WindmillSink.java:142 ) at org.apache.beam.runners.dataflow.worker.WindmillSink$WindmillStreamWriter.add ( org/apache.beam.runners.dataflow.worker/WindmillSink.java:159 ) at org.apache.beam.runners.dataflow.worker.WindmillSink$WindmillStreamWriter.add ( org/apache.beam.runners.dataflow.worker/WindmillSink.java:130 ) at org.apache.beam.runners.dataflow.worker.SizeReportingSinkWrapper$SizeLimitingWriterWrapper.add ( org/apache.beam.runners.dataflow.worker/SizeReportingSinkWrapper.java:63 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/WriteOperation.java:89 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/OutputReceiver.java:54 ) at org.apache.beam.runners.dataflow.worker.AssignWindowsParDoFnFactory$AssignWindowsParDoFn.processElement ( org/apache.beam.runners.dataflow.worker/AssignWindowsParDoFnFactory.java:115 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.ParDoOperation.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/ParDoOperation.java:44 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/OutputReceiver.java:54 ) at org.apache.beam.runners.dataflow.worker.SimpleParDoFn$1.output ( org/apache.beam.runners.dataflow.worker/SimpleParDoFn.java:285 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.outputWindowedValue ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:276 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.access$900 ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:86 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:432 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:412 ) at com.prizeengine.jobs.ParseMessageFromCasinoEngine.parseStringToLogElement ( com/prizeengine.jobs/ParseMessageFromCasinoEngine.java:123 ) at com.prizeengine.jobs.ParseMessageFromCasinoEngine$DoFnInvoker.invokeProcessElement at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:212 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.processElement ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:189 ) at org.apache.beam.runners.dataflow.worker.SimpleParDoFn.processElement ( org/apache.beam.runners.dataflow.worker/SimpleParDoFn.java:340 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.ParDoOperation.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/ParDoOperation.java:44 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/OutputReceiver.java:54 ) at org.apache.beam.runners.dataflow.worker.SimpleParDoFn$1.output ( org/apache.beam.runners.dataflow.worker/SimpleParDoFn.java:285 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.outputWindowedValue ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:276 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.access$900 ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:86 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:432 ) at org.apache.beam.sdk.transforms.DoFnOutputReceivers$WindowedContextOutputReceiver.output ( org/apache.beam.sdk.transforms/DoFnOutputReceivers.java:89 ) at org.apache.beam.sdk.transforms.MapElements$2.processElement ( org/apache.beam.sdk.transforms/MapElements.java:151 ) at org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:212 ) at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.processElement ( org/apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core/SimpleDoFnRunner.java:189 ) at org.apache.beam.runners.dataflow.worker.SimpleParDoFn.processElement ( org/apache.beam.runners.dataflow.worker/SimpleParDoFn.java:340 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.ParDoOperation.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/ParDoOperation.java:44 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process ( org/apache.beam.runners.dataflow.worker.util.common.worker/OutputReceiver.java:54 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.runReadLoop ( org/apache.beam.runners.dataflow.worker.util.common.worker/ReadOperation.java:218 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.start ( org/apache.beam.runners.dataflow.worker.util.common.worker/ReadOperation.java:169 ) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute ( org/apache.beam.runners.dataflow.worker.util.common.worker/MapTaskExecutor.java:83 ) at org.apache.beam.runners.dataflow.worker.streaming.ComputationWorkExecutor.executeWork ( org/apache.beam.runners.dataflow.worker.streaming/ComputationWorkExecutor.java:78 ) at org.apache.beam.runners.dataflow.worker.windmill.work.processing.StreamingWorkScheduler.executeWork ( org/apache.beam.runners.dataflow.worker.windmill.work.processing/StreamingWorkScheduler.java:377 ) at org.apache.beam.runners.dataflow.worker.windmill.work.processing.StreamingWorkScheduler.processWork ( org/apache.beam.runners.dataflow.worker.windmill.work.processing/StreamingWorkScheduler.java:252 ) at org.apache.beam.runners.dataflow.worker.windmill.work.processing.StreamingWorkScheduler.lambda$scheduleWork$2 ( org/apache.beam.runners.dataflow.worker.windmill.work.processing/StreamingWorkScheduler.java:211 ) at org.apache.beam.runners.dataflow.worker.streaming.ExecutableWork.run ( org/apache.beam.runners.dataflow.worker.streaming/ExecutableWork.java:38 ) at org.apache.beam.runners.dataflow.worker.util.BoundedQueueExecutor.lambda$executeMonitorHeld$0 ( org/apache.beam.runners.dataflow.worker.util/BoundedQueueExecutor.java:232 ) at java.util.concurrent.ThreadPoolExecutor.runWorker ( java/util.concurrent/ThreadPoolExecutor.java:1144 ) at java.util.concurrent.ThreadPoolExecutor$Worker.run ( java/util.concurrent/ThreadPoolExecutor.java:642 ) at java.lang.Thread.run ( java/lang/Thread.java:1583 ) ` The code is rather simple, a java class annotated with defaultCoder(Avro.class) put to output: `res = KV.of(sessionId, baseTransaction); c.output(res);` I tried to bring same guava version as in error log, but it doesn't help. ### Issue Priority Priority: 3 (minor) ### Issue Components - [ ] Component: Python SDK - [X] Component: Java SDK - [ ] Component: Go SDK - [ ] Component: Typescript SDK - [ ] Component: IO connector - [ ] Component: Beam YAML - [ ] Component: Beam examples - [ ] Component: Beam playground - [ ] Component: Beam katas - [ ] Component: Website - [ ] Component: Spark Runner - [ ] Component: Flink Runner - [ ] Component: Samza Runner - [ ] Component: Twister2 Runner - [ ] Component: Hazelcast Jet Runner - [X] Component: Google Cloud Dataflow Runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
