See <https://ci-beam.apache.org/job/beam_PostCommit_Python36/4097/display/redirect>
Changes: ------------------------------------------ [...truncated 47.57 MB...] apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2021-07-11_06_16_13-11282561498706325615 is in state JOB_STATE_RUNNING apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:16.479Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2021-07-11_06_16_13-11282561498706325615. The number of workers will be between 1 and 1000. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:16.576Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2021-07-11_06_16_13-11282561498706325615. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:18.154Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-b. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:18.794Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:18.829Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:18.900Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:18.945Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step GroupByKey: GroupByKey not followed by a combiner. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:18.967Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.005Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.026Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.077Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.104Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/FlatMap(<lambda at core.py:2972>) into Create/Impulse apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.136Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/AddRandomKeys into Create/FlatMap(<lambda at core.py:2972>) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.169Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps) into Create/MaybeReshuffle/Reshuffle/AddRandomKeys apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.203Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.232Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.260Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.287Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps) into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.320Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.343Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/Map(decode) into Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.368Z: JOB_MESSAGE_DETAILED: Fusing consumer metrics into Create/Map(decode) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.395Z: JOB_MESSAGE_DETAILED: Fusing consumer map_to_common_key into metrics apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.421Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Reify into map_to_common_key apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.446Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Write into GroupByKey/Reify apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.477Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/GroupByWindow into GroupByKey/Read apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.500Z: JOB_MESSAGE_DETAILED: Fusing consumer m_out into GroupByKey/GroupByWindow apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.529Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.556Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.582Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.608Z: JOB_MESSAGE_DEBUG: Assigning stage ids. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.838Z: JOB_MESSAGE_DEBUG: Executing wait step start23 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.903Z: JOB_MESSAGE_BASIC: Executing operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.939Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:19.969Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b... apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:20.263Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:20.322Z: JOB_MESSAGE_DEBUG: Value "Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Session" materialized. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:20.473Z: JOB_MESSAGE_BASIC: Executing operation Create/Impulse+Create/FlatMap(<lambda at core.py:2972>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:16:54.225Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:17:36.315Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:17:36.355Z: JOB_MESSAGE_DETAILED: Workers have started successfully. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:05.207Z: JOB_MESSAGE_ERROR: java.lang.ExceptionInInitializerError at org.apache.beam.runners.dataflow.worker.ShuffleLibrary.load(ShuffleLibrary.java:33) at org.apache.beam.runners.dataflow.worker.ApplianceShuffleWriter.<clinit>(ApplianceShuffleWriter.java:35) at org.apache.beam.runners.dataflow.worker.ShuffleSink.writer(ShuffleSink.java:348) at org.apache.beam.runners.dataflow.worker.SizeReportingSinkWrapper.writer(SizeReportingSinkWrapper.java:46) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.initializeWriter(WriteOperation.java:71) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.start(WriteOperation.java:78) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:92) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:127) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:420) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:389) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:233) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:141) Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:223) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.abort(RegisterAndProcessBundleOperation.java:354) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortReadOperation.abort(RemoteGrpcPortReadOperation.java:95) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getProcessBundleResponse(RegisterAndProcessBundleOperation.java:620) at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getFinalMonitoringInfos(RegisterAndProcessBundleOperation.java:401) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor$SingularProcessBundleProgressTracker.stop(BeamFnMapTaskExecutor.java:476) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.lambda$progressTrackerCloseable$0(BeamFnMapTaskExecutor.java:134) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.$closeResource(BeamFnMapTaskExecutor.java:129) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:129) ... 5 more Caused by: java.lang.RuntimeException: Loading shuffle_client failed: at org.apache.beam.runners.dataflow.worker.ShuffleLibrary$ShuffleLibraryLoader.<clinit>(ShuffleLibrary.java:51) ... 13 more Caused by: java.io.IOException: No space left on device at sun.nio.ch.FileDispatcherImpl.write0(Native Method) at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60) at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) at sun.nio.ch.IOUtil.write(IOUtil.java:65) at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211) at java.nio.channels.Channels.writeFullyImpl(Channels.java:78) at java.nio.channels.Channels.writeFully(Channels.java:101) at java.nio.channels.Channels.access$000(Channels.java:61) at java.nio.channels.Channels$1.write(Channels.java:174) at java.nio.file.Files.copy(Files.java:2909) at java.nio.file.Files.copy(Files.java:3027) at org.apache.beam.runners.dataflow.worker.ShuffleLibrary$ShuffleLibraryLoader.<clinit>(ShuffleLibrary.java:48) ... 13 more apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:07.412Z: JOB_MESSAGE_ERROR: java.lang.NoClassDefFoundError: Could not initialize class org.apache.beam.runners.dataflow.worker.ApplianceShuffleWriter at org.apache.beam.runners.dataflow.worker.ShuffleSink.writer(ShuffleSink.java:348) at org.apache.beam.runners.dataflow.worker.SizeReportingSinkWrapper.writer(SizeReportingSinkWrapper.java:46) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.initializeWriter(WriteOperation.java:71) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.start(WriteOperation.java:78) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:92) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:127) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:420) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:389) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:233) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:141) Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:223) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.abort(RegisterAndProcessBundleOperation.java:354) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortReadOperation.abort(RemoteGrpcPortReadOperation.java:95) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getProcessBundleResponse(RegisterAndProcessBundleOperation.java:620) at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getFinalMonitoringInfos(RegisterAndProcessBundleOperation.java:401) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor$SingularProcessBundleProgressTracker.stop(BeamFnMapTaskExecutor.java:476) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.lambda$progressTrackerCloseable$0(BeamFnMapTaskExecutor.java:134) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.$closeResource(BeamFnMapTaskExecutor.java:129) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:129) ... 5 more apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:09.594Z: JOB_MESSAGE_ERROR: java.lang.NoClassDefFoundError: Could not initialize class org.apache.beam.runners.dataflow.worker.ApplianceShuffleWriter at org.apache.beam.runners.dataflow.worker.ShuffleSink.writer(ShuffleSink.java:348) at org.apache.beam.runners.dataflow.worker.SizeReportingSinkWrapper.writer(SizeReportingSinkWrapper.java:46) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.initializeWriter(WriteOperation.java:71) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.start(WriteOperation.java:78) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:92) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:127) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:420) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:389) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:233) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:141) Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:223) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.abort(RegisterAndProcessBundleOperation.java:354) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortReadOperation.abort(RemoteGrpcPortReadOperation.java:95) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getProcessBundleResponse(RegisterAndProcessBundleOperation.java:620) at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getFinalMonitoringInfos(RegisterAndProcessBundleOperation.java:401) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor$SingularProcessBundleProgressTracker.stop(BeamFnMapTaskExecutor.java:476) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.lambda$progressTrackerCloseable$0(BeamFnMapTaskExecutor.java:134) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.$closeResource(BeamFnMapTaskExecutor.java:129) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:129) ... 5 more apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:11.757Z: JOB_MESSAGE_ERROR: java.lang.NoClassDefFoundError: Could not initialize class org.apache.beam.runners.dataflow.worker.ApplianceShuffleWriter at org.apache.beam.runners.dataflow.worker.ShuffleSink.writer(ShuffleSink.java:348) at org.apache.beam.runners.dataflow.worker.SizeReportingSinkWrapper.writer(SizeReportingSinkWrapper.java:46) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.initializeWriter(WriteOperation.java:71) at org.apache.beam.runners.dataflow.worker.util.common.worker.WriteOperation.start(WriteOperation.java:78) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:92) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:127) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:420) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:389) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:233) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:141) Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:223) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.abort(RegisterAndProcessBundleOperation.java:354) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortReadOperation.abort(RemoteGrpcPortReadOperation.java:95) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:109) ... 6 more Suppressed: java.lang.NullPointerException at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getProcessBundleResponse(RegisterAndProcessBundleOperation.java:620) at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.getFinalMonitoringInfos(RegisterAndProcessBundleOperation.java:401) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor$SingularProcessBundleProgressTracker.stop(BeamFnMapTaskExecutor.java:476) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.lambda$progressTrackerCloseable$0(BeamFnMapTaskExecutor.java:134) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.$closeResource(BeamFnMapTaskExecutor.java:129) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:129) ... 5 more apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:11.780Z: JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at core.py:2972>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:11.843Z: JOB_MESSAGE_DEBUG: Executing failure step failure22 apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:11.877Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S02:Create/Impulse+Create/FlatMap(<lambda at core.py:2972>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: beamapp-jenkins-071113160-07110616-7coj-harness-kznw Root cause: Work item failed., beamapp-jenkins-071113160-07110616-7coj-harness-kznw Root cause: Work item failed., beamapp-jenkins-071113160-07110616-7coj-harness-kznw Root cause: Work item failed., beamapp-jenkins-071113160-07110616-7coj-harness-kznw Root cause: Work item failed. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:11.956Z: JOB_MESSAGE_DETAILED: Cleaning up. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:12.016Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:23:12.041Z: JOB_MESSAGE_BASIC: Stopping worker pool... oauth2client.transport: INFO: Refreshing due to a 401 (attempt 1/2) apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:24:04.322Z: JOB_MESSAGE_BASIC: Worker pool stopped. apache_beam.runners.dataflow.dataflow_runner: INFO: 2021-07-11T13:24:04.346Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2021-07-11_06_16_13-11282561498706325615 is in state JOB_STATE_FAILED --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: nosetests-postCommitIT-df-py36.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 74 tests in 5615.574s FAILED (SKIP=8, errors=1) > Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 126 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 36m 18s 216 actionable tasks: 153 executed, 59 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/6d7carccaq3w2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
