See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/50/display/redirect?page=changes>
Changes: [Ismaël Mejía] [BEAM-12277] Update Flink 1.13 version to 1.13.1 [Ismaël Mejía] [BEAM-12424] Update Flink 1.12 to version 1.12.4 ------------------------------------------ [...truncated 696.27 KB...] May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) as step s5 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery0/SqlQuery0/SqlQuery0.Serialize as step s6 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_92/ParDo(Calc) as step s6 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_55/ParDo(Calc) as step s6 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_56/ParDo(Calc) as step s7 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous) as step s7 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) as step s7 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous) as step s8 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery2/SqlQuery2.Debug as step s8 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery1/SqlQuery1.Debug as step s8 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery0/SqlQuery0.Debug as step s9 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery2/SqlQuery2.Stamp as step s9 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery0/SqlQuery0.Stamp as step s10 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery1/SqlQuery1.Stamp as step s9 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery2.Format as step s10 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery1.Format as step s10 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery2.DevNull as step s11 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery0.Format as step s11 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery1.DevNull as step s11 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding SqlQuery0.DevNull as step s12 May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.31.0-SNAPSHOT May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.31.0-SNAPSHOT May 31, 2021 12:35:37 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.31.0-SNAPSHOT May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-31_05_35_37-13828155688456705049?project=apache-beam-testing May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-05-31_05_35_37-13828155688456705049 May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-05-31_05_35_37-13828155688456705049 May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-31_05_35_37-14798124915093312781?project=apache-beam-testing May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-05-31_05_35_37-14798124915093312781 May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-05-31_05_35_37-14798124915093312781 May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-31_05_35_37-5785604639207706482?project=apache-beam-testing May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-05-31_05_35_37-5785604639207706482 May 31, 2021 12:35:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-05-31_05_35_37-5785604639207706482 May 31, 2021 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-05-31T12:35:41.617Z: The requested max number of ****s (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE). May 31, 2021 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-05-31T12:35:41.434Z: The requested max number of ****s (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE). May 31, 2021 12:35:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-05-31T12:35:41.615Z: The requested max number of ****s (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE). May 31, 2021 12:35:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:45.740Z: Worker configuration: n1-standard-1 in us-central1-f. May 31, 2021 12:35:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:45.622Z: Worker configuration: n1-standard-1 in us-central1-f. May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.404Z: Expanding SplittableParDo operations into optimizable parts. May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.428Z: Expanding CollectionToSingleton operations into optimizable parts. May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.480Z: Expanding CoGroupByKey operations into optimizable parts. May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.518Z: Expanding GroupByKey operations into optimizable parts. May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.610Z: Fusing adjacent ParDo, Read, Write, and Flatten operations May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.641Z: Fusing consumer SqlQuery1.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into SqlQuery1.ReadBounded/Impulse May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.674Z: Fusing consumer SqlQuery1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into SqlQuery1.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.704Z: Fusing consumer SqlQuery1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into SqlQuery1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.750Z: Fusing consumer SqlQuery1/SqlQuery1.Monitor/ParMultiDo(Monitor) into SqlQuery1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.809Z: Fusing consumer SqlQuery1/SqlQuery1.Snoop/ParMultiDo(Anonymous) into SqlQuery1/SqlQuery1.Monitor/ParMultiDo(Monitor) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.847Z: Fusing consumer SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery1/SqlQuery1.Snoop/ParMultiDo(Anonymous) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.879Z: Fusing consumer SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.913Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_55/ParDo(Calc)/ParMultiDo(Calc) into SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.947Z: Fusing consumer SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_55/ParDo(Calc)/ParMultiDo(Calc) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.982Z: Fusing consumer SqlQuery1/SqlQuery1.Debug/ParMultiDo(Monitor) into SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:47.015Z: Fusing consumer SqlQuery1/SqlQuery1.Stamp/ParMultiDo(Anonymous) into SqlQuery1/SqlQuery1.Debug/ParMultiDo(Monitor) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:47.050Z: Fusing consumer SqlQuery1.Format/ParMultiDo(Anonymous) into SqlQuery1/SqlQuery1.Stamp/ParMultiDo(Anonymous) May 31, 2021 12:35:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:47.076Z: Fusing consumer SqlQuery1.DevNull/ParMultiDo(Anonymous) into SqlQuery1.Format/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:47.697Z: Executing operation SqlQuery1.ReadBounded/Impulse+SqlQuery1.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+SqlQuery1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+SqlQuery1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:47.778Z: Starting 4 ****s in us-central1-f... May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.422Z: Expanding SplittableParDo operations into optimizable parts. May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.447Z: Expanding CollectionToSingleton operations into optimizable parts. May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.504Z: Expanding CoGroupByKey operations into optimizable parts. May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.544Z: Expanding GroupByKey operations into optimizable parts. May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.590Z: Fusing adjacent ParDo, Read, Write, and Flatten operations May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.610Z: Fusing consumer SqlQuery0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into SqlQuery0.ReadBounded/Impulse May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.631Z: Fusing consumer SqlQuery0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into SqlQuery0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.653Z: Fusing consumer SqlQuery0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into SqlQuery0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.674Z: Fusing consumer SqlQuery0/SqlQuery0.Monitor/ParMultiDo(Monitor) into SqlQuery0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.704Z: Fusing consumer SqlQuery0/SqlQuery0.Snoop/ParMultiDo(Anonymous) into SqlQuery0/SqlQuery0.Monitor/ParMultiDo(Monitor) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.727Z: Fusing consumer SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery0/SqlQuery0.Snoop/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.752Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.802Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.Serialize/ParMultiDo(Anonymous) into SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.826Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_56/ParDo(Calc)/ParMultiDo(Calc) into SqlQuery0/SqlQuery0/SqlQuery0.Serialize/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.855Z: Fusing consumer SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_56/ParDo(Calc)/ParMultiDo(Calc) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.879Z: Fusing consumer SqlQuery0/SqlQuery0.Debug/ParMultiDo(Monitor) into SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.903Z: Fusing consumer SqlQuery0/SqlQuery0.Stamp/ParMultiDo(Anonymous) into SqlQuery0/SqlQuery0.Debug/ParMultiDo(Monitor) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.928Z: Fusing consumer SqlQuery0.Format/ParMultiDo(Anonymous) into SqlQuery0/SqlQuery0.Stamp/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:46.947Z: Fusing consumer SqlQuery0.DevNull/ParMultiDo(Anonymous) into SqlQuery0.Format/ParMultiDo(Anonymous) May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:47.219Z: Executing operation SqlQuery0.ReadBounded/Impulse+SqlQuery0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+SqlQuery0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+SqlQuery0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing May 31, 2021 12:35:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:47.288Z: Starting 4 ****s in us-central1-f... May 31, 2021 12:35:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:35:55.354Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete May 31, 2021 12:36:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:06.956Z: Worker configuration: n1-standard-1 in us-central1-b. May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:07.786Z: Expanding SplittableParDo operations into optimizable parts. May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:07.837Z: Expanding CollectionToSingleton operations into optimizable parts. May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:07.904Z: Expanding CoGroupByKey operations into optimizable parts. May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:07.945Z: Expanding GroupByKey operations into optimizable parts. May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.010Z: Fusing adjacent ParDo, Read, Write, and Flatten operations May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.041Z: Fusing consumer SqlQuery2.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into SqlQuery2.ReadBounded/Impulse May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.068Z: Fusing consumer SqlQuery2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into SqlQuery2.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.112Z: Fusing consumer SqlQuery2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into SqlQuery2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.170Z: Fusing consumer SqlQuery2/SqlQuery2.Monitor/ParMultiDo(Monitor) into SqlQuery2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.197Z: Fusing consumer SqlQuery2/SqlQuery2.Snoop/ParMultiDo(Anonymous) into SqlQuery2/SqlQuery2.Monitor/ParMultiDo(Monitor) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.224Z: Fusing consumer SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery2/SqlQuery2.Snoop/ParMultiDo(Anonymous) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.259Z: Fusing consumer SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.288Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_92/ParDo(Calc)/ParMultiDo(Calc) into SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.308Z: Fusing consumer SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous) into SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_92/ParDo(Calc)/ParMultiDo(Calc) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.333Z: Fusing consumer SqlQuery2/SqlQuery2.Debug/ParMultiDo(Monitor) into SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.362Z: Fusing consumer SqlQuery2/SqlQuery2.Stamp/ParMultiDo(Anonymous) into SqlQuery2/SqlQuery2.Debug/ParMultiDo(Monitor) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.388Z: Fusing consumer SqlQuery2.Format/ParMultiDo(Anonymous) into SqlQuery2/SqlQuery2.Stamp/ParMultiDo(Anonymous) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.419Z: Fusing consumer SqlQuery2.DevNull/ParMultiDo(Anonymous) into SqlQuery2.Format/ParMultiDo(Anonymous) May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:08.904Z: Executing operation SqlQuery2.ReadBounded/Impulse+SqlQuery2.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+SqlQuery2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+SqlQuery2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing May 31, 2021 12:36:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-31T12:36:09.025Z: Starting 4 ****s in us-central1-b... > Task :sdks:java:testing:nexmark:run FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=8fa2961d-3015-4556-a831-68cf295d7f71, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 22618 log file: /home/jenkins/.gradle/daemon/6.8.3/daemon-22618.out.log ----- Last 20 lines from daemon log file - daemon-22618.out.log ----- at org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:241) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:218) at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:369) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:87) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:365) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) ... 7 more ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210531123449 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0038b97aaabb5ee4127ed9e1648657ea4bca1418b06926e60fecfcdb1c910e1d Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
