See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/8350/display/redirect?page=changes>
Changes: [Pablo Estrada] Simplify README for new users [laraschmidt] Fix final allowskew error to properly handle a large allowedSkew [noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on ------------------------------------------ [...truncated 1.27 MB...] INFO: 2022-02-18T00:22:24.964Z: Starting 4 ****s in us-central1-b... Feb 18, 2022 12:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:25.383Z: Worker configuration: e2-standard-2 in us-central1-b. Feb 18, 2022 12:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.401Z: Expanding CoGroupByKey operations into optimizable parts. Feb 18, 2022 12:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.453Z: Expanding GroupByKey operations into optimizable parts. Feb 18, 2022 12:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.487Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Feb 18, 2022 12:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.573Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 18, 2022 12:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.616Z: Fusing consumer SqlQuery1/SqlQuery1.Monitor into SqlQuery1.ReadBounded Feb 18, 2022 12:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.649Z: Fusing consumer SqlQuery1/SqlQuery1.Snoop into SqlQuery1/SqlQuery1.Monitor Feb 18, 2022 12:22:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:25.789Z: Executing operation NexmarkUtils.GenerateSideInputData/GenerateSequence/Read(BoundedCountingSource)+NexmarkUtils.GenerateSideInputData/MapElements/Map+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SideToRows/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:22:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:25.822Z: Executing operation SqlBoundedSideInputJoin.ReadBounded+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Monitor+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Snoop+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/Filter/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.SelectEvent/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_1156/ParMultiDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/extractKeylhs+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable0+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.683Z: Fusing consumer SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) into SqlQuery1/SqlQuery1.Snoop Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.724Z: Fusing consumer SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) into SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.759Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_166/ParMultiDo(Calc) into SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.790Z: Fusing consumer SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_166/ParMultiDo(Calc) Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.819Z: Fusing consumer SqlQuery1/SqlQuery1.Debug into SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.856Z: Fusing consumer SqlQuery1/SqlQuery1.Stamp into SqlQuery1/SqlQuery1.Debug Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.889Z: Fusing consumer SqlQuery1.Format into SqlQuery1/SqlQuery1.Stamp Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:26.915Z: Fusing consumer SqlQuery1.DevNull into SqlQuery1.Format Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:27.395Z: Executing operation SqlQuery1.ReadBounded+SqlQuery1/SqlQuery1.Monitor+SqlQuery1/SqlQuery1.Snoop+SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_166/ParMultiDo(Calc)+SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1.Debug+SqlQuery1/SqlQuery1.Stamp+SqlQuery1.Format+SqlQuery1.DevNull Feb 18, 2022 12:22:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:27.508Z: Starting 4 ****s in us-central1-b... Feb 18, 2022 12:22:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:30.527Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:22:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:35.680Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:22:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:41.354Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:22:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:41.226Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:22:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:44.023Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:22:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:22:49.090Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:23:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:00.254Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:00.290Z: Resized **** pool to 1, though goal was 4. This could be a quota issue. Feb 18, 2022 12:23:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:04.447Z: Autoscaling: Raised the number of ****s to 2 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:04.470Z: Resized **** pool to 2, though goal was 4. This could be a quota issue. Feb 18, 2022 12:23:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:05.828Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:10.548Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:10.620Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:11.665Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:14.759Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:20.629Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:23:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:29.133Z: Workers have started successfully. Feb 18, 2022 12:23:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:29.163Z: Workers have started successfully. Feb 18, 2022 12:23:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:33.183Z: Workers have started successfully. Feb 18, 2022 12:23:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:33.211Z: Workers have started successfully. Feb 18, 2022 12:23:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:34.968Z: Workers have started successfully. Feb 18, 2022 12:23:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:34.993Z: Workers have started successfully. Feb 18, 2022 12:23:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:37.877Z: Workers have started successfully. Feb 18, 2022 12:23:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:37.905Z: Workers have started successfully. Feb 18, 2022 12:23:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:41.947Z: Workers have started successfully. Feb 18, 2022 12:23:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:41.976Z: Workers have started successfully. Feb 18, 2022 12:23:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:45.292Z: Workers have started successfully. Feb 18, 2022 12:23:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:23:45.338Z: Workers have started successfully. Feb 18, 2022 12:24:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:00.692Z: Finished operation NexmarkUtils.GenerateSideInputData/GenerateSequence/Read(BoundedCountingSource)+NexmarkUtils.GenerateSideInputData/MapElements/Map+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SideToRows/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:10.046Z: Finished operation SqlQuery2.ReadBounded+SqlQuery2/SqlQuery2.Monitor+SqlQuery2/SqlQuery2.Snoop+SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_261/ParMultiDo(Calc)+SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2.Debug+SqlQuery2/SqlQuery2.Stamp+SqlQuery2.Format+SqlQuery2.DevNull Feb 18, 2022 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:10.280Z: Cleaning up. Feb 18, 2022 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:10.395Z: Stopping **** pool... Feb 18, 2022 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:10.252Z: Finished operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_1692/ParMultiDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_1691/ParMultiDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/extractKeylhs+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:10.333Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close Feb 18, 2022 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:10.393Z: Finished operation SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close Feb 18, 2022 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:10.472Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Select.Fields/ParDo(Select)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_1694/ParMultiDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull Feb 18, 2022 12:24:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:12.504Z: Finished operation SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlQuery3/SqlQuery3/SqlTransform/BeamCoGBKJoinRel_1693/Select.Fields/ParDo(Select)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_1694/ParMultiDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull Feb 18, 2022 12:24:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:12.664Z: Cleaning up. Feb 18, 2022 12:24:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:12.736Z: Stopping **** pool... Feb 18, 2022 12:24:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:16.311Z: Finished operation SqlBoundedSideInputJoin.ReadBounded+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Monitor+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Snoop+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/Filter/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.SelectEvent/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_1156/ParMultiDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/extractKeylhs+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable0+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:24:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:16.386Z: Executing operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close Feb 18, 2022 12:24:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:16.441Z: Finished operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close Feb 18, 2022 12:24:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:16.510Z: Executing operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Select.Fields/ParDo(Select)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_1159/ParMultiDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/ResultToBid/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Debug+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Stamp+SqlBoundedSideInputJoin.Format+SqlBoundedSideInputJoin.DevNull Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.223Z: Finished operation SqlQuery7.ReadBounded+SqlQuery7/SqlQuery7.Monitor+SqlQuery7/SqlQuery7.Snoop+SqlQuery7/SqlQuery7/Filter/ParDo(Anonymous)+SqlQuery7/SqlQuery7/SqlQuery7.SelectEvent/ParDo(Anonymous)+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_675/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_671/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/assignEventTimestamp/AddTimestamps+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Window.Into()/Window.Assign+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/GroupByKey+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/Combine/Partial+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/GroupByKey/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/assignEventTimestamp/AddTimestamps+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Window.Into()/Window.Assign+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/GroupByKey+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/Combine/Partial+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/GroupByKey/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/GroupByKey/Write+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/GroupByKey/Write Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.311Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/GroupByKey/Close Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.347Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/GroupByKey/Close Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.373Z: Finished operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/GroupByKey/Close Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.395Z: Finished operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/GroupByKey/Close Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.460Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Create Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.660Z: Finished operation SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Create Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.848Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/Combine+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/Combine/Extract+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToRow+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/mergeRecord+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_677/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:34.876Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/Combine+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/Combine/Extract+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToRow+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/mergeRecord+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_674/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/extractKeylhs+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable0+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:24:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:36.126Z: Finished operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/Combine+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/Combine/Extract+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/Group.CombineFieldsByFields/ToRow+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_676/mergeRecord+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_677/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.529Z: Finished operation SqlQuery0.ReadBounded+SqlQuery0/SqlQuery0.Monitor+SqlQuery0/SqlQuery0.Snoop+SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.Serialize+SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_165/ParMultiDo(Calc)+SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0.Debug+SqlQuery0/SqlQuery0.Stamp+SqlQuery0.Format+SqlQuery0.DevNull Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.880Z: Cleaning up. Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:40.123Z: Stopping **** pool... Feb 18, 2022 12:24:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.067Z: Finished operation SqlQuery1.ReadBounded+SqlQuery1/SqlQuery1.Monitor+SqlQuery1/SqlQuery1.Snoop+SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_166/ParMultiDo(Calc)+SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1.Debug+SqlQuery1/SqlQuery1.Stamp+SqlQuery1.Format+SqlQuery1.DevNull Feb 18, 2022 12:24:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.260Z: Cleaning up. Feb 18, 2022 12:24:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.364Z: Stopping **** pool... Feb 18, 2022 12:24:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:47.113Z: Finished operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1157/Select.Fields/ParDo(Select)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_1159/ParMultiDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/ResultToBid/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Debug+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Stamp+SqlBoundedSideInputJoin.Format+SqlBoundedSideInputJoin.DevNull Feb 18, 2022 12:24:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:47.278Z: Cleaning up. Feb 18, 2022 12:24:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:47.332Z: Stopping **** pool... Feb 18, 2022 12:25:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:02.175Z: Finished operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/Combine+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/Combine/Extract+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/Group.CombineFieldsByFields/ToRow+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_673/mergeRecord+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_674/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/extractKeylhs+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable0+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write Feb 18, 2022 12:25:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:02.259Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close Feb 18, 2022 12:25:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:02.312Z: Finished operation SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close Feb 18, 2022 12:25:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:02.398Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Select.Fields/ParDo(Select)+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_680/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery7/SqlQuery7.Debug+SqlQuery7/SqlQuery7.Stamp+SqlQuery7.Format+SqlQuery7.DevNull Feb 18, 2022 12:25:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:15.023Z: Finished operation SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlQuery7/SqlQuery7/SqlTransform/BeamCoGBKJoinRel_678/Select.Fields/ParDo(Select)+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_680/ParMultiDo(Calc)+SqlQuery7/SqlQuery7/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery7/SqlQuery7.Debug+SqlQuery7/SqlQuery7.Stamp+SqlQuery7.Format+SqlQuery7.DevNull Feb 18, 2022 12:25:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:15.204Z: Cleaning up. Feb 18, 2022 12:25:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:15.299Z: Stopping **** pool... Feb 18, 2022 12:26:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2022-02-18T00:26:09.103Z Waiting for main pipeline to 'finish' 2022-02-18T00:26:09.128Z RUNNING SqlQuery0 Feb 18, 2022 12:26:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2022-02-18T00:26:09.158Z Waiting for main pipeline to 'finish' 2022-02-18T00:26:09.178Z RUNNING SqlQuery1 Feb 18, 2022 12:26:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2022-02-18T00:26:09.357Z Waiting for main pipeline to 'finish' 2022-02-18T00:26:09.382Z RUNNING SqlQuery2 Feb 18, 2022 12:26:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2022-02-18T00:26:09.543Z Waiting for main pipeline to 'finish' 2022-02-18T00:26:09.568Z RUNNING SqlBoundedSideInputJoin Feb 18, 2022 12:26:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2022-02-18T00:26:09.607Z Waiting for main pipeline to 'finish' 2022-02-18T00:26:09.633Z RUNNING SqlQuery3 Feb 18, 2022 12:26:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned within allotted timeout. State value RUNNING 2022-02-18T00:26:09.683Z Waiting for main pipeline to 'finish' 2022-02-18T00:26:09.702Z RUNNING SqlQuery7 2022-02-18T00:26:09.850Z new perf {"snapshots":null,"runtimeSec":32.614,"numEvents":10000000,"eventsPerSec":306616.7903354388,"eventBytesPerSec":3.9356254890537806E7,"numResults":9200000,"resultsPerSec":282087.44710860366,"resultBytesPerSec":2.8349621205617223E7,"startupDelaySec":-123.469,"processingDelaySec":0.47,"shutdownDelaySec":90.855,"timeDilation":30.660145949592202,"errors":null,"jobId":null} 2022-02-18T00:26:10.003Z new perf {"snapshots":null,"runtimeSec":17.739,"numEvents":10000000,"eventsPerSec":563729.6352669259,"eventBytesPerSec":7.235835712272394E7,"numResults":83527,"resultsPerSec":4708.664524494053,"resultBytesPerSec":75338.63239190484,"startupDelaySec":-137.099,"processingDelaySec":0.729,"shutdownDelaySec":119.36,"timeDilation":56.369581148881,"errors":null,"jobId":null} 2022-02-18T00:26:10.213Z new perf {"snapshots":null,"runtimeSec":50.242,"numEvents":10000000,"eventsPerSec":199036.66255324232,"eventBytesPerSec":2.5547647326937623E7,"numResults":9200000,"resultsPerSec":183113.72954898293,"resultBytesPerSec":6527045.002189403,"startupDelaySec":-133.176,"processingDelaySec":20.715,"shutdownDelaySec":82.934,"timeDilation":-1.0,"errors":null,"jobId":null} 2022-02-18T00:26:10.258Z new perf {"snapshots":null,"runtimeSec":21.297,"numEvents":10000000,"eventsPerSec":469549.7018359393,"eventBytesPerSec":6.026975146734282E7,"numResults":9054,"resultsPerSec":425.1303000422595,"resultBytesPerSec":13577.733953138939,"startupDelaySec":-138.439,"processingDelaySec":20.029,"shutdownDelaySec":117.142,"timeDilation":46.60280790721698,"errors":null,"jobId":null} 2022-02-18T00:26:10.411Z new perf {"snapshots":null,"runtimeSec":35.698,"numEvents":10000000,"eventsPerSec":280127.73824864137,"eventBytesPerSec":3.5956213149196036E7,"numResults":9200000,"resultsPerSec":257717.51918875007,"resultBytesPerSec":2.5900457896800943E7,"startupDelaySec":-126.316,"processingDelaySec":0.47,"shutdownDelaySec":90.618,"timeDilation":28.011373186172897,"errors":null,"jobId":null} 2022-02-18T00:26:10.480Z new perf {"snapshots":null,"runtimeSec":76.398,"numEvents":10000000,"eventsPerSec":130893.47888688186,"eventBytesPerSec":1.680102747454122E7,"numResults":100,"resultsPerSec":1.3089347888688185,"resultBytesPerSec":132.24168171941673,"startupDelaySec":-131.428,"processingDelaySec":65.15,"shutdownDelaySec":55.03,"timeDilation":12.958454409801304,"errors":null,"jobId":null} 2022-02-18T00:26:24.902Z RUNNING SqlQuery1 2022-02-18T00:26:25.031Z RUNNING SqlQuery2 2022-02-18T00:26:25.258Z RUNNING SqlBoundedSideInputJoin 2022-02-18T00:26:25.290Z RUNNING SqlQuery3 2022-02-18T00:26:25.447Z RUNNING SqlQuery0 2022-02-18T00:26:25.514Z RUNNING SqlQuery7 2022-02-18T00:26:25.521Z no activity 2022-02-18T00:26:25.590Z no activity 2022-02-18T00:26:25.922Z no activity 2022-02-18T00:26:25.975Z no activity 2022-02-18T00:26:26.048Z no activity 2022-02-18T00:26:26.208Z no activity FATAL: command execution failed java.io.IOException: Backing channel 'apache-beam-jenkins-14' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286) at com.sun.proxy.$Proxy126.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205) at hudson.Launcher$ProcStarter.join(Launcher.java:522) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:806) at hudson.model.Build$BuildExecution.build(Build.java:198) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:514) at hudson.model.Run.execute(Run.java:1888) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:99) at hudson.model.Executor.run(Executor.java:432) Caused by: java.io.IOException: Pipe closed after 0 cycles at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126) at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105) at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:93) at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:74) at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:104) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-14 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
