See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/1287/display/redirect?page=changes>
Changes: [noreply] [BEAM-13925] Dont double assign committers if author or other reviewer [noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362) ------------------------------------------ [...truncated 477.75 KB...] INFO: 2022-04-14T16:32:20.788Z: Fusing consumer Query5-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Query5-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:20.873Z: Fusing consumer Query5.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) into Query5-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:20.938Z: Fusing consumer Query5/Query5.Monitor/ParMultiDo(Monitor) into Query5.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:20.989Z: Fusing consumer Query5/Query5.Snoop/ParMultiDo(Anonymous) into Query5/Query5.Monitor/ParMultiDo(Monitor) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.011Z: Fusing consumer Query5/Query5/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query5/Query5.Snoop/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.069Z: Fusing consumer Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous) into Query5/Query5/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.114Z: Fusing consumer Query5/Query5/Window.Into()/Window.Assign into Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.204Z: Fusing consumer Query5/Query5/BidToAuction/ParMultiDo(Anonymous) into Query5/Query5/Window.Into()/Window.Assign Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.281Z: Fusing consumer Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query5/Query5/BidToAuction/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.312Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ConvertToAccumulators into Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.349Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/WriteStream into Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ConvertToAccumulators Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.372Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/ReadStream Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.413Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.450Z: Fusing consumer Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) into Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.483Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce into Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.507Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PrepareCold/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.534Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/ConvertToAccumulators into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.560Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/WriteStream into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/ConvertToAccumulators Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.593Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/ReadStream Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.615Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.637Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.675Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.711Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/ReadStream Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.732Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.766Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Values/Values/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Extract Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.787Z: Fusing consumer Query5/Query5/Query5.Select/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Values/Values/Map/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.819Z: Fusing consumer Query5/Query5.Debug/ParMultiDo(Monitor) into Query5/Query5/Query5.Select/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.864Z: Fusing consumer Query5/Query5.Stamp/ParMultiDo(Anonymous) into Query5/Query5.Debug/ParMultiDo(Monitor) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.899Z: Fusing consumer Query5.Format/ParMultiDo(Anonymous) into Query5/Query5.Stamp/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.954Z: Fusing consumer Query5.DevNull/ParMultiDo(Anonymous) into Query5.Format/ParMultiDo(Anonymous) Apr 14, 2022 4:32:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.256Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.443Z: Worker configuration: e2-standard-2 in us-central1-b. Apr 14, 2022 4:32:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:22.266Z: Expanding SplittableParDo operations into optimizable parts. Apr 14, 2022 4:32:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:22.387Z: Expanding CollectionToSingleton operations into optimizable parts. Apr 14, 2022 4:32:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:22.541Z: Expanding CoGroupByKey operations into optimizable parts. Apr 14, 2022 4:32:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:22.653Z: Expanding SplittableProcessKeyed operations into optimizable parts. Apr 14, 2022 4:32:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:22.790Z: Expanding GroupByKey operations into streaming Read/Write steps Apr 14, 2022 4:32:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.176Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Apr 14, 2022 4:32:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:22.063Z: Running job using Streaming Engine Apr 14, 2022 4:32:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:22.352Z: Starting 4 ****s in us-central1-b... Apr 14, 2022 4:32:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:21.819Z: Starting 4 ****s in us-central1-b... Apr 14, 2022 4:32:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.145Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.582Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.636Z: Fusing consumer Query12.ReadUnbounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query12.ReadUnbounded/Impulse Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.673Z: Fusing consumer Query12-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Query12.ReadUnbounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.730Z: Fusing consumer Query12-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Query12-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.783Z: Fusing consumer Query12.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) into Query12-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.821Z: Fusing consumer Query12/Query12.Monitor/ParMultiDo(Monitor) into Query12.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.880Z: Fusing consumer Query12/Query12.Snoop/ParMultiDo(Anonymous) into Query12/Query12.Monitor/ParMultiDo(Monitor) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.912Z: Fusing consumer Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query12/Query12.Snoop/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.939Z: Fusing consumer Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous) into Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:23.976Z: Fusing consumer Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.011Z: Fusing consumer Query12/Query12/Window.Into()/Window.Assign into Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.036Z: Fusing consumer Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query12/Query12/Window.Into()/Window.Assign Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.067Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ConvertToAccumulators into Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.100Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/WriteStream into Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ConvertToAccumulators Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.129Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/ReadStream Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.161Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.191Z: Fusing consumer Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous) into Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.225Z: Fusing consumer Query12/Query12.Debug/ParMultiDo(Monitor) into Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.246Z: Fusing consumer Query12/Query12.Stamp/ParMultiDo(Anonymous) into Query12/Query12.Debug/ParMultiDo(Monitor) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.340Z: Fusing consumer Query12.Format/ParMultiDo(Anonymous) into Query12/Query12.Stamp/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.380Z: Fusing consumer Query12.DevNull/ParMultiDo(Anonymous) into Query12.Format/ParMultiDo(Anonymous) Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:24.868Z: Running job using Streaming Engine Apr 14, 2022 4:32:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:25.495Z: Starting 4 ****s in us-central1-b... Apr 14, 2022 4:32:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:26.765Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:29.464Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:32.309Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:33.283Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:35.187Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:41.341Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:42.961Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:44.039Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:45.267Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 14, 2022 4:32:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:54.076Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:32:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:54.103Z: Resized **** pool to 1, though goal was 4. This could be a quota issue. Apr 14, 2022 4:32:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:54.197Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:32:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:53.799Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:32:59.076Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:01.161Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:02.853Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:02.127Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:04.734Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:04.422Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:05.026Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:07.519Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-04-14T16:33:06.251Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 14, 2022 4:33:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_59-2662565092002426603 Apr 14, 2022 4:33:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_58-6388577678369968021 Apr 14, 2022 4:33:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_59-13140680785302966778 Apr 14, 2022 4:33:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_58-5335523686028483664 Apr 14, 2022 4:33:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_58-6960115025792824104 Apr 14, 2022 4:33:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_59-15733384409665958787 Apr 14, 2022 4:33:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_58-12715248984538741149 > Task :sdks:java:testing:nexmark:run FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=ae3f8c01-f417-44a2-b088-59635be74971, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 2362995 log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-2362995.out.log ----- Last 20 lines from daemon log file - daemon-2362995.out.log ----- > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-04-14_09_31_58-12715248984538741149 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220414163109 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9bcb1c829932424548f09a50b9d916dbfd5a5fa5c74ae513b4ebc870f2da4a33 Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:365) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:61) at java.lang.Thread.run(Thread.java:748) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220414163109 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9bcb1c829932424548f09a50b9d916dbfd5a5fa5c74ae513b4ebc870f2da4a33 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
