See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/1980/display/redirect?page=changes>
Changes: [bulat.safiullin] [Website] fix navbar footer overlap #22698 [noreply] AI/ML pipelines master page documentation (#23443) [noreply] Fix go fmt error (#23474) [noreply] Revert "Add drop_example flag to the RunInference and Model Handler ------------------------------------------ [...truncated 169.00 KB...] INFO: 2022-10-04T14:34:40.221Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.255Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.285Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.323Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.722Z: Executing operation Query5.ReadBounded/Impulse+Query5.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.804Z: Starting 4 ****s in us-central1-a... Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.894Z: Executing operation Query8.ReadBounded/Impulse+Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.971Z: Starting 4 ****s in us-central1-a... Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.705Z: Expanding SplittableParDo operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.740Z: Expanding CollectionToSingleton operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.799Z: Expanding CoGroupByKey operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.859Z: Expanding GroupByKey operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.914Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.942Z: Fusing consumer Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query14.ReadBounded/Impulse Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.972Z: Fusing consumer Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.003Z: Fusing consumer Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.040Z: Fusing consumer Query14/Query14.Monitor/ParMultiDo(Monitor) into Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.065Z: Fusing consumer Query14/Query14.Snoop/ParMultiDo(Anonymous) into Query14/Query14.Monitor/ParMultiDo(Monitor) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.090Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Pair with random key/ParMultiDo(AssignShard) into Query14/Query14.Snoop/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.116Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Query14/Query14/Reshuffle.ViaRandomKey/Pair with random key/ParMultiDo(AssignShard) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.150Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.177Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.206Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.242Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.277Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.301Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.324Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.351Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.383Z: Fusing consumer Query14/Query14.Debug/ParMultiDo(Monitor) into Query14/Query14/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.412Z: Fusing consumer Query14/Query14.Stamp/ParMultiDo(Anonymous) into Query14/Query14.Debug/ParMultiDo(Monitor) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.446Z: Fusing consumer Query14.Format/ParMultiDo(Anonymous) into Query14/Query14.Stamp/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.478Z: Fusing consumer Query14.DevNull/ParMultiDo(Anonymous) into Query14.Format/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.795Z: Executing operation Query14.ReadBounded/Impulse+Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.867Z: Starting 4 ****s in us-central1-a... Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.551Z: Executing operation Query1.ReadBounded/Impulse+Query1.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.635Z: Starting 4 ****s in us-central1-a... Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.913Z: Expanding SplittableParDo operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:39.944Z: Expanding CollectionToSingleton operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.000Z: Expanding CoGroupByKey operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.047Z: Expanding GroupByKey operations into optimizable parts. Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.105Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.131Z: Fusing consumer Query0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query0.ReadBounded/Impulse Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.167Z: Fusing consumer Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.200Z: Fusing consumer Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.222Z: Fusing consumer Query0/Query0.Monitor/ParMultiDo(Monitor) into Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.247Z: Fusing consumer Query0/Query0.Snoop/ParMultiDo(Anonymous) into Query0/Query0.Monitor/ParMultiDo(Monitor) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.279Z: Fusing consumer Query0/Query0/Query0.Serialize/ParMultiDo(Anonymous) into Query0/Query0.Snoop/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.309Z: Fusing consumer Query0/Query0.Debug/ParMultiDo(Monitor) into Query0/Query0/Query0.Serialize/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.344Z: Fusing consumer Query0/Query0.Stamp/ParMultiDo(Anonymous) into Query0/Query0.Debug/ParMultiDo(Monitor) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.367Z: Fusing consumer Query0.Format/ParMultiDo(Anonymous) into Query0/Query0.Stamp/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.402Z: Fusing consumer Query0.DevNull/ParMultiDo(Anonymous) into Query0.Format/ParMultiDo(Anonymous) Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.764Z: Executing operation Query0.ReadBounded/Impulse+Query0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 04, 2022 2:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:40.841Z: Starting 4 ****s in us-central1-a... Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:42.439Z: Worker configuration: e2-standard-2 in us-central1-a. Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:43.724Z: Expanding SplittableParDo operations into optimizable parts. Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:43.755Z: Expanding CollectionToSingleton operations into optimizable parts. Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:43.822Z: Expanding CoGroupByKey operations into optimizable parts. Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:43.887Z: Expanding GroupByKey operations into optimizable parts. Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:43.954Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:43.983Z: Fusing consumer Query13.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query13.ReadBounded/Impulse Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.023Z: Fusing consumer Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query13.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.054Z: Fusing consumer Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.091Z: Fusing consumer Query13/Query13.Monitor/ParMultiDo(Monitor) into Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.124Z: Fusing consumer Query13/Query13.Snoop/ParMultiDo(Anonymous) into Query13/Query13.Monitor/ParMultiDo(Monitor) Oct 04, 2022 2:34:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.157Z: Fusing consumer Query13/Query13/Pair with random key/ParMultiDo(AssignShard) into Query13/Query13.Snoop/ParMultiDo(Anonymous) Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.192Z: Fusing consumer Query13/Query13/GroupByKey/Write into Query13/Query13/Pair with random key/ParMultiDo(AssignShard) Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.222Z: Fusing consumer Query13/Query13/ExpandIterable/ParMultiDo(Anonymous) into Query13/Query13/GroupByKey/Read Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.254Z: Fusing consumer Query13/Query13/Query13.Serialize/ParMultiDo(Anonymous) into Query13/Query13/ExpandIterable/ParMultiDo(Anonymous) Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.279Z: Fusing consumer Query13/Query13.Debug/ParMultiDo(Monitor) into Query13/Query13/Query13.Serialize/ParMultiDo(Anonymous) Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.312Z: Fusing consumer Query13/Query13.Stamp/ParMultiDo(Anonymous) into Query13/Query13.Debug/ParMultiDo(Monitor) Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.342Z: Fusing consumer Query13.Format/ParMultiDo(Anonymous) into Query13/Query13.Stamp/ParMultiDo(Anonymous) Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.383Z: Fusing consumer Query13.DevNull/ParMultiDo(Anonymous) into Query13.Format/ParMultiDo(Anonymous) Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.759Z: Executing operation Query13.ReadBounded/Impulse+Query13.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 04, 2022 2:34:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:44.843Z: Starting 4 ****s in us-central1-a... Oct 04, 2022 2:34:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:46.892Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:34:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:52.822Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:34:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:51.836Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:34:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:56.047Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:34:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:58.570Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:35:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:34:59.745Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:35:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:03.610Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:35:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:05.753Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:35:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:07.906Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 04, 2022 2:35:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:20.250Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:21.812Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:21.564Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:23.696Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:25.208Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:24.255Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:26.054Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:27.745Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:28.247Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-04T14:35:28.548Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 04, 2022 2:35:54 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-04_07_34_26-4320724365584899563 Oct 04, 2022 2:35:54 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-04_07_34_26-8889006291871325544 Oct 04, 2022 2:35:54 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-04_07_34_26-17302032745220933024 Oct 04, 2022 2:35:54 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-04_07_34_26-5714303096992185889 > Task :sdks:java:testing:nexmark:run FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=435f55b6-f172-46eb-8c50-78e58d786e72, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 962965 log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-962965.out.log ----- Last 20 lines from daemon log file - daemon-962965.out.log ----- To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-04_07_34_26-5714303096992185889 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221004143229 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d339238f6df5533ef3c6893fb9989e42ed46f746c1f86150734d748fb32fca67 Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221004143229 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d339238f6df5533ef3c6893fb9989e42ed46f746c1f86150734d748fb32fca67 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
