See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/2538/display/redirect>
Changes: ------------------------------------------ [...truncated 162.22 KB...] INFO: 2023-02-21T16:31:43.291Z: Unzipping flatten Query8-Query8-CoGroupByKey-Flatten-u19 for input Query8-Query8-CoGroupByKey-GBK-reify-value6-c17 Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.322Z: Fusing unzipped copy of Query8/Query8/CoGroupByKey/GBK/Write, through flatten Query8/Query8/CoGroupByKey/Flatten/Unzipped-1, into producer Query8/Query8/CoGroupByKey/GBK/Reify Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.350Z: Fusing consumer Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query8/Query8.Snoop/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.380Z: Fusing consumer Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query8/Query8.Snoop/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.418Z: Fusing consumer Query8/Query8/CoGroupByKey/GBK/Reify into Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.452Z: Fusing consumer Query8/Query8/CoGroupByKey/GBK/Write into Query8/Query8/CoGroupByKey/GBK/Reify Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.477Z: Fusing consumer Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query8.ReadBounded/Impulse Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.512Z: Fusing consumer Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.548Z: Fusing consumer Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.578Z: Fusing consumer Query8/Query8.Monitor/ParMultiDo(Monitor) into Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.610Z: Fusing consumer Query8/Query8.Snoop/ParMultiDo(Anonymous) into Query8/Query8.Monitor/ParMultiDo(Monitor) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.643Z: Fusing consumer Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous) into Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.677Z: Fusing consumer Query8/Query8/Query8.WindowPersons/Window.Assign into Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.703Z: Fusing consumer Query8/Query8/PersonById/ParMultiDo(Anonymous) into Query8/Query8/Query8.WindowPersons/Window.Assign Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.737Z: Fusing consumer Query8/Query8/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Query8/Query8/PersonById/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.768Z: Fusing consumer Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous) into Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.793Z: Fusing consumer Query8/Query8/Query8.WindowAuctions/Window.Assign into Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.831Z: Fusing consumer Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous) into Query8/Query8/Query8.WindowAuctions/Window.Assign Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.866Z: Fusing consumer Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.288Z: Executing operation Query8.ReadBounded/Impulse+Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.378Z: Starting 4 ****s in us-central1-b... Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:42.947Z: Executing operation Query12.ReadBounded/Impulse+Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.028Z: Starting 4 ****s in us-central1-b... Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.646Z: Expanding SplittableParDo operations into optimizable parts. Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.678Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.736Z: Expanding CoGroupByKey operations into optimizable parts. Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.825Z: Expanding GroupByKey operations into optimizable parts. Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.896Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.927Z: Fusing consumer Query10.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query10.ReadBounded/Impulse Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.961Z: Fusing consumer Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query10.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.989Z: Fusing consumer Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.017Z: Fusing consumer Query10/Query10.Monitor/ParMultiDo(Monitor) into Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.046Z: Fusing consumer Query10/Query10.Snoop/ParMultiDo(Anonymous) into Query10/Query10.Monitor/ParMultiDo(Monitor) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.078Z: Fusing consumer Query10/Query10/Query10.ShardEvents/ParMultiDo(Anonymous) into Query10/Query10.Snoop/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.118Z: Fusing consumer Query10/Query10/Query10.WindowEvents/Window.Assign into Query10/Query10/Query10.ShardEvents/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.158Z: Fusing consumer Query10/Query10/Query10.GroupByKey/Reify into Query10/Query10/Query10.WindowEvents/Window.Assign Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.189Z: Fusing consumer Query10/Query10/Query10.GroupByKey/Write into Query10/Query10/Query10.GroupByKey/Reify Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.222Z: Fusing consumer Query10/Query10/Query10.GroupByKey/GroupByWindow into Query10/Query10/Query10.GroupByKey/Read Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.268Z: Fusing consumer Query10/Query10/Query10.CheckForLateEvents/ParMultiDo(Anonymous) into Query10/Query10/Query10.GroupByKey/GroupByWindow Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.311Z: Fusing consumer Query10/Query10/Query10.UploadEvents/ParMultiDo(Anonymous) into Query10/Query10/Query10.CheckForLateEvents/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.343Z: Fusing consumer Query10/Query10/Query10.WindowLogFiles/Window.Assign into Query10/Query10/Query10.UploadEvents/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.377Z: Fusing consumer Query10/Query10/Query10.GroupByKey2/Reify into Query10/Query10/Query10.WindowLogFiles/Window.Assign Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.411Z: Fusing consumer Query10/Query10/Query10.GroupByKey2/Write into Query10/Query10/Query10.GroupByKey2/Reify Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.461Z: Fusing consumer Query10/Query10/Query10.GroupByKey2/GroupByWindow into Query10/Query10/Query10.GroupByKey2/Read Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.500Z: Fusing consumer Query10/Query10/Query10.Index/ParMultiDo(Anonymous) into Query10/Query10/Query10.GroupByKey2/GroupByWindow Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.546Z: Fusing consumer Query10/Query10.Debug/ParMultiDo(Monitor) into Query10/Query10/Query10.Index/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.587Z: Fusing consumer Query10/Query10.Stamp/ParMultiDo(Anonymous) into Query10/Query10.Debug/ParMultiDo(Monitor) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.617Z: Fusing consumer Query10.Format/ParMultiDo(Anonymous) into Query10/Query10.Stamp/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.662Z: Fusing consumer Query10.DevNull/ParMultiDo(Anonymous) into Query10.Format/ParMultiDo(Anonymous) Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:42.328Z: Executing operation Query14.ReadBounded/Impulse+Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 21, 2023 4:31:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:42.406Z: Starting 4 ****s in us-central1-b... Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.833Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:43.925Z: Expanding GroupByKey operations into optimizable parts. Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.010Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.043Z: Unzipping flatten Query5-Query5-Combine-globally-Top--Combine-perKeyWithFanout-Top--Flatten-PCollections for input Query5-Query5-Combine-globally-Top--Combine-perKeyWithFanout-Top--PrepareCold-Map-ParMultiDo-Anonymo.output Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.076Z: Fusing unzipped copy of Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial, through flatten Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Flatten.PCollections, into producer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PrepareCold/Map/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.129Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Write into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Reify Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.161Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/GroupByWindow into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Read Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.196Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/GroupByWindow Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.230Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.274Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Values/Values/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Extract Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.302Z: Fusing consumer Query5/Query5/Query5.Select/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Values/Values/Map/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.331Z: Fusing consumer Query5/Query5.Debug/ParMultiDo(Monitor) into Query5/Query5/Query5.Select/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.366Z: Fusing consumer Query5/Query5.Stamp/ParMultiDo(Anonymous) into Query5/Query5.Debug/ParMultiDo(Monitor) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.404Z: Fusing consumer Query5.Format/ParMultiDo(Anonymous) into Query5/Query5.Stamp/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.435Z: Fusing consumer Query5.DevNull/ParMultiDo(Anonymous) into Query5.Format/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.483Z: Unzipping flatten Query5-Query5-Combine-globally-Top--Combine-perKeyWithFanout-Top--Flatten-PCollections-u64 for input partial-Query5-Query5-Combine-globally-Top--Combine-perKeyWithFanout-Top--PostCombine-GroupByKey-out7-c62 Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.535Z: Fusing unzipped copy of Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Reify, through flatten Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Flatten.PCollections/Unzipped-1, into producer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.572Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.611Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Reify into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.647Z: Fusing consumer Query5.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query5.ReadBounded/Impulse Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.684Z: Fusing consumer Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query5.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.716Z: Fusing consumer Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.749Z: Fusing consumer Query5/Query5.Monitor/ParMultiDo(Monitor) into Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.785Z: Fusing consumer Query5/Query5.Snoop/ParMultiDo(Anonymous) into Query5/Query5.Monitor/ParMultiDo(Monitor) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.819Z: Fusing consumer Query5/Query5/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query5/Query5.Snoop/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.848Z: Fusing consumer Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous) into Query5/Query5/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.871Z: Fusing consumer Query5/Query5/Window.Into()/Window.Assign into Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.897Z: Fusing consumer Query5/Query5/BidToAuction/ParMultiDo(Anonymous) into Query5/Query5/Window.Into()/Window.Assign Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.933Z: Fusing consumer Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query5/Query5/BidToAuction/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:44.967Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial into Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.000Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.034Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.053Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.085Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.117Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.146Z: Fusing consumer Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) into Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.180Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce into Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.211Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PrepareCold/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.246Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.268Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.302Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Write into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.324Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Read Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.352Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.389Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.412Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract Feb 21, 2023 4:31:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.439Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) Feb 21, 2023 4:31:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.040Z: Executing operation Query10.ReadBounded/Impulse+Query10.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 21, 2023 4:31:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.103Z: Starting 4 ****s in us-central1-b... Feb 21, 2023 4:31:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.799Z: Executing operation Query5.ReadBounded/Impulse+Query5.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 21, 2023 4:31:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:45.862Z: Starting 4 ****s in us-central1-b... Feb 21, 2023 4:31:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:52.695Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:31:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:54.555Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:32:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:59.287Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:32:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:58.840Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:32:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:31:59.222Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:32:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:32:01.169Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:32:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:32:03.589Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:32:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:32:12.354Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2023 4:32:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-21T16:32:12.886Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete FATAL: command execution failed hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@76b09a4d:apache-beam-jenkins-3": Remote call on apache-beam-jenkins-3 failed. The channel is closing down or has closed down at hudson.remoting.Channel.call(Channel.java:993) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285) at com.sun.proxy.$Proxy143.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207) at hudson.Launcher$ProcStarter.join(Launcher.java:524) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814) at hudson.model.Build$BuildExecution.build(Build.java:199) at hudson.model.Build$BuildExecution.doRun(Build.java:164) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522) at hudson.model.Run.execute(Run.java:1896) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) Caused by: java.io.IOException: Pipe closed after 0 cycles at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126) at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105) at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94) at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75) at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-3 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
