See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/2100/display/redirect?page=changes>
Changes: [noreply] Disable flaky fn_api_runner tests (#23971) [noreply] Make BatchConverter inference errors more helpful (#23965) ------------------------------------------ [...truncated 170.63 KB...] INFO: 2022-11-04T04:26:13.405Z: Expanding GroupByKey operations into optimizable parts. Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.479Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.517Z: Fusing consumer Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query12.ReadBounded/Impulse Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.547Z: Fusing consumer Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.587Z: Fusing consumer Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.610Z: Fusing consumer Query12/Query12.Monitor/ParMultiDo(Monitor) into Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.636Z: Fusing consumer Query12/Query12.Snoop/ParMultiDo(Anonymous) into Query12/Query12.Monitor/ParMultiDo(Monitor) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.667Z: Fusing consumer Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query12/Query12.Snoop/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.702Z: Fusing consumer Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous) into Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.726Z: Fusing consumer Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.758Z: Fusing consumer Query12/Query12/Window.Into()/Window.Assign into Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.784Z: Fusing consumer Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query12/Query12/Window.Into()/Window.Assign Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.820Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial into Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.856Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write into Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.890Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.920Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.949Z: Fusing consumer Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous) into Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.981Z: Fusing consumer Query12/Query12.Debug/ParMultiDo(Monitor) into Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.007Z: Fusing consumer Query12/Query12.Stamp/ParMultiDo(Anonymous) into Query12/Query12.Debug/ParMultiDo(Monitor) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.036Z: Fusing consumer Query12.Format/ParMultiDo(Anonymous) into Query12/Query12.Stamp/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.071Z: Fusing consumer Query12.DevNull/ParMultiDo(Anonymous) into Query12.Format/ParMultiDo(Anonymous) Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.417Z: Executing operation Query12.ReadBounded/Impulse+Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.486Z: Starting 4 ****s in us-central1-b... Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.989Z: Executing operation Query14.ReadBounded/Impulse+Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.073Z: Starting 4 ****s in us-central1-b... Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.487Z: Executing operation Query8.ReadBounded/Impulse+Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 04, 2022 4:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.570Z: Starting 4 ****s in us-central1-b... Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.208Z: Fusing consumer Query11/Query11/justBids/AsBid/ParMultiDo(Anonymous) into Query11/Query11/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.238Z: Fusing consumer Query11/Query11/Query11.Rekey/ParMultiDo(Anonymous) into Query11/Query11/justBids/AsBid/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.262Z: Fusing consumer Query11/Query11/Window.Into()/Window.Assign into Query11/Query11/Query11.Rekey/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.288Z: Fusing consumer Query11/Query11/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query11/Query11/Window.Into()/Window.Assign Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.313Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/AddInput into Query11/Query11/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.350Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify into Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/AddInput Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.375Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write into Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.408Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow into Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.434Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.461Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.494Z: Fusing consumer Query11/Query11/Query11.ToResult/ParMultiDo(Anonymous) into Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.529Z: Fusing consumer Query11/Query11.Debug/ParMultiDo(Monitor) into Query11/Query11/Query11.ToResult/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.557Z: Fusing consumer Query11/Query11.Stamp/ParMultiDo(Anonymous) into Query11/Query11.Debug/ParMultiDo(Monitor) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.584Z: Fusing consumer Query11.Format/ParMultiDo(Anonymous) into Query11/Query11.Stamp/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.613Z: Fusing consumer Query11.DevNull/ParMultiDo(Anonymous) into Query11.Format/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:13.953Z: Executing operation Query11.ReadBounded/Impulse+Query11.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query11-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query11-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.025Z: Starting 4 ****s in us-central1-b... Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.475Z: Fusing consumer Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous) into Query5/Query5/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.508Z: Fusing consumer Query5/Query5/Window.Into()/Window.Assign into Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.542Z: Fusing consumer Query5/Query5/BidToAuction/ParMultiDo(Anonymous) into Query5/Query5/Window.Into()/Window.Assign Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.577Z: Fusing consumer Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query5/Query5/BidToAuction/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.618Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial into Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.655Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.687Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.715Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.741Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.779Z: Fusing consumer Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.813Z: Fusing consumer Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) into Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.848Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce into Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.876Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PrepareCold/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.904Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.932Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.960Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Write into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:14.993Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Read Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:15.027Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:15.058Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:15.087Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:15.128Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:15.521Z: Executing operation Query5.ReadBounded/Impulse+Query5.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 04, 2022 4:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:15.598Z: Starting 4 ****s in us-central1-b... Nov 04, 2022 4:26:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:18.034Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:19.086Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:21.385Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:22.359Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:24.592Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:23.706Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:27.961Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:29.283Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:37.357Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:38.789Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 04, 2022 4:26:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:55.313Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:26:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:56.264Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:26:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:55.637Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:26:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:57.597Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:26:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:57.848Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:26:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:58.073Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:26:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:57.230Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:26:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:57.530Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:27:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:57.462Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:27:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:26:59.054Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 04, 2022 4:27:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:27:53.676Z: Workers have started successfully. Nov 04, 2022 4:27:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:27:54.052Z: Workers have started successfully. Nov 04, 2022 4:27:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:27:56.972Z: Workers have started successfully. Nov 04, 2022 4:28:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-04T04:28:01.461Z: Workers have started successfully. Nov 04, 2022 4:28:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-03_21_26_00-5961325046477860493 Nov 04, 2022 4:28:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-03_21_26_00-10092455695615972703 Nov 04, 2022 4:28:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-03_21_26_00-17349609907160502155 Nov 04, 2022 4:28:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-03_21_26_00-18201492747548911186 Nov 04, 2022 4:28:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-03_21_26_00-4956505085103330635 > Task :sdks:java:testing:nexmark:run FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=e94d3e42-ed0c-46d1-b553-0ea78454933f, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 2526080 log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-2526080.out.log ----- Last 20 lines from daemon log file - daemon-2526080.out.log ----- To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-03_21_26_00-4956505085103330635 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221104042435 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8304cd80ff9fae7d9ea28cdcbc9c1edfd6f269181d963d379f1ab5738371e19 Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221104042435 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f8304cd80ff9fae7d9ea28cdcbc9c1edfd6f269181d963d379f1ab5738371e19 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
