See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/1045/display/redirect?page=changes>
Changes: [noreply] Minor: Add 2.38.0 section to CHANGES.md (#16804) ------------------------------------------ [...truncated 486.58 KB...] INFO: 2022-02-10T18:14:18.037Z: Fusing consumer Query11/Query11/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query11/Query11.Snoop/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.071Z: Fusing consumer Query11/Query11/justBids/AsBid/ParMultiDo(Anonymous) into Query11/Query11/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.033Z: Expanding SplittableParDo operations into optimizable parts. Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.061Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.132Z: Expanding CoGroupByKey operations into optimizable parts. Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.217Z: Expanding SplittableProcessKeyed operations into optimizable parts. Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.239Z: Expanding GroupByKey operations into streaming Read/Write steps Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.329Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.459Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.484Z: Fusing consumer Query10.ReadUnbounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query10.ReadUnbounded/Impulse Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.509Z: Fusing consumer Query10-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Query10.ReadUnbounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.539Z: Fusing consumer Query10-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Query10-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.561Z: Fusing consumer Query10.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) into Query10-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.584Z: Fusing consumer Query10/Query10.Monitor/ParMultiDo(Monitor) into Query10.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.634Z: Fusing consumer Query10/Query10.Snoop/ParMultiDo(Anonymous) into Query10/Query10.Monitor/ParMultiDo(Monitor) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.666Z: Fusing consumer Query10/Query10/Query10.ShardEvents/ParMultiDo(Anonymous) into Query10/Query10.Snoop/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.701Z: Fusing consumer Query10/Query10/Query10.WindowEvents/Window.Assign into Query10/Query10/Query10.ShardEvents/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.735Z: Fusing consumer Query10/Query10/Query10.GroupByKey/WriteStream into Query10/Query10/Query10.WindowEvents/Window.Assign Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.759Z: Fusing consumer Query10/Query10/Query10.GroupByKey/MergeBuckets into Query10/Query10/Query10.GroupByKey/ReadStream Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.795Z: Fusing consumer Query10/Query10/Query10.CheckForLateEvents/ParMultiDo(Anonymous) into Query10/Query10/Query10.GroupByKey/MergeBuckets Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.834Z: Fusing consumer Query10/Query10/Query10.UploadEvents/ParMultiDo(Anonymous) into Query10/Query10/Query10.CheckForLateEvents/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.869Z: Fusing consumer Query10/Query10/Query10.WindowLogFiles/Window.Assign into Query10/Query10/Query10.UploadEvents/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.903Z: Fusing consumer Query10/Query10/Query10.GroupByKey2/WriteStream into Query10/Query10/Query10.WindowLogFiles/Window.Assign Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.928Z: Fusing consumer Query10/Query10/Query10.GroupByKey2/MergeBuckets into Query10/Query10/Query10.GroupByKey2/ReadStream Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.957Z: Fusing consumer Query10/Query10/Query10.Index/ParMultiDo(Anonymous) into Query10/Query10/Query10.GroupByKey2/MergeBuckets Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:16.990Z: Fusing consumer Query10/Query10.Debug/ParMultiDo(Monitor) into Query10/Query10/Query10.Index/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:17.022Z: Fusing consumer Query10/Query10.Stamp/ParMultiDo(Anonymous) into Query10/Query10.Debug/ParMultiDo(Monitor) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:17.045Z: Fusing consumer Query10.Format/ParMultiDo(Anonymous) into Query10/Query10.Stamp/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:17.068Z: Fusing consumer Query10.DevNull/ParMultiDo(Anonymous) into Query10.Format/ParMultiDo(Anonymous) Feb 10, 2022 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:17.339Z: Starting 4 ****s in us-central1-c... Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.105Z: Fusing consumer Query11/Query11/Query11.Rekey/ParMultiDo(Anonymous) into Query11/Query11/justBids/AsBid/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.137Z: Fusing consumer Query11/Query11/Window.Into()/Window.Assign into Query11/Query11/Query11.Rekey/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.171Z: Fusing consumer Query11/Query11/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query11/Query11/Window.Into()/Window.Assign Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.207Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ConvertToAccumulators into Query11/Query11/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.228Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/WriteStream into Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/ConvertToAccumulators Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.271Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/ReadStream Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.301Z: Fusing consumer Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.334Z: Fusing consumer Query11/Query11/Query11.ToResult/ParMultiDo(Anonymous) into Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.369Z: Fusing consumer Query11/Query11.Debug/ParMultiDo(Monitor) into Query11/Query11/Query11.ToResult/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.402Z: Fusing consumer Query11/Query11.Stamp/ParMultiDo(Anonymous) into Query11/Query11.Debug/ParMultiDo(Monitor) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.450Z: Fusing consumer Query11.Format/ParMultiDo(Anonymous) into Query11/Query11.Stamp/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.477Z: Fusing consumer Query11.DevNull/ParMultiDo(Anonymous) into Query11.Format/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.526Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.765Z: Starting 4 ****s in us-central1-c... Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:17.943Z: Expanding SplittableParDo operations into optimizable parts. Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:17.965Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.025Z: Expanding CoGroupByKey operations into optimizable parts. Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.153Z: Expanding SplittableProcessKeyed operations into optimizable parts. Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.183Z: Expanding GroupByKey operations into streaming Read/Write steps Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.337Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.490Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.513Z: Unzipping flatten Query7-Query7-Combine-GloballyAsSingletonView-CombineValues-Combine-perKeyWithFanout-MaxLong--Flatte for input Query7-Query7-Combine-GloballyAsSingletonView-CombineValues-Combine-perKeyWithFanout-MaxLong--Prepar.output Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.535Z: Fusing unzipped copy of Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/ConvertToAccumulators, through flatten Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/Flatten.PCollections, into producer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PrepareCold/Map/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.570Z: Unzipping flatten Query7-Query7-Combine-GloballyAsSingletonView-CombineValues-Combine-perKeyWithFanout-MaxLong--Flatte-u53 for input Query7-Query7-Combine-GloballyAsSingletonView-CombineValues-Combine-perKeyWithFanout-MaxLong--PostCo3-add-input-out19-c51 Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.602Z: Fusing unzipped copy of Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/WriteStream, through flatten Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/Flatten.PCollections/Unzipped-1, into producer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/ConvertToAccumulators Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.631Z: Fusing consumer Query7/Query7/BidToPrice/ParMultiDo(Anonymous) into Query7/Query7/Window.Into()/Window.Assign Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.657Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/ConvertToAccumulators into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.683Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/WriteStream into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/ConvertToAccumulators Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.714Z: Fusing consumer Query7.ReadUnbounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query7.ReadUnbounded/Impulse Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.737Z: Fusing consumer Query7-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Query7.ReadUnbounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.771Z: Fusing consumer Query7-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Query7-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.804Z: Fusing consumer Query7.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) into Query7-ReadUnbounded-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.837Z: Fusing consumer Query7/Query7.Monitor/ParMultiDo(Monitor) into Query7.ReadUnbounded/ParDo(StripIds)/ParMultiDo(StripIds) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.871Z: Fusing consumer Query7/Query7.Snoop/ParMultiDo(Anonymous) into Query7/Query7.Monitor/ParMultiDo(Monitor) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.905Z: Fusing consumer Query7/Query7/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query7/Query7.Snoop/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.936Z: Fusing consumer Query7/Query7/justBids/AsBid/ParMultiDo(Anonymous) into Query7/Query7/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.964Z: Fusing consumer Query7/Query7/Window.Into()/Window.Assign into Query7/Query7/justBids/AsBid/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:18.994Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) into Query7/Query7/BidToPrice/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.013Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/AddNonce into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.035Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PrepareCold/Map/ParMultiDo(Anonymous) into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/AddNonce Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.063Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/ConvertToAccumulators into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/AddNonce Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.087Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/WriteStream into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/ConvertToAccumulators Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.113Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/ReadStream Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.136Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.159Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map/ParMultiDo(Anonymous) into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.189Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.217Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/ReadStream Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.248Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.294Z: Fusing consumer Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Values/Values/Map/ParMultiDo(Anonymous) into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.318Z: Fusing consumer Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/PairWithVoidKey into Query7/Query7/Combine.GloballyAsSingletonView/CombineValues/Values/Values/Map/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.351Z: Fusing consumer Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/GroupByKey/WriteStream into Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/PairWithVoidKey Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.388Z: Fusing consumer Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/GroupByKey/MergeBuckets into Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/GroupByKey/ReadStream Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.422Z: Fusing consumer Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/Values into Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/GroupByKey/MergeBuckets Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.453Z: Fusing consumer Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/StreamingPCollectionViewWriter into Query7/Query7/Query7.Select/ParMultiDo(Anonymous)/View-org.apache.beam.sdk.values.PCollectionViews$SimplePCollectionView.<init>:1202#eaad07ea78187579/Values Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.487Z: Fusing consumer Query7/Query7.Debug/ParMultiDo(Monitor) into Query7/Query7/Query7.Select/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.521Z: Fusing consumer Query7/Query7.Stamp/ParMultiDo(Anonymous) into Query7/Query7.Debug/ParMultiDo(Monitor) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.547Z: Fusing consumer Query7.Format/ParMultiDo(Anonymous) into Query7/Query7.Stamp/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.575Z: Fusing consumer Query7.DevNull/ParMultiDo(Anonymous) into Query7.Format/ParMultiDo(Anonymous) Feb 10, 2022 6:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.946Z: Starting 4 ****s in us-central1-c... Feb 10, 2022 6:14:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:19.907Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:23.024Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:22.441Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:23.813Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:26.606Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:33.930Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:33.003Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:36.563Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:39.801Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:41.649Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 10, 2022 6:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:50.460Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:51.037Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:14:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:53.294Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:14:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:56.153Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:14:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:57.103Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:14:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:56.724Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:14:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:55.676Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:14:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:57.041Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:15:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:58.972Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:15:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:14:59.654Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 10, 2022 6:15:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-10T18:15:03.052Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate. FATAL: command execution failed java.io.IOException: Backing channel 'apache-beam-jenkins-3' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286) at com.sun.proxy.$Proxy133.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1211) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1203) at hudson.Launcher$ProcStarter.join(Launcher.java:523) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:803) at hudson.model.Build$BuildExecution.build(Build.java:197) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:513) at hudson.model.Run.execute(Run.java:1906) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) Caused by: java.io.IOException: Pipe closed after 0 cycles at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:118) at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:101) at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:93) at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:74) at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:104) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-3 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
