See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/242/display/redirect?page=changes>
Changes: [Pablo Estrada] Simplify README for new users [laraschmidt] Fix final allowskew error to properly handle a large allowedSkew [noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on ------------------------------------------ [...truncated 168.06 KB...] INFO: 2022-02-18T00:24:32.287Z: Fusing consumer Query2/Query2.Stamp/ParMultiDo(Anonymous) into Query2/Query2.Debug/ParMultiDo(Monitor) Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.318Z: Fusing consumer Query2.Format/ParMultiDo(Anonymous) into Query2/Query2.Stamp/ParMultiDo(Anonymous) Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.342Z: Fusing consumer Query2.DevNull/ParMultiDo(Anonymous) into Query2.Format/ParMultiDo(Anonymous) Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.492Z: Worker configuration: e2-standard-2 in us-central1-f. Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.237Z: Expanding SplittableParDo operations into optimizable parts. Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.269Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.342Z: Expanding CoGroupByKey operations into optimizable parts. Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.387Z: Expanding GroupByKey operations into optimizable parts. Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.467Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.500Z: Fusing consumer Query0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query0.ReadBounded/Impulse Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.536Z: Fusing consumer Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.564Z: Fusing consumer Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.603Z: Fusing consumer Query0/Query0.Monitor/ParMultiDo(Monitor) into Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 18, 2022 12:24:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.641Z: Fusing consumer Query0/Query0.Snoop/ParMultiDo(Anonymous) into Query0/Query0.Monitor/ParMultiDo(Monitor) Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.900Z: Executing operation Query10.ReadBounded/Impulse+Query10.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.990Z: Starting 4 ****s in us-central1-b... Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.688Z: Executing operation Query2.ReadBounded/Impulse+Query2.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.772Z: Starting 4 ****s in us-central1-f... Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.343Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.368Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.409Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Write into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.445Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Read Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.479Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.515Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.554Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:31.595Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.069Z: Executing operation Query5.ReadBounded/Impulse+Query5.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:24:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.152Z: Starting 4 ****s in us-central1-b... Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.672Z: Fusing consumer Query0/Query0/Query0.Serialize/ParMultiDo(Anonymous) into Query0/Query0.Snoop/ParMultiDo(Anonymous) Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.715Z: Fusing consumer Query0/Query0.Debug/ParMultiDo(Monitor) into Query0/Query0/Query0.Serialize/ParMultiDo(Anonymous) Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.748Z: Fusing consumer Query0/Query0.Stamp/ParMultiDo(Anonymous) into Query0/Query0.Debug/ParMultiDo(Monitor) Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.816Z: Fusing consumer Query0.Format/ParMultiDo(Anonymous) into Query0/Query0.Stamp/ParMultiDo(Anonymous) Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.851Z: Fusing consumer Query0.DevNull/ParMultiDo(Anonymous) into Query0.Format/ParMultiDo(Anonymous) Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:33.233Z: Executing operation Query0.ReadBounded/Impulse+Query0.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:33.311Z: Starting 4 ****s in us-central1-f... Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.690Z: Executing operation Query12.ReadBounded/Impulse+Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:32.770Z: Starting 4 ****s in us-central1-f... Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:37.490Z: Worker configuration: e2-standard-2 in us-central1-a. Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.553Z: Expanding SplittableParDo operations into optimizable parts. Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.587Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.688Z: Expanding CoGroupByKey operations into optimizable parts. Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.810Z: Expanding GroupByKey operations into optimizable parts. Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.896Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.936Z: Fusing consumer Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query14.ReadBounded/Impulse Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.964Z: Fusing consumer Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:38.988Z: Fusing consumer Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.029Z: Fusing consumer Query14/Query14.Monitor/ParMultiDo(Monitor) into Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.054Z: Fusing consumer Query14/Query14.Snoop/ParMultiDo(Anonymous) into Query14/Query14.Monitor/ParMultiDo(Monitor) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.101Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Pair with random key/ParMultiDo(AssignShard) into Query14/Query14.Snoop/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.171Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Query14/Query14/Reshuffle.ViaRandomKey/Pair with random key/ParMultiDo(AssignShard) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.194Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.219Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.272Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.308Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.362Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.399Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.422Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.466Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.503Z: Fusing consumer Query14/Query14.Debug/ParMultiDo(Monitor) into Query14/Query14/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.539Z: Fusing consumer Query14/Query14.Stamp/ParMultiDo(Anonymous) into Query14/Query14.Debug/ParMultiDo(Monitor) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.573Z: Fusing consumer Query14.Format/ParMultiDo(Anonymous) into Query14/Query14.Stamp/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.668Z: Fusing consumer Query14.DevNull/ParMultiDo(Anonymous) into Query14.Format/ParMultiDo(Anonymous) Feb 18, 2022 12:24:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:39.722Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:24:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:40.360Z: Executing operation Query14.ReadBounded/Impulse+Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:24:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:40.443Z: Starting 4 ****s in us-central1-a... Feb 18, 2022 12:24:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:46.778Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:24:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:48.022Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:24:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:50.280Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:24:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:50.814Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:24:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:52.586Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:24:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:24:54.810Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:25:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:02.220Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:25:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:02.677Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:02.704Z: Resized **** pool to 1, though goal was 4. This could be a quota issue. Feb 18, 2022 12:25:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:03.675Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:25:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:04.978Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 18, 2022 12:25:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:11.086Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:13.010Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:15.982Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:17.251Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:18.070Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:17.511Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:20.511Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:21.585Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:26.282Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:25:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:25:27.059Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Feb 18, 2022 12:26:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:02.226Z: Workers have started successfully. Feb 18, 2022 12:26:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:02.270Z: Workers have started successfully. Feb 18, 2022 12:26:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:09.968Z: Workers have started successfully. Feb 18, 2022 12:26:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:10.005Z: Workers have started successfully. Feb 18, 2022 12:26:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:13.696Z: Workers have started successfully. Feb 18, 2022 12:26:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:13.725Z: Workers have started successfully. Feb 18, 2022 12:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:14.046Z: Finished operation Query1.ReadBounded/Impulse+Query1.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:26:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:14.228Z: Executing operation Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query1/Query1.Monitor/ParMultiDo(Monitor)+Query1/Query1.Snoop/ParMultiDo(Anonymous)+Query1/Query1/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query1/Query1/justBids/AsBid/ParMultiDo(Anonymous)+Query1/Query1/Query1.ToEuros/ParMultiDo(Anonymous)+Query1/Query1.Debug/ParMultiDo(Monitor)+Query1/Query1.Stamp/ParMultiDo(Anonymous)+Query1.Format/ParMultiDo(Anonymous)+Query1.DevNull/ParMultiDo(Anonymous) Feb 18, 2022 12:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:15.443Z: Workers have started successfully. Feb 18, 2022 12:26:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:15.481Z: Workers have started successfully. Feb 18, 2022 12:26:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:15.465Z: Workers have started successfully. Feb 18, 2022 12:26:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:15.502Z: Workers have started successfully. Feb 18, 2022 12:26:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:17.414Z: Workers have started successfully. Feb 18, 2022 12:26:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:17.433Z: Workers have started successfully. Feb 18, 2022 12:26:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:16.701Z: Workers have started successfully. Feb 18, 2022 12:26:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:16.729Z: Workers have started successfully. Feb 18, 2022 12:26:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:25.130Z: Workers have started successfully. Feb 18, 2022 12:26:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:25.166Z: Workers have started successfully. Feb 18, 2022 12:26:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:26.321Z: Workers have started successfully. Feb 18, 2022 12:26:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:26.352Z: Workers have started successfully. Feb 18, 2022 12:26:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:26.370Z: Workers have started successfully. Feb 18, 2022 12:26:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:26.412Z: Workers have started successfully. Feb 18, 2022 12:26:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:27.025Z: Finished operation Query13.ReadBounded/Impulse+Query13.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 18, 2022 12:26:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-18T00:26:27.246Z: Executing operation Query13/Query13/GroupByKey/Create FATAL: command execution failed java.io.IOException: Backing channel 'apache-beam-jenkins-9' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286) at com.sun.proxy.$Proxy126.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205) at hudson.Launcher$ProcStarter.join(Launcher.java:522) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:806) at hudson.model.Build$BuildExecution.build(Build.java:198) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:514) at hudson.model.Run.execute(Run.java:1888) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:99) at hudson.model.Executor.run(Executor.java:432) Caused by: java.io.IOException: Pipe closed after 0 cycles at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126) at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105) at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:93) at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:74) at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:104) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-9 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
