See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/1187/display/redirect?page=changes>
Changes: [Moritz Mack] Fix SparkSessionFactory to not fail when using Spark master local[*] ------------------------------------------ [...truncated 174.85 KB...] Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.731Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.753Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.778Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.808Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable/ParMultiDo(Anonymous) Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.833Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.861Z: Fusing consumer Query14/Query14/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous) into Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.888Z: Fusing consumer Query14/Query14.Debug/ParMultiDo(Monitor) into Query14/Query14/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous) Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.918Z: Fusing consumer Query14/Query14.Stamp/ParMultiDo(Anonymous) into Query14/Query14.Debug/ParMultiDo(Monitor) Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.941Z: Fusing consumer Query14.Format/ParMultiDo(Anonymous) into Query14/Query14.Stamp/ParMultiDo(Anonymous) Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.960Z: Fusing consumer Query14.DevNull/ParMultiDo(Anonymous) into Query14.Format/ParMultiDo(Anonymous) Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.002Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.237Z: Executing operation Query14.ReadBounded/Impulse+Query14.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 14, 2022 3:25:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.297Z: Starting 4 ****s in us-central1-b... Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.518Z: Fusing consumer Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query8/Query8.Snoop/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.546Z: Fusing consumer Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query8/Query8.Snoop/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.579Z: Fusing consumer Query8/Query8/CoGroupByKey/GBK/Reify into Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.616Z: Fusing consumer Query8/Query8/CoGroupByKey/GBK/Write into Query8/Query8/CoGroupByKey/GBK/Reify Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.654Z: Fusing consumer Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query8.ReadBounded/Impulse Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.692Z: Fusing consumer Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.725Z: Fusing consumer Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.763Z: Fusing consumer Query8/Query8.Monitor/ParMultiDo(Monitor) into Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.790Z: Fusing consumer Query8/Query8.Snoop/ParMultiDo(Anonymous) into Query8/Query8.Monitor/ParMultiDo(Monitor) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.817Z: Fusing consumer Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous) into Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.838Z: Fusing consumer Query8/Query8/Query8.WindowPersons/Window.Assign into Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.873Z: Fusing consumer Query8/Query8/PersonById/ParMultiDo(Anonymous) into Query8/Query8/Query8.WindowPersons/Window.Assign Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.906Z: Fusing consumer Query8/Query8/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Query8/Query8/PersonById/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.945Z: Fusing consumer Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous) into Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:56.972Z: Fusing consumer Query8/Query8/Query8.WindowAuctions/Window.Assign into Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.003Z: Fusing consumer Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous) into Query8/Query8/Query8.WindowAuctions/Window.Assign Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.038Z: Fusing consumer Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous) Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.407Z: Executing operation Query8.ReadBounded/Impulse+Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 14, 2022 3:25:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.518Z: Starting 4 ****s in us-central1-b... Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.919Z: Fusing consumer Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query12.ReadBounded/Impulse Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.958Z: Fusing consumer Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:57.993Z: Fusing consumer Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.035Z: Fusing consumer Query12/Query12.Monitor/ParMultiDo(Monitor) into Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.072Z: Fusing consumer Query12/Query12.Snoop/ParMultiDo(Anonymous) into Query12/Query12.Monitor/ParMultiDo(Monitor) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.111Z: Fusing consumer Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query12/Query12.Snoop/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.145Z: Fusing consumer Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous) into Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.183Z: Fusing consumer Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.218Z: Fusing consumer Query12/Query12/Window.Into()/Window.Assign into Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.253Z: Fusing consumer Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous) into Query12/Query12/Window.Into()/Window.Assign Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.284Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial into Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.320Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write into Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.354Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.388Z: Fusing consumer Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.415Z: Fusing consumer Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous) into Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.445Z: Fusing consumer Query12/Query12.Debug/ParMultiDo(Monitor) into Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.471Z: Fusing consumer Query12/Query12.Stamp/ParMultiDo(Anonymous) into Query12/Query12.Debug/ParMultiDo(Monitor) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.504Z: Fusing consumer Query12.Format/ParMultiDo(Anonymous) into Query12/Query12.Stamp/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:58.540Z: Fusing consumer Query12.DevNull/ParMultiDo(Anonymous) into Query12.Format/ParMultiDo(Anonymous) Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:59.114Z: Executing operation Query12.ReadBounded/Impulse+Query12.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Oct 14, 2022 3:26:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:25:59.252Z: Starting 4 ****s in us-central1-b... Oct 14, 2022 3:26:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:06.617Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:08.644Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:11.782Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:12.692Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:16.211Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:18.520Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:20.828Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:22.647Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:24.630Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 14, 2022 3:26:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:35.228Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:35.247Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:36.133Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:36.171Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:37.663Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:37.688Z: Autoscaling: Resized **** pool to 1, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:37.921Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:37.956Z: Autoscaling: Resized **** pool to 1, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:38.603Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:38.635Z: Autoscaling: Resized **** pool to 1, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.204Z: Autoscaling: Raised the number of ****s to 2 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.240Z: Autoscaling: Resized **** pool to 2, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.163Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.187Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.583Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.611Z: Autoscaling: Resized **** pool to 1, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.013Z: Autoscaling: Raised the number of ****s to 2 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:40.044Z: Autoscaling: Resized **** pool to 2, though goal was 4. This could be a quota issue. Oct 14, 2022 3:26:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:45.551Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:46.368Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:47.911Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:48.220Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:48.825Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:50.315Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:49.295Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:50.543Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:50.856Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:26:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-10-14T15:26:50.481Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Oct 14, 2022 3:27:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-14_08_25_43-9605018624140026006 Oct 14, 2022 3:27:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-14_08_25_44-1891688259478321249 Oct 14, 2022 3:27:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-14_08_25_44-12408349850706786984 Oct 14, 2022 3:27:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-14_08_25_43-2356371540991634540 Oct 14, 2022 3:27:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-14_08_25_43-15954922314914385023 Oct 14, 2022 3:27:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-14_08_25_43-12875677469177178720 > Task :sdks:java:testing:nexmark:run FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=2118d94b-2471-41e2-a9ee-4844ec9576a7, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 3892685 log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-3892685.out.log ----- Last 20 lines from daemon log file - daemon-3892685.out.log ----- Oct 14, 2022 3:27:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-10-14_08_25_43-12875677469177178720 Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:239) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
