See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/1323/display/redirect?page=changes>
Changes: [egalpin] Uses _all to follow alias/datastreams when estimating index size [egalpin] Adds test for following aliases when estimating index size [noreply] Bump github.com/aws/aws-sdk-go-v2/config from 1.18.0 to 1.18.1 in /sdks ------------------------------------------ [...truncated 211.02 KB...] INFO: 2022-11-17T15:27:39.654Z: Unzipping flatten Query8-Query8-CoGroupByKey-Flatten for input Query8-Query8-CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.676Z: Fusing unzipped copy of Query8/Query8/CoGroupByKey/GBK/Reify, through flatten Query8/Query8/CoGroupByKey/Flatten, into producer Query8/Query8/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.702Z: Fusing consumer Query8/Query8/CoGroupByKey/GBK/GroupByWindow into Query8/Query8/CoGroupByKey/GBK/Read Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.737Z: Fusing consumer Query8/Query8/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into Query8/Query8/CoGroupByKey/GBK/GroupByWindow Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.765Z: Fusing consumer Query8/Query8/Query8.Select/ParMultiDo(Anonymous) into Query8/Query8/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.801Z: Fusing consumer Query8/Query8.Debug/ParMultiDo(Monitor) into Query8/Query8/Query8.Select/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.838Z: Fusing consumer Query8/Query8.Stamp/ParMultiDo(Anonymous) into Query8/Query8.Debug/ParMultiDo(Monitor) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.871Z: Fusing consumer Query8.Format/ParMultiDo(Anonymous) into Query8/Query8.Stamp/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.912Z: Fusing consumer Query8.DevNull/ParMultiDo(Anonymous) into Query8.Format/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.947Z: Unzipping flatten Query8-Query8-CoGroupByKey-Flatten-u19 for input Query8-Query8-CoGroupByKey-GBK-reify-value6-c17 Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.987Z: Fusing unzipped copy of Query8/Query8/CoGroupByKey/GBK/Write, through flatten Query8/Query8/CoGroupByKey/Flatten/Unzipped-1, into producer Query8/Query8/CoGroupByKey/GBK/Reify Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.012Z: Fusing consumer Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query8/Query8.Snoop/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.051Z: Fusing consumer Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous) into Query8/Query8.Snoop/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.084Z: Fusing consumer Query8/Query8/CoGroupByKey/GBK/Reify into Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.115Z: Fusing consumer Query8/Query8/CoGroupByKey/GBK/Write into Query8/Query8/CoGroupByKey/GBK/Reify Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.151Z: Fusing consumer Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Query8.ReadBounded/Impulse Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.183Z: Fusing consumer Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.206Z: Fusing consumer Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.243Z: Fusing consumer Query8/Query8.Monitor/ParMultiDo(Monitor) into Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.276Z: Fusing consumer Query8/Query8.Snoop/ParMultiDo(Anonymous) into Query8/Query8.Monitor/ParMultiDo(Monitor) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.312Z: Fusing consumer Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous) into Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.363Z: Fusing consumer Query8/Query8/Query8.WindowPersons/Window.Assign into Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.386Z: Fusing consumer Query8/Query8/PersonById/ParMultiDo(Anonymous) into Query8/Query8/Query8.WindowPersons/Window.Assign Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.416Z: Fusing consumer Query8/Query8/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Query8/Query8/PersonById/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.445Z: Fusing consumer Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous) into Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.478Z: Fusing consumer Query8/Query8/Query8.WindowAuctions/Window.Assign into Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.514Z: Fusing consumer Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous) into Query8/Query8/Query8.WindowAuctions/Window.Assign Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.548Z: Fusing consumer Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.972Z: Executing operation Query8.ReadBounded/Impulse+Query8.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:41.054Z: Starting 4 ****s in us-central1-b... Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:41.441Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.349Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.381Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.414Z: Fusing consumer Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous) into Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.844Z: Executing operation Query5.ReadBounded/Impulse+Query5.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.915Z: Starting 4 ****s in us-central1-b... Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.828Z: Fusing consumer Query1/Query1.Stamp/ParMultiDo(Anonymous) into Query1/Query1.Debug/ParMultiDo(Monitor) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.871Z: Fusing consumer Query1.Format/ParMultiDo(Anonymous) into Query1/Query1.Stamp/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:39.914Z: Fusing consumer Query1.DevNull/ParMultiDo(Anonymous) into Query1.Format/ParMultiDo(Anonymous) Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.300Z: Executing operation Query1.ReadBounded/Impulse+Query1.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 17, 2022 3:27:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.372Z: Starting 4 ****s in us-central1-b... Nov 17, 2022 3:27:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:41.934Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:27:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:40.733Z: Fusing consumer Query11.DevNull/ParMultiDo(Anonymous) into Query11.Format/ParMultiDo(Anonymous) Nov 17, 2022 3:27:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:41.185Z: Executing operation Query11.ReadBounded/Impulse+Query11.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query11-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query11-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 17, 2022 3:27:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:41.261Z: Starting 4 ****s in us-central1-b... Nov 17, 2022 3:27:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:46.432Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:27:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:52.289Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:27:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:54.388Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:27:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:54.169Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:27:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:56.456Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:27:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:57.247Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:28:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:27:58.420Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:28:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:06.959Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 17, 2022 3:28:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:21.860Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:21.895Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:20.436Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:20.467Z: Autoscaling: Resized **** pool to 1, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:22.370Z: Autoscaling: Raised the number of ****s to 2 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:22.395Z: Autoscaling: Resized **** pool to 2, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:23.428Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:23.460Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:23.395Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:23.430Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:21.983Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:22.016Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:24.790Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:24.828Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:22.102Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:22.129Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:23.772Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:24.874Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:24.902Z: Autoscaling: Resized **** pool to 3, though goal was 4. This could be a quota issue. Nov 17, 2022 3:28:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:30.864Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:32.337Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:32.206Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:32.695Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:32.431Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:33.786Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:33.840Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:35.249Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-17T15:28:35.175Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s). Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-17487571062398119036 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-17430109632563120466 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-13662963652756944990 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-13301792890237926958 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-8447892989269531500 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-11994910030889225418 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-532202315520903317 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-3442490443107748963 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-7381389464056649106 Nov 17, 2022 3:28:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0 WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it. To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-8950191943171895390 > Task :sdks:java:testing:nexmark:run FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=263c913b-560c-4d63-9393-409178f64ba7, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 2831043 log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-2831043.out.log ----- Last 20 lines from daemon log file - daemon-2831043.out.log ----- To cancel the job in the cloud, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-17_07_27_25-8950191943171895390 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221117152430 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b12959f33b5337313a55c3a4781ae78f31fc88777ced6ecf3f99dc02174a38 Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. Remove shutdown hook failed java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) at java.lang.Runtime.removeShutdownHook(Runtime.java:231) at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38) at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208) at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366) at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108) at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84) at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221117152430 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:71b12959f33b5337313a55c3a4781ae78f31fc88777ced6ecf3f99dc02174a38 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
