See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/169/display/redirect>
Changes: ------------------------------------------ [...truncated 296.58 KB...] Jun 06, 2022 3:03:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-06-06T15:03:31.384Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20batch0gbk05-jenkins-06061503-jx2o. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:36.748Z: Worker configuration: e2-standard-2 in us-central1-b. Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:37.561Z: Expanding SplittableParDo operations into optimizable parts. Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:37.592Z: Expanding CollectionToSingleton operations into optimizable parts. Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:37.656Z: Expanding CoGroupByKey operations into optimizable parts. Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:37.993Z: Expanding GroupByKey operations into optimizable parts. Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.063Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.098Z: Fusing consumer Group by key (1)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.128Z: Fusing consumer Group by key (2)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.161Z: Fusing consumer Group by key (3)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.184Z: Fusing consumer Group by key (4)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.215Z: Fusing consumer Group by key (5)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.259Z: Fusing consumer Group by key (6)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.287Z: Fusing consumer Group by key (7)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.350Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.395Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.426Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.459Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.490Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.550Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.584Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.618Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.649Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.684Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/Read Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.717Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.761Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/Read Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.808Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.875Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/Read Jun 06, 2022 3:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.923Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:38.978Z: Fusing consumer Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) into Group by key (4)/Read Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.025Z: Fusing consumer Collect end time metrics (4)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.058Z: Fusing consumer Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) into Group by key (5)/Read Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.081Z: Fusing consumer Collect end time metrics (5)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.113Z: Fusing consumer Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) into Group by key (6)/Read Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.136Z: Fusing consumer Collect end time metrics (6)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.162Z: Fusing consumer Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) into Group by key (7)/Read Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.195Z: Fusing consumer Collect end time metrics (7)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:39.639Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Jun 06, 2022 3:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:40.797Z: Starting 16 ****s in us-central1-b... Jun 06, 2022 3:03:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:03:57.962Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jun 06, 2022 3:04:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:04:03.212Z: Autoscaling: Raised the number of ****s to 16 based on the rate of progress in the currently running stage(s). Jun 06, 2022 3:05:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:08.951Z: Workers have started successfully. Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:24.913Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.066Z: Executing operation Group by key (7)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.120Z: Executing operation Group by key (1)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.147Z: Executing operation Group by key (2)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.181Z: Executing operation Group by key (3)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.215Z: Executing operation Group by key (4)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.272Z: Executing operation Group by key (5)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.303Z: Executing operation Group by key (6)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.339Z: Executing operation Group by key (0)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.680Z: Finished operation Group by key (1)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.683Z: Finished operation Group by key (3)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.686Z: Finished operation Group by key (7)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:25.700Z: Finished operation Group by key (6)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:26.514Z: Finished operation Group by key (2)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:26.533Z: Finished operation Group by key (5)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:26.564Z: Finished operation Group by key (4)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:26.687Z: Finished operation Group by key (0)/Create Jun 06, 2022 3:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:26.811Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Jun 06, 2022 3:05:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:36.813Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Jun 06, 2022 3:05:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:36.880Z: Executing operation Group by key (2)/Close Jun 06, 2022 3:05:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:36.915Z: Executing operation Group by key (3)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:36.943Z: Finished operation Group by key (2)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:36.969Z: Finished operation Group by key (3)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:36.970Z: Executing operation Group by key (4)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:36.998Z: Executing operation Group by key (5)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.022Z: Finished operation Group by key (4)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.026Z: Executing operation Group by key (6)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.052Z: Finished operation Group by key (5)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.056Z: Executing operation Group by key (7)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.080Z: Finished operation Group by key (6)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.106Z: Finished operation Group by key (7)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.124Z: Executing operation Group by key (1)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.162Z: Executing operation Group by key (0)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.187Z: Finished operation Group by key (1)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.200Z: Executing operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.213Z: Finished operation Group by key (0)/Close Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.234Z: Executing operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.283Z: Executing operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.325Z: Executing operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.384Z: Executing operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.414Z: Executing operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.452Z: Executing operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:37.485Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:41.509Z: Finished operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:43.833Z: Finished operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:44.071Z: Finished operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:44.523Z: Finished operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:44.883Z: Finished operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:45.499Z: Finished operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:46.146Z: Finished operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:46.641Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Jun 06, 2022 3:05:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:46.784Z: Cleaning up. Jun 06, 2022 3:05:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:05:46.854Z: Stopping **** pool... Jun 06, 2022 3:06:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:06:16.177Z: Autoscaling: Resized **** pool from 16 to 0. Jun 06, 2022 3:06:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-06-06T15:06:16.249Z: Worker pool stopped. Jun 06, 2022 3:06:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-06-06_08_03_26-3008779726791235033 finished with status DONE. Load test results for test (ID): 4b1e24e1-28ef-44f1-bae8-72b023cc73c9 and timestamp: 2022-06-06T15:03:20.758000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 16.919 dataflow_v2_java17_total_bytes_count 2.5E8 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220606150247 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5bfbf7bf89dbda3d7397cf1daeef5839fc5b6e9057944d430b0cedda2c3488ec Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220606150247] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5bfbf7bf89dbda3d7397cf1daeef5839fc5b6e9057944d430b0cedda2c3488ec] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220606150247] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5bfbf7bf89dbda3d7397cf1daeef5839fc5b6e9057944d430b0cedda2c3488ec])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5bfbf7bf89dbda3d7397cf1daeef5839fc5b6e9057944d430b0cedda2c3488ec Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5bfbf7bf89dbda3d7397cf1daeef5839fc5b6e9057944d430b0cedda2c3488ec ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Mon, 06 Jun 2022 15:06:29 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:5bfbf7bf89dbda3d7397cf1daeef5839fc5b6e9057944d430b0cedda2c3488ec': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 297 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 3m 43s 105 actionable tasks: 8 executed, 97 up-to-date Publishing build scan... https://gradle.com/s/oasrdyl4zah36 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
