See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/658/display/redirect>
Changes: ------------------------------------------ [...truncated 327.16 KB...] Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:25.724Z: Worker configuration: e2-standard-2 in us-central1-f. Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:26.683Z: Expanding SplittableParDo operations into optimizable parts. Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:26.716Z: Expanding CollectionToSingleton operations into optimizable parts. Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:26.769Z: Expanding CoGroupByKey operations into optimizable parts. Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.001Z: Expanding GroupByKey operations into optimizable parts. Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.055Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.081Z: Fusing consumer Group by key (1)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.108Z: Fusing consumer Group by key (2)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.131Z: Fusing consumer Group by key (3)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.162Z: Fusing consumer Group by key (4)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.185Z: Fusing consumer Group by key (5)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.210Z: Fusing consumer Group by key (6)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.235Z: Fusing consumer Group by key (7)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.260Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.289Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.314Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.338Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.366Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.389Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.412Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.442Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.466Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.489Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.511Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.533Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.555Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.584Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.608Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.635Z: Fusing consumer Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) into Group by key (4)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.659Z: Fusing consumer Collect end time metrics (4)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.685Z: Fusing consumer Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) into Group by key (5)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.713Z: Fusing consumer Collect end time metrics (5)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.743Z: Fusing consumer Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) into Group by key (6)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.766Z: Fusing consumer Collect end time metrics (6)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.790Z: Fusing consumer Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) into Group by key (7)/Read Apr 09, 2023 2:27:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:27.812Z: Fusing consumer Collect end time metrics (7)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) Apr 09, 2023 2:27:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:28.137Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Apr 09, 2023 2:27:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:28.207Z: Starting 16 ****s in us-central1-f... Apr 09, 2023 2:27:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:27:52.747Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 09, 2023 2:28:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:28:07.121Z: Autoscaling: Raised the number of ****s to 16 based on the rate of progress in the currently running stage(s). Apr 09, 2023 2:28:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:28:55.916Z: Workers have started successfully. Apr 09, 2023 2:29:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:10.231Z: All ****s have finished the startup processes and began to receive work requests. Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.167Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.295Z: Executing operation Group by key (7)/Create Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.318Z: Executing operation Group by key (1)/Create Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.346Z: Executing operation Group by key (2)/Create Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.379Z: Executing operation Group by key (3)/Create Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.412Z: Executing operation Group by key (4)/Create Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.445Z: Executing operation Group by key (5)/Create Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.473Z: Executing operation Group by key (6)/Create Apr 09, 2023 2:29:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:15.499Z: Executing operation Group by key (0)/Create Apr 09, 2023 2:29:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:16.641Z: Finished operation Group by key (7)/Create Apr 09, 2023 2:29:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:18.037Z: Finished operation Group by key (1)/Create Apr 09, 2023 2:29:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:19.507Z: Finished operation Group by key (2)/Create Apr 09, 2023 2:29:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:19.526Z: Finished operation Group by key (3)/Create Apr 09, 2023 2:29:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:19.574Z: Finished operation Group by key (4)/Create Apr 09, 2023 2:29:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:19.576Z: Finished operation Group by key (0)/Create Apr 09, 2023 2:29:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:20.569Z: Finished operation Group by key (5)/Create Apr 09, 2023 2:29:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:20.584Z: Finished operation Group by key (6)/Create Apr 09, 2023 2:29:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:20.715Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.327Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.380Z: Executing operation Group by key (2)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.412Z: Executing operation Group by key (3)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.424Z: Finished operation Group by key (2)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.443Z: Executing operation Group by key (4)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.457Z: Finished operation Group by key (3)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.481Z: Executing operation Group by key (5)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.496Z: Finished operation Group by key (4)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.507Z: Executing operation Group by key (6)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.528Z: Executing operation Group by key (7)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.529Z: Finished operation Group by key (5)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.551Z: Executing operation Group by key (1)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.562Z: Finished operation Group by key (6)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.574Z: Executing operation Group by key (0)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.581Z: Finished operation Group by key (7)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.605Z: Finished operation Group by key (1)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.605Z: Executing operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.626Z: Finished operation Group by key (0)/Close Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.628Z: Executing operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.655Z: Executing operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.691Z: Executing operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.713Z: Executing operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.734Z: Executing operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.757Z: Executing operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:41.783Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:46.054Z: Finished operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:46.554Z: Finished operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:48.775Z: Finished operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:50.005Z: Finished operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:51.262Z: Finished operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:52.269Z: Finished operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:52.288Z: Finished operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:53.202Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Apr 09, 2023 2:29:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:53.312Z: Cleaning up. Apr 09, 2023 2:29:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:29:53.381Z: Stopping **** pool... Apr 09, 2023 2:32:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:32:04.143Z: Autoscaling: Resized **** pool from 16 to 0. Apr 09, 2023 2:32:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-09T14:32:04.187Z: Worker pool stopped. Apr 09, 2023 2:32:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2023-04-09_07_27_16-10265526615911403762 finished with status DONE. Load test results for test (ID): 119a53fd-c45d-4294-a5eb-73a1a9d81987 and timestamp: 2023-04-09T14:27:11.500000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 28.844 dataflow_v2_java11_total_bytes_count 2.5E8 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409142650 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3fd57e1cd1443a4eac126271f9942b320c0eba35a81c71e831816a72cd37d17 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409142650] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3fd57e1cd1443a4eac126271f9942b320c0eba35a81c71e831816a72cd37d17] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230409142650] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3fd57e1cd1443a4eac126271f9942b320c0eba35a81c71e831816a72cd37d17])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3fd57e1cd1443a4eac126271f9942b320c0eba35a81c71e831816a72cd37d17 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3fd57e1cd1443a4eac126271f9942b320c0eba35a81c71e831816a72cd37d17 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Sun, 09 Apr 2023 14:32:14 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404} Failed to compute blob liveness for manifest: 'sha256:b3fd57e1cd1443a4eac126271f9942b320c0eba35a81c71e831816a72cd37d17': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 306 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 5m 39s 112 actionable tasks: 9 executed, 103 up-to-date Publishing build scan... https://gradle.com/s/gyr53wsrjialo Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
