See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/458/display/redirect>
Changes: ------------------------------------------ [...truncated 314.78 KB...] Mar 22, 2023 3:11:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:16.256Z: Expanding CollectionToSingleton operations into optimizable parts. Mar 22, 2023 3:11:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:16.381Z: Expanding CoGroupByKey operations into optimizable parts. Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:16.824Z: Expanding GroupByKey operations into optimizable parts. Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:16.924Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:16.960Z: Fusing consumer Group by key (1)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.026Z: Fusing consumer Group by key (2)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.075Z: Fusing consumer Group by key (3)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.131Z: Fusing consumer Group by key (4)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.173Z: Fusing consumer Group by key (5)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.225Z: Fusing consumer Group by key (6)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.266Z: Fusing consumer Group by key (7)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.323Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.369Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.401Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.438Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.474Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.507Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.558Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.617Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.669Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.715Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/Read Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.758Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.811Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/Read Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.866Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.933Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/Read Mar 22, 2023 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:17.977Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.022Z: Fusing consumer Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) into Group by key (4)/Read Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.078Z: Fusing consumer Collect end time metrics (4)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.121Z: Fusing consumer Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) into Group by key (5)/Read Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.179Z: Fusing consumer Collect end time metrics (5)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.221Z: Fusing consumer Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) into Group by key (6)/Read Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.274Z: Fusing consumer Collect end time metrics (6)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.322Z: Fusing consumer Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) into Group by key (7)/Read Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:18.386Z: Fusing consumer Collect end time metrics (7)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:19.636Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Mar 22, 2023 3:11:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:19.753Z: Starting 16 ****s in us-central1-b... Mar 22, 2023 3:11:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:11:30.791Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Mar 22, 2023 3:12:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:12:04.435Z: Autoscaling: Raised the number of ****s to 6 based on the rate of progress in the currently running stage(s). Mar 22, 2023 3:12:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:12:04.475Z: Autoscaling: Resized **** pool to 6, though goal was 16. This could be a quota issue. Mar 22, 2023 3:12:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:12:13.812Z: Autoscaling: Raised the number of ****s to 16 based on the rate of progress in the currently running stage(s). Mar 22, 2023 3:13:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:06.240Z: Workers have started successfully. Mar 22, 2023 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:17.998Z: All ****s have finished the startup processes and began to receive work requests. Mar 22, 2023 3:13:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:21.626Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Mar 22, 2023 3:13:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:21.817Z: Executing operation Group by key (7)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:21.931Z: Executing operation Group by key (1)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:21.994Z: Executing operation Group by key (2)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:22.050Z: Executing operation Group by key (3)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:22.093Z: Executing operation Group by key (4)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:22.160Z: Executing operation Group by key (5)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:22.233Z: Executing operation Group by key (6)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:22.309Z: Executing operation Group by key (0)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:23.304Z: Finished operation Group by key (1)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:23.307Z: Finished operation Group by key (2)/Create Mar 22, 2023 3:13:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:23.307Z: Finished operation Group by key (7)/Create Mar 22, 2023 3:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:24.531Z: Finished operation Group by key (3)/Create Mar 22, 2023 3:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:24.736Z: Finished operation Group by key (5)/Create Mar 22, 2023 3:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:24.835Z: Finished operation Group by key (6)/Create Mar 22, 2023 3:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:25.487Z: Finished operation Group by key (4)/Create Mar 22, 2023 3:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:25.683Z: Finished operation Group by key (0)/Create Mar 22, 2023 3:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:25.822Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.355Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.420Z: Executing operation Group by key (2)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.456Z: Executing operation Group by key (3)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.487Z: Finished operation Group by key (2)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.489Z: Executing operation Group by key (4)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.514Z: Finished operation Group by key (3)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.522Z: Executing operation Group by key (5)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.546Z: Executing operation Group by key (6)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.560Z: Finished operation Group by key (4)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.580Z: Finished operation Group by key (5)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.599Z: Executing operation Group by key (7)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.616Z: Finished operation Group by key (6)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.631Z: Executing operation Group by key (1)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.654Z: Executing operation Group by key (0)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.660Z: Finished operation Group by key (7)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.691Z: Executing operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.693Z: Finished operation Group by key (1)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.709Z: Finished operation Group by key (0)/Close Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.722Z: Executing operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.770Z: Executing operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.803Z: Executing operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.830Z: Executing operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.865Z: Executing operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.895Z: Executing operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:38.933Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:43.333Z: Finished operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:44.103Z: Finished operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:46.072Z: Finished operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:48.182Z: Finished operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:48.226Z: Finished operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:48.900Z: Finished operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:48.979Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:49.271Z: Finished operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Mar 22, 2023 3:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:49.410Z: Cleaning up. Mar 22, 2023 3:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:13:49.496Z: Stopping **** pool... Mar 22, 2023 3:16:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:16:17.773Z: Autoscaling: Resized **** pool from 16 to 0. Mar 22, 2023 3:16:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-03-22T15:16:17.820Z: Worker pool stopped. Mar 22, 2023 3:16:24 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2023-03-22_08_11_04-7665960464485467278 finished with status DONE. Load test results for test (ID): 64e770ec-281a-4119-bc7b-2ae9f5084708 and timestamp: 2023-03-22T15:10:58.863000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 21.374 dataflow_v2_java17_total_bytes_count 2.5E8 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322151033 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2532bdfc009f53ae7bc1c742864b415673089f44660b8d86d302f476c467ecda WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322151033] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2532bdfc009f53ae7bc1c742864b415673089f44660b8d86d302f476c467ecda] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230322151033] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2532bdfc009f53ae7bc1c742864b415673089f44660b8d86d302f476c467ecda])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b33e79bce75bb20ea7ccad275bb009f28464ebd168bddde016308a793e6e1398 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b33e79bce75bb20ea7ccad275bb009f28464ebd168bddde016308a793e6e1398 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Wed, 22 Mar 2023 15:16:28 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404} Failed to compute blob liveness for manifest: 'sha256:b33e79bce75bb20ea7ccad275bb009f28464ebd168bddde016308a793e6e1398': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 306 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 6m 10s 111 actionable tasks: 9 executed, 102 up-to-date Publishing build scan... https://gradle.com/s/elk2aamopqrdm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
