See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/96/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11. [Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11. [Kyle Weaver] [BEAM-14139] Update list of supported Flink versions. [Kyle Weaver] [BEAM-14139] Update CHANGES.md [noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill [noreply] Minor: Make IOTypeHints a real NamedTuple (#17174) [noreply] [BEAM-14172] Update tox.ini for pydocs (#17176) [noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028) ------------------------------------------ [...truncated 294.83 KB...] INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-25_08_13_24-16391921474438913991?project=apache-beam-testing Mar 25, 2022 3:13:26 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-03-25_08_13_24-16391921474438913991 Mar 25, 2022 3:13:26 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-03-25_08_13_24-16391921474438913991 Mar 25, 2022 3:13:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-03-25T15:13:29.538Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20batch0gbk05-jenkins-03251513-tdyr. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Mar 25, 2022 3:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:33.701Z: Worker configuration: e2-standard-2 in us-central1-c. Mar 25, 2022 3:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:34.606Z: Expanding SplittableParDo operations into optimizable parts. Mar 25, 2022 3:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:34.649Z: Expanding CollectionToSingleton operations into optimizable parts. Mar 25, 2022 3:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:34.710Z: Expanding CoGroupByKey operations into optimizable parts. Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.013Z: Expanding GroupByKey operations into optimizable parts. Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.079Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.114Z: Fusing consumer Group by key (1)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.135Z: Fusing consumer Group by key (2)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.159Z: Fusing consumer Group by key (3)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.194Z: Fusing consumer Group by key (4)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.229Z: Fusing consumer Group by key (5)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.264Z: Fusing consumer Group by key (6)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.297Z: Fusing consumer Group by key (7)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.355Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.383Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.416Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.440Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.491Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.527Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.558Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.594Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.632Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.660Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.686Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.718Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.753Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.777Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.805Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.886Z: Fusing consumer Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) into Group by key (4)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:35.963Z: Fusing consumer Collect end time metrics (4)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.007Z: Fusing consumer Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) into Group by key (5)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.041Z: Fusing consumer Collect end time metrics (5)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.067Z: Fusing consumer Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) into Group by key (6)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.103Z: Fusing consumer Collect end time metrics (6)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.140Z: Fusing consumer Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) into Group by key (7)/Read Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.172Z: Fusing consumer Collect end time metrics (7)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.648Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Mar 25, 2022 3:13:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:36.714Z: Starting 16 ****s in us-central1-c... Mar 25, 2022 3:13:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:13:45.554Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Mar 25, 2022 3:14:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:14:04.933Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s). Mar 25, 2022 3:14:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:14:04.993Z: Resized **** pool to 3, though goal was 16. This could be a quota issue. Mar 25, 2022 3:14:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:14:15.251Z: Autoscaling: Raised the number of ****s to 16 based on the rate of progress in the currently running stage(s). Mar 25, 2022 3:15:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:07.303Z: Workers have started successfully. Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.545Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.764Z: Executing operation Group by key (7)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.811Z: Executing operation Group by key (1)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.848Z: Executing operation Group by key (2)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.902Z: Executing operation Group by key (3)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.923Z: Executing operation Group by key (4)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.961Z: Executing operation Group by key (5)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:21.992Z: Executing operation Group by key (6)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:22.021Z: Executing operation Group by key (0)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:22.819Z: Finished operation Group by key (7)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:23.380Z: Finished operation Group by key (2)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:23.398Z: Finished operation Group by key (1)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:23.612Z: Finished operation Group by key (0)/Create Mar 25, 2022 3:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:23.824Z: Finished operation Group by key (3)/Create Mar 25, 2022 3:15:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:24.449Z: Finished operation Group by key (5)/Create Mar 25, 2022 3:15:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:24.455Z: Finished operation Group by key (6)/Create Mar 25, 2022 3:15:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:24.494Z: Finished operation Group by key (4)/Create Mar 25, 2022 3:15:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:24.773Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.013Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.087Z: Executing operation Group by key (2)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.124Z: Executing operation Group by key (3)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.143Z: Finished operation Group by key (2)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.161Z: Executing operation Group by key (4)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.190Z: Finished operation Group by key (3)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.205Z: Executing operation Group by key (5)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.226Z: Finished operation Group by key (4)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.247Z: Executing operation Group by key (6)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.266Z: Finished operation Group by key (5)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.279Z: Executing operation Group by key (7)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.308Z: Finished operation Group by key (6)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.318Z: Executing operation Group by key (1)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.333Z: Finished operation Group by key (7)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.351Z: Executing operation Group by key (0)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.381Z: Finished operation Group by key (1)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.403Z: Finished operation Group by key (0)/Close Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.424Z: Executing operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.463Z: Executing operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.530Z: Executing operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.564Z: Executing operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.599Z: Executing operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.632Z: Executing operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.667Z: Executing operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:38.702Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:42.760Z: Finished operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:44.416Z: Finished operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:47.708Z: Finished operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:47.709Z: Finished operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:47.766Z: Finished operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:48.295Z: Finished operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:48.315Z: Finished operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:49.687Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Mar 25, 2022 3:15:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:49.850Z: Cleaning up. Mar 25, 2022 3:15:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:15:50.094Z: Stopping **** pool... Mar 25, 2022 3:18:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:18:06.834Z: Autoscaling: Resized **** pool from 16 to 0. Mar 25, 2022 3:18:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-03-25T15:18:06.877Z: Worker pool stopped. Mar 25, 2022 3:18:42 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-03-25_08_13_24-16391921474438913991 finished with status DONE. Load test results for test (ID): 328f7f30-d69c-4148-ae6b-99ea9994b8aa and timestamp: 2022-03-25T15:13:19.591000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 21.225 dataflow_v2_java17_total_bytes_count 2.5E8 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220325151243 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8bcb098ae72bc514988fd153223ce7b3c42e634465b3e048dfacb1b33830c9e1 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220325151243] FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 294 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 6m 2s 105 actionable tasks: 8 executed, 97 up-to-date Publishing build scan... https://gradle.com/s/j2n3gqpvdqijc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
