See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/59/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-12712] Spark: Exclude looping timer tests. [Kyle Weaver] [BEAM-13919] Annotate PerKeyOrderingTest with UsesStatefulParDo. [noreply] Update 2.36.0 blog post to mention ARM64 support [noreply] Minor: Disable checker framework in nightly snapshot (#16829) [artur.khanin] Updated example link [noreply] [BEAM-13860] Make `DoFn.infer_output_type` return element type (#16788) [noreply] [BEAM-13894] Unit test utilities in the ptest package (#16830) [Kenneth Knowles] Add test for processing time continuation trigger [noreply] [BEAM-13922] [Coverage] Make boot.go more testable and add tests [noreply] Exclude SpannerChangeStream IT from Dataflow V1 postcommit (#16851) [noreply] [BEAM-13930] Address StateSpec consistency issue between Runner and Fn ------------------------------------------ [...truncated 293.14 KB...] INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-15_07_14_22-13986766751085597985?project=apache-beam-testing Feb 15, 2022 3:14:22 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-02-15_07_14_22-13986766751085597985 Feb 15, 2022 3:14:22 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-02-15_07_14_22-13986766751085597985 Feb 15, 2022 3:14:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-02-15T15:14:30.463Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20batch0gbk05-jenkins-02151514-9s8m. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Feb 15, 2022 3:14:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:34.723Z: Worker configuration: e2-standard-2 in us-central1-b. Feb 15, 2022 3:14:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:35.474Z: Expanding SplittableParDo operations into optimizable parts. Feb 15, 2022 3:14:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:35.516Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:35.593Z: Expanding CoGroupByKey operations into optimizable parts. Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:35.889Z: Expanding GroupByKey operations into optimizable parts. Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:35.962Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.002Z: Fusing consumer Group by key (1)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.043Z: Fusing consumer Group by key (2)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.083Z: Fusing consumer Group by key (3)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.121Z: Fusing consumer Group by key (4)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.163Z: Fusing consumer Group by key (5)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.188Z: Fusing consumer Group by key (6)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.228Z: Fusing consumer Group by key (7)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.247Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.272Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.302Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.332Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.387Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.424Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.458Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.494Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.517Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.562Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/Read Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.587Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.619Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/Read Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.685Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.720Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/Read Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.757Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.786Z: Fusing consumer Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) into Group by key (4)/Read Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.812Z: Fusing consumer Collect end time metrics (4)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.838Z: Fusing consumer Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) into Group by key (5)/Read Feb 15, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.856Z: Fusing consumer Collect end time metrics (5)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.887Z: Fusing consumer Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) into Group by key (6)/Read Feb 15, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.916Z: Fusing consumer Collect end time metrics (6)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.940Z: Fusing consumer Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) into Group by key (7)/Read Feb 15, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:36.969Z: Fusing consumer Collect end time metrics (7)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) Feb 15, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:37.340Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 15, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:37.439Z: Starting 16 ****s in us-central1-b... Feb 15, 2022 3:15:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:14:49.950Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 15, 2022 3:15:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:15:22.871Z: Autoscaling: Raised the number of ****s to 16 based on the rate of progress in the currently running stage(s). Feb 15, 2022 3:16:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:19.609Z: Workers have started successfully. Feb 15, 2022 3:16:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:19.644Z: Workers have started successfully. Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:32.805Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:32.948Z: Executing operation Group by key (7)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:32.967Z: Executing operation Group by key (1)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.002Z: Executing operation Group by key (2)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.034Z: Executing operation Group by key (3)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.067Z: Executing operation Group by key (4)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.090Z: Executing operation Group by key (5)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.116Z: Executing operation Group by key (6)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.150Z: Executing operation Group by key (0)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.479Z: Finished operation Group by key (6)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:33.485Z: Finished operation Group by key (0)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:34.187Z: Finished operation Group by key (7)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:34.229Z: Finished operation Group by key (1)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:34.256Z: Finished operation Group by key (2)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:34.270Z: Finished operation Group by key (3)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:34.306Z: Finished operation Group by key (4)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:34.355Z: Finished operation Group by key (5)/Create Feb 15, 2022 3:16:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:16:34.540Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Feb 15, 2022 3:18:52 PM org.apache.beam.sdk.metrics.MetricsEnvironment getCurrentContainer WARNING: Reporting metrics are not supported in the current execution environment. Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.659Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.741Z: Executing operation Group by key (2)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.776Z: Executing operation Group by key (3)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.808Z: Executing operation Group by key (4)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.810Z: Finished operation Group by key (2)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.844Z: Executing operation Group by key (5)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.877Z: Executing operation Group by key (6)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.905Z: Finished operation Group by key (5)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.914Z: Executing operation Group by key (7)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.945Z: Executing operation Group by key (1)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.972Z: Finished operation Group by key (7)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:31.982Z: Executing operation Group by key (0)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.013Z: Executing operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.058Z: Executing operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.076Z: Finished operation Group by key (4)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.102Z: Executing operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.136Z: Finished operation Group by key (0)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.136Z: Finished operation Group by key (3)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.145Z: Executing operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.192Z: Finished operation Group by key (1)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.213Z: Executing operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.242Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.274Z: Executing operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.456Z: Finished operation Group by key (6)/Close Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:32.518Z: Executing operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:36.643Z: Finished operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:39.732Z: Finished operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:41.942Z: Finished operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:42.262Z: Finished operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:42.948Z: Finished operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:43.527Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:43.688Z: Finished operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:45.011Z: Finished operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:45.153Z: Cleaning up. Feb 15, 2022 3:18:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:18:45.208Z: Stopping **** pool... Feb 15, 2022 3:21:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:21:19.934Z: Autoscaling: Resized **** pool from 16 to 0. Feb 15, 2022 3:21:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-15T15:21:19.991Z: Worker pool stopped. Feb 15, 2022 3:21:58 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-02-15_07_14_22-13986766751085597985 finished with status DONE. Load test results for test (ID): dd135276-39ce-4c7a-a95d-c4e335a5531a and timestamp: 2022-02-15T15:14:15.700000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 126.591 dataflow_v2_java17_total_bytes_count 2.5E8 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220215151339 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:278c57bdc7696ed6be4dfba253d91681285129515bbb719870593c8b9a1a0f83 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220215151339] FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 294 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 8m 21s 104 actionable tasks: 8 executed, 96 up-to-date Publishing build scan... https://gradle.com/s/uqsvvynj3l52e Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
