See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/332/display/redirect?page=changes>
Changes: [Kenneth Knowles] Fix arguments to checkState in BatchViewOverrides [noreply] Configure flutter_code_editor options with Hugo shortcode (#23926) [noreply] Eliminate CalciteUtil.CharType logical type (#24013) [noreply] [Playground] Move Playground in GKE and Infrastructure change (#23928) [noreply] Fix broken notebook (#24179) [noreply] Add error reporting for BatchConverter match failure (#24022) [noreply] Update automation to use Go 1.19 (#24175) [noreply] Fix broken json for notebook (#24183) [noreply] Using Teardown context instead of deprecated finalize (#24180) [noreply] [Python]Support pipe operator as Union (PEP -604) (#24106) [noreply] Updated README of Interactive Beam [noreply] Minor update [noreply] Add custom inference function support to the PyTorch model handler [noreply] Strip FGAC database role from changestreams metadata requests (#24177) [Jozef Vilcek] Re-use serializable pipeline options when already available (#24192) ------------------------------------------ [...truncated 303.85 KB...] Nov 16, 2022 3:12:18 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.44.0-SNAPSHOT Nov 16, 2022 3:12:18 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-11-16_07_12_18-13037283096963069737?project=apache-beam-testing Nov 16, 2022 3:12:18 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-11-16_07_12_18-13037283096963069737 Nov 16, 2022 3:12:18 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-11-16_07_12_18-13037283096963069737 Nov 16, 2022 3:12:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-11-16T15:12:20.451Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20batch0gbk05-jenkins-11161512-adzu. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Nov 16, 2022 3:12:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:27.931Z: Worker configuration: e2-standard-2 in us-central1-b. Nov 16, 2022 3:12:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.260Z: Expanding SplittableParDo operations into optimizable parts. Nov 16, 2022 3:12:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.293Z: Expanding CollectionToSingleton operations into optimizable parts. Nov 16, 2022 3:12:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.363Z: Expanding CoGroupByKey operations into optimizable parts. Nov 16, 2022 3:12:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.649Z: Expanding GroupByKey operations into optimizable parts. Nov 16, 2022 3:12:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.724Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Nov 16, 2022 3:12:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.752Z: Fusing consumer Group by key (1)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.783Z: Fusing consumer Group by key (2)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.822Z: Fusing consumer Group by key (3)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.856Z: Fusing consumer Group by key (4)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.888Z: Fusing consumer Group by key (5)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.924Z: Fusing consumer Group by key (6)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.946Z: Fusing consumer Group by key (7)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:29.971Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.009Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.042Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.077Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.114Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.143Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.167Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.192Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.224Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.250Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.277Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.301Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.329Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.355Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.392Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.422Z: Fusing consumer Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) into Group by key (4)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.457Z: Fusing consumer Collect end time metrics (4)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.484Z: Fusing consumer Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) into Group by key (5)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.505Z: Fusing consumer Collect end time metrics (5)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.535Z: Fusing consumer Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) into Group by key (6)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.566Z: Fusing consumer Collect end time metrics (6)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.597Z: Fusing consumer Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) into Group by key (7)/Read Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:30.624Z: Fusing consumer Collect end time metrics (7)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:31.009Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 16, 2022 3:12:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:31.095Z: Starting 16 ****s in us-central1-b... Nov 16, 2022 3:12:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:12:41.357Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Nov 16, 2022 3:13:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:13:12.893Z: Autoscaling: Raised the number of ****s to 16 based on the rate of progress in the currently running stage(s). Nov 16, 2022 3:13:50 PM org.apache.beam.sdk.metrics.MetricsEnvironment getCurrentContainer WARNING: Reporting metrics are not supported in the current execution environment. Nov 16, 2022 3:14:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:19.415Z: Workers have started successfully. Nov 16, 2022 3:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.546Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.685Z: Executing operation Group by key (7)/Create Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.721Z: Executing operation Group by key (1)/Create Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.754Z: Executing operation Group by key (2)/Create Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.790Z: Executing operation Group by key (3)/Create Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.826Z: Executing operation Group by key (4)/Create Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.850Z: Executing operation Group by key (5)/Create Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.885Z: Executing operation Group by key (6)/Create Nov 16, 2022 3:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:36.907Z: Executing operation Group by key (0)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.005Z: Finished operation Group by key (7)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.015Z: Finished operation Group by key (1)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.019Z: Finished operation Group by key (2)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.032Z: Finished operation Group by key (3)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.100Z: Finished operation Group by key (4)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.131Z: Finished operation Group by key (0)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.142Z: Finished operation Group by key (5)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.153Z: Finished operation Group by key (6)/Create Nov 16, 2022 3:14:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:38.401Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:47.931Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.000Z: Executing operation Group by key (2)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.039Z: Executing operation Group by key (3)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.055Z: Finished operation Group by key (2)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.074Z: Executing operation Group by key (4)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.097Z: Finished operation Group by key (3)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.102Z: Executing operation Group by key (5)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.137Z: Executing operation Group by key (6)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.138Z: Finished operation Group by key (4)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.162Z: Finished operation Group by key (5)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.175Z: Executing operation Group by key (7)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.202Z: Finished operation Group by key (6)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.211Z: Executing operation Group by key (1)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.236Z: Finished operation Group by key (7)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.243Z: Executing operation Group by key (0)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.266Z: Finished operation Group by key (1)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.279Z: Executing operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.306Z: Finished operation Group by key (0)/Close Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.312Z: Executing operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.348Z: Executing operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.384Z: Executing operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.417Z: Executing operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.441Z: Executing operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.463Z: Executing operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:48.496Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:52.846Z: Finished operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:56.589Z: Finished operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:57.518Z: Finished operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:14:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:58.488Z: Finished operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:15:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:58.852Z: Finished operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:15:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:14:59.862Z: Finished operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:15:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:15:00.444Z: Finished operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:15:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:15:00.820Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Nov 16, 2022 3:15:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:15:00.980Z: Cleaning up. Nov 16, 2022 3:15:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:15:01.084Z: Stopping **** pool... Nov 16, 2022 3:17:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:17:16.761Z: Autoscaling: Resized **** pool from 16 to 0. Nov 16, 2022 3:17:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-11-16T15:17:16.816Z: Worker pool stopped. Nov 16, 2022 3:17:37 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-11-16_07_12_18-13037283096963069737 finished with status DONE. Load test results for test (ID): cf53197f-0715-4a21-b0b9-0a81d77a5b83 and timestamp: 2022-11-16T15:12:12.825000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 17.397 dataflow_v2_java17_total_bytes_count 2.5E8 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221116151138 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:204eb868197bb716aae6cf57586cbcb0c4c23e8c454b41e57f7926a686bfde66 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221116151138] FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 301 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 6m 1s 108 actionable tasks: 9 executed, 99 up-to-date Publishing build scan... https://gradle.com/s/jfyxd4at2tcda Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
