See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/25/display/redirect?page=changes>
Changes: [Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.106 ------------------------------------------ [...truncated 51.17 KB...] INFO: Adding Collect start time metrics (input) as step s3 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Jan 10, 2022 12:39:59 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a37191a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5854a18, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@d5556bf, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@791c12e3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@b112b13, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@24eb65e3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3ac3f6f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1abebef3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@18f55704, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@67cefd84, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5fbe155, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6add8e3f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58a2b917, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@48904d5a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12bbfc54, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1491344a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@59b65dce, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1386313f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5e922647, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@433c6abb] Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Jan 10, 2022 12:39:59 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.37.0-SNAPSHOT Jan 10, 2022 12:40:00 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-10_04_39_59-15736926293421518288?project=apache-beam-testing Jan 10, 2022 12:40:00 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-01-10_04_39_59-15736926293421518288 Jan 10, 2022 12:40:00 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-01-10_04_39_59-15736926293421518288 Jan 10, 2022 12:40:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-01-10T12:40:06.796Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20streaming0cogbk01-jenkins-01-slwf. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jan 10, 2022 12:40:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:11.072Z: Worker configuration: e2-standard-2 in us-central1-f. Jan 10, 2022 12:40:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:11.838Z: Expanding SplittableParDo operations into optimizable parts. Jan 10, 2022 12:40:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:11.869Z: Expanding CollectionToSingleton operations into optimizable parts. Jan 10, 2022 12:40:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:11.919Z: Expanding CoGroupByKey operations into optimizable parts. Jan 10, 2022 12:40:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.036Z: Expanding SplittableProcessKeyed operations into optimizable parts. Jan 10, 2022 12:40:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.089Z: Expanding GroupByKey operations into streaming Read/Write steps Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.147Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.247Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.284Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.307Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.332Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.365Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.397Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.433Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.470Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.491Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.523Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.570Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.597Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.618Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.655Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.679Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.708Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.740Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.775Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.807Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.840Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.868Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.907Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:12.941Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Jan 10, 2022 12:40:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:13.324Z: Starting 5 ****s in us-central1-f... Jan 10, 2022 12:40:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:40:43.001Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jan 10, 2022 12:41:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:41:01.762Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Jan 10, 2022 12:41:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:41:54.396Z: Workers have started successfully. Jan 10, 2022 12:41:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T12:41:54.423Z: Workers have started successfully. Jan 10, 2022 12:52:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:14.180Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:14.349Z: Staged package cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:14.604Z: Staged package dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:14.683Z: Staged package flatbuffers-java-1.12.0-P4wIi03QSphYch8uFiUIyU2w3Yb5YeMG7mPvLtqHG_c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/flatbuffers-java-1.12.0-P4wIi03QSphYch8uFiUIyU2w3Yb5YeMG7mPvLtqHG_c.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:15.819Z: Staged package icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:15.873Z: Staged package jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:16.099Z: Staged package joda-time-2.10.10-3Y58khhaZ40be5M_MSCbYgPI_6kemIBHWhvgNGuWF-M.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/joda-time-2.10.10-3Y58khhaZ40be5M_MSCbYgPI_6kemIBHWhvgNGuWF-M.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:16.284Z: Staged package localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar' is inaccessible. Jan 10, 2022 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-10T12:52:16.378Z: Staged package nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar' is inaccessible. Jan 10, 2022 12:52:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-01-10T12:52:17.088Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Jan 10, 2022 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.684Z: Cancel request is committed for workflow job: 2022-01-10_04_39_59-15736926293421518288. Jan 10, 2022 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.751Z: Cleaning up. Jan 10, 2022 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.823Z: Stopping **** pool... Jan 10, 2022 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.865Z: Stopping **** pool... Jan 10, 2022 4:03:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:03:11.241Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Jan 10, 2022 4:03:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:03:11.278Z: Worker pool stopped. Jan 10, 2022 4:03:17 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-01-10_04_39_59-15736926293421518288 finished with status CANCELLED. Load test results for test (ID): f09c43a2-02c4-49b8-8571-570b88a08584 and timestamp: 2022-01-10T12:39:53.438000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 11890.045 dataflow_v2_java17_total_bytes_count 1.30727934E10 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110123752 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0fea859cd5bf6fe50d01a96741742d148f794e15cb75d3e1f9c94f260a4094d5 Deleted: sha256:ba7b50fbf320168acc9cd1335c324607fe611547419a57ad3bb8c2dc7428def5 Deleted: sha256:b80d2947d1a42da9fce6bd47333a60c270f327243f52c72cc0c78b8d4b49b6f8 Deleted: sha256:21543f48256fd3649f9827a4cf74ac7154aa98481df64892724b7309f96a0967 Deleted: sha256:42e8eb07cbc5b3c54018e6eac1140836381f1e8fbcb2789fab7e98c04486372c Deleted: sha256:98876176a02d3a299f0424072cd58220573a5bc6ed4cf17520b7d64722724c75 Deleted: sha256:deab8d669ddafde69893ebfb23f4fc2a57b92a25bfaf846c5b3a99e27ed8cccd Deleted: sha256:198b9e6f3f609fb8ce33ebaad57e788239261b36ca078940ed47d02d8b77422f Deleted: sha256:4c01b2a95ef6bc5c20113b09ab96de947f4ed3b32897d010747d91708d2033f6 Deleted: sha256:4a4b3bf0c1798ce8f384262618fd52286b1e6e8eda5964164342656bc5b3a2ef Deleted: sha256:ca8d12747da8e754dc807801f70064f83f3de952977835e16fd47312efc85083 Deleted: sha256:a04b27336887dd41ab0af3d8c360898126d8a63db4a4e09582ef5e59be0d79d8 Deleted: sha256:5cefdac6abaa403a457f872b1a53213899691e132916e308a445012cada7d71e Deleted: sha256:66fba344762eb9a89467aeab762fdaff7c9800acc64eff703c372f829da8017f Deleted: sha256:9fd7507f6a2758cb6966f7d9bb61fe4f4f40ef031086d4617043833f593bd5ea Deleted: sha256:e3ef3358e8a613328c5ff09ca1955b545d900e137a82d13b7fbc89e468479242 Deleted: sha256:44c7f15f6042aec2125ce0728c235d52f3ca6a0b0a16c2da296a376b53e4868b Deleted: sha256:f58e6f387dee1bc883afdb26c505e1d00ad531f12bcd074a5ca094b50c2c5beb Deleted: sha256:04ed0c861a6f3e2c1152f08d6333c9828b12b2008eb6689b5e67b1911e92fcb0 Deleted: sha256:f317e398d9fae2097fa1aa469efe74aa3de7e78d49ad1c2aef46b43f38f388ff Deleted: sha256:cb8a6871b5ee1bf01f36311e4be672ae1df8f1156c29e822f323f27b8309f360 Deleted: sha256:6164beb0344d987d9b8ce394d8d009eb752d1cb5058b4ea4f1e73cda4dfdb701 Deleted: sha256:2cf1ebaa63f4197ab705502f53a9b155cfaac7a5234529d7cf491d16a78a3467 Deleted: sha256:eaae951a72883eb231511a6917151217debb193ef39cd079a7e5f1ed679f08ea Deleted: sha256:52f253e799595766774650af8f4a2ea2067b040d64a8a5de7ab0348b93b6cd8c Deleted: sha256:7069679fc4d196e1faf5dc59be1c79485d88de81081df9ac95a4ddf483d3630e Deleted: sha256:8ed8c0a29b65c7cd379fbc0026fc94e18386887a2c548caf4dc270e99a40c69b Deleted: sha256:179c32628b941f4b58e5e1727ddaed1084a0debcf8c54039c827eeaa686c1edb Deleted: sha256:4f0082d55aef90f65355b94411d9968b100f734f8c55537277d6b8a6d8a47dc2 Deleted: sha256:e3466fd734587afc4dd60a113755765e5adebc32d18d7061db125d52b7189d87 Deleted: sha256:1b4f529dcb2ffe7a1d4c457a798d3af7b0125a1a7b890545084e080aa52fb290 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110123752] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0fea859cd5bf6fe50d01a96741742d148f794e15cb75d3e1f9c94f260a4094d5] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110123752] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0fea859cd5bf6fe50d01a96741742d148f794e15cb75d3e1f9c94f260a4094d5])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c ERROR: (gcloud.container.images.delete) Not found: response: {'status': '404', 'content-length': '168', 'x-xss-protection': '0', 'transfer-encoding': 'chunked', 'server': 'Docker Registry', '-content-encoding': 'gzip', 'docker-distribution-api-version': 'registry/2.0', 'cache-control': 'private', 'date': 'Mon, 10 Jan 2022 16:03:20 GMT', 'x-frame-options': 'SAMEORIGIN', 'content-type': 'application/json'} Failed to compute blob liveness for manifest: 'sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 290 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 3h 25m 41s 109 actionable tasks: 75 executed, 30 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/w72xgajshzb5g Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
