See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/207/display/redirect?page=changes>
Changes: [Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.106 ------------------------------------------ [...truncated 50.03 KB...] dc39cbdf68ec: Pushed 8dff6234b371: Pushed aaa06dfc4b09: Pushed 781753bd57dc: Pushed 3bb5258f46d2: Layer already exists 97b5df71f94d: Pushed 4065f5dd1ce4: Pushed 832e177bb500: Layer already exists f9e18e59a565: Layer already exists 26a504e63be4: Layer already exists 31892cc314cb: Layer already exists 11936051f93b: Layer already exists 8bf42db0de72: Layer already exists 2433e8a37a43: Pushed 2cfca14c1553: Pushed 20220110125822: digest: sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c size: 4520 > Task :sdks:java:testing:load-tests:run Jan 10, 2022 1:00:07 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Jan 10, 2022 1:00:07 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 203 files. Enable logging at DEBUG level to see which files will be staged. Jan 10, 2022 1:00:08 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Jan 10, 2022 1:00:08 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Jan 10, 2022 1:00:10 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 203 files from PipelineOptions.filesToStage to staging location to prepare for execution. Jan 10, 2022 1:00:11 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 203 files cached, 0 files newly uploaded in 0 seconds Jan 10, 2022 1:00:11 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Jan 10, 2022 1:00:11 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <113691 bytes, hash 388b486776f0e09d258c614d195174106d80d9980d6b4542c5a2f9b30810eef3> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-OItIZ3bw4J0ljGFNGVF0EG2A2ZgNa0VCxaL5swgQ7vM.pb Jan 10, 2022 1:00:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Jan 10, 2022 1:00:12 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37045b48, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@60b34931, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4aa21f9d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@71c17a57, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@640ab13c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1e0a864d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@440e3ce6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3e67f5f2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@fd53053, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4527f70a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@707b1a44, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7132a9dc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@57435801, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2da66a44, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@527fc8e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@61bfc9bf, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2c7106d9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@329bad59, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@862f408, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@178f268a] Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s3 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Jan 10, 2022 1:00:13 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@791c12e3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@b112b13, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@24eb65e3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3ac3f6f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1abebef3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@18f55704, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@67cefd84, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5fbe155, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6add8e3f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58a2b917, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@48904d5a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12bbfc54, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1491344a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@59b65dce, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1386313f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5e922647, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@433c6abb, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@288f173f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@a22c4d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@45cd7bc5] Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Jan 10, 2022 1:00:13 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.37.0-SNAPSHOT Jan 10, 2022 1:00:14 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-10_05_00_13-957728361604083376?project=apache-beam-testing Jan 10, 2022 1:00:14 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-01-10_05_00_13-957728361604083376 Jan 10, 2022 1:00:14 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-01-10_05_00_13-957728361604083376 Jan 10, 2022 1:00:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-01-10T13:00:22.542Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0cogbk01-jenkins-01-pqck. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jan 10, 2022 1:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:25.918Z: Worker configuration: e2-standard-2 in us-central1-f. Jan 10, 2022 1:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.521Z: Expanding SplittableParDo operations into optimizable parts. Jan 10, 2022 1:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.551Z: Expanding CollectionToSingleton operations into optimizable parts. Jan 10, 2022 1:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.615Z: Expanding CoGroupByKey operations into optimizable parts. Jan 10, 2022 1:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.686Z: Expanding SplittableProcessKeyed operations into optimizable parts. Jan 10, 2022 1:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.713Z: Expanding GroupByKey operations into streaming Read/Write steps Jan 10, 2022 1:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.779Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.886Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.930Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.957Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:26.981Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.015Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.039Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.061Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.096Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.117Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.141Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.165Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.200Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.235Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.257Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.279Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.306Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.341Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.371Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.405Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.466Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.502Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.534Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.558Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Jan 10, 2022 1:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:27.878Z: Starting 5 ****s in us-central1-f... Jan 10, 2022 1:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:00:43.129Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jan 10, 2022 1:01:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:01:13.115Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Jan 10, 2022 1:02:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:02:12.988Z: Workers have started successfully. Jan 10, 2022 1:02:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T13:02:13.052Z: Workers have started successfully. Jan 10, 2022 4:00:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.704Z: Cancel request is committed for workflow job: 2022-01-10_05_00_13-957728361604083376. Jan 10, 2022 4:00:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.762Z: Cleaning up. Jan 10, 2022 4:00:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.833Z: Stopping **** pool... Jan 10, 2022 4:00:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:00:41.898Z: Stopping **** pool... Jan 10, 2022 4:03:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:03:09.599Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Jan 10, 2022 4:03:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-10T16:03:09.629Z: Worker pool stopped. Jan 10, 2022 4:03:16 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-01-10_05_00_13-957728361604083376 finished with status CANCELLED. Load test results for test (ID): e507aab1-8236-48ec-a3fe-a38e8f856745 and timestamp: 2022-01-10T13:00:07.869000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 10672.675 dataflow_v2_java11_total_bytes_count 1.42755092E10 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110125822 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c Deleted: sha256:fa0e1a4ce5b525b74b8cf0aafcdbdb045329d0d7370e6696ba4ad26cef3489ef Deleted: sha256:85acfc7854af4e97f17d405b70ac5e7a7e17e7a09178e588316b1dedc5d1706b Deleted: sha256:ace68236c694a0a5433bc06318009de33e862b7e03bf29532edcc1455bbde412 Deleted: sha256:01b34adcd0d0293859c5f33ec501837743a1ce87b42adf3caeea91d0bd3ec26c Deleted: sha256:1139ea4cfbd758b08ce84d6a90e1bc54e6427d4df91098338ccfd5eb1676c367 Deleted: sha256:4d427d4c444fc118741eb98a1c81bb9e4de9147c3fd70486fa8982e7544eff16 Deleted: sha256:05d6c5c335f013051c496942b3f8572d24551b8623e1ee2c4b157d31b5242070 Deleted: sha256:87f143ec89ef0e6684282a8f9ab743241ec1c2701f1a5818ffc1779aa5ccb292 Deleted: sha256:556cee2737c37c3fb362525348494d84870cef7461ff38d976daf7f3d90df16b Deleted: sha256:bccc893ab7dfd97aec6a49d1c4758a8997bcb4d7a596a8a7c685edb7cb5910b5 Deleted: sha256:a7ef68fa8820af19b21ba3c986f7ceb305393a408b758f3671b78ef72fb489a2 Deleted: sha256:957e6d572f767bf39858b557ac23276264cda27459d2366ff405e958e0e88284 Deleted: sha256:c9fdcfd0e1f3465fd0192b48f8c4a4ff539559892c039c389baa057b4d9114ac Deleted: sha256:1c98ab856d749af49de5c8d8d518225dc250206ccde0f728535a51669d847bf2 Deleted: sha256:d9e66597176a1120109786215b146cd6c23a285b9246624ee9203892f969e2b0 Deleted: sha256:c20972ec3c14861f6769c488569233d6b66e48e96fb5434faf9e979f5d16018a Deleted: sha256:d3dd2cda4fbba257a2d384735e2460a6396505e0c2f6329b5eb9232f1334d571 Deleted: sha256:9db193f2f1eac5bbefc67715dc10547b8dffe5221068d0ecb777586d0d1fc1e4 Deleted: sha256:751b35ff270e0728b29808c54150b830ee37b9404c3af033f8a96e276444c5d1 Deleted: sha256:4a316c6804be6bcf4a5bf1f46649a67090f421a7ffe6561059d7a04214de30f2 Deleted: sha256:99a6f2c086cc67f50b6a307b6c2781176404ecfb58b2d74bd18a4480adc5999f Deleted: sha256:cc3203d7ab3cf78fc7efce3dfa05c125ea70c36282b04597e84db367df456db3 Deleted: sha256:b946168f2939b86c9a4c9fb5617ba79b95d9cb507560784c8703b49953a45dfb Deleted: sha256:666dd19db6bbc81187c4ec4fd7f4bd13649f956b219dd9923603c3df94de6be1 Deleted: sha256:884d8f324381440e42556e0478a0c68ee7aee10e49a0f5d03d37d22c71cf8cef Deleted: sha256:b7e9f8b8820a373a4a4f792b235f0af3b95588e85aab2913e311e9467a63a8a5 Deleted: sha256:7b3c51279f492fc862c1ae6e48abe722061d3c350c81e5919cbd227389bfb22a Deleted: sha256:15cb9b0e04f34ad82d94a969f66dd3644b559b3c5c15d7d30cf35442c9d47b86 Deleted: sha256:c36325729922a2f2eb07663a16ffdd4cef1b753ace054985e421904986b8d802 Deleted: sha256:67e1725730cbb360174ffe8d552143a62cfec96cdd07dd27857cbf025fd58fcc Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110125822] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110125822] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:63aa69ba85114b9a7e55d1e8cf4c7c5ef2151b9ae2729504823103f9c2e7130c]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 3h 5m 12s 109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/r75wcrrleeucw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
