See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Batch_Java17/277/display/redirect?page=changes>
Changes: [bvolpato] Do not use .get() on ValueProvider during pipeline creation [noreply] [Java SDK core] emit watermark from PeriodicSequence (#23301) (#23302) [noreply] Extend protocol in windmill.proto used by google-cloud-dataflow-java [noreply] Allow longer Class-Path entries (#23269) [noreply] Improved pipeline translation in SparkStructuredStreamingRunner (#22446) ------------------------------------------ [...truncated 252.87 KB...] bafdbe68e4ae: Layer already exists a13c519c6361: Layer already exists f8b98004736b: Pushed 8fec4b664bf7: Pushed 0fc07553c3b7: Pushed 20220922150803: digest: sha256:9ac4c9eb6beb19353301c02a3594ec31c5c33812f07040fd8a34cb0789c9e7ce size: 4729 > Task :sdks:java:testing:load-tests:run Sep 22, 2022 3:08:36 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Sep 22, 2022 3:08:37 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 227 files. Enable logging at DEBUG level to see which files will be staged. Sep 22, 2022 3:08:38 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Sep 22, 2022 3:08:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Sep 22, 2022 3:08:40 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 227 files from PipelineOptions.filesToStage to staging location to prepare for execution. Sep 22, 2022 3:08:40 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 227 files cached, 0 files newly uploaded in 0 seconds Sep 22, 2022 3:08:40 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Sep 22, 2022 3:08:40 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <116575 bytes, hash ed971c018be401a5e8cbac5b312b60fe56101cc01c5a97996f46b3385e9b341a> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-7ZccAYvkAaXoy6xbMStg_lYQHMAcWpeZb0azOF6bNBo.pb Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input as step s1 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s2 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s3 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input as step s4 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s5 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s6 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s7 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s8 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s9 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s10 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s11 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s12 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s13 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s14 Sep 22, 2022 3:08:44 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.43.0-SNAPSHOT Sep 22, 2022 3:08:45 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-09-22_08_08_44-872219836300314312?project=apache-beam-testing Sep 22, 2022 3:08:45 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-09-22_08_08_44-872219836300314312 Sep 22, 2022 3:08:45 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-09-22_08_08_44-872219836300314312 Sep 22, 2022 3:08:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-09-22T15:08:48.221Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20batch0cogbk04-jenkins-092215-tvtv. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Sep 22, 2022 3:08:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:56.793Z: Worker configuration: e2-standard-2 in us-central1-a. Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.180Z: Expanding SplittableParDo operations into optimizable parts. Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.213Z: Expanding CollectionToSingleton operations into optimizable parts. Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.284Z: Expanding CoGroupByKey operations into optimizable parts. Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.366Z: Expanding GroupByKey operations into optimizable parts. Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.439Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.478Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.508Z: Fusing unzipped copy of CoGroupByKey/GBK/Write, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.540Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/Read Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.572Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.593Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.626Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.648Z: Fusing consumer CoGroupByKey/GBK/Write into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.680Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.713Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.747Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.789Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.813Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.871Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.943Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.967Z: Fusing consumer Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:58.989Z: Fusing consumer Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:59.010Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:59.043Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:59.119Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:59.571Z: Executing operation Read co-input/Impulse+Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:59.611Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Sep 22, 2022 3:09:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:08:59.643Z: Starting 5 ****s in us-central1-a... Sep 22, 2022 3:09:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:09:27.006Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Sep 22, 2022 3:09:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:09:41.717Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). Sep 22, 2022 3:10:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:10:46.960Z: Workers have started successfully. Sep 22, 2022 3:11:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:05.205Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Sep 22, 2022 3:11:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:05.249Z: Finished operation Read co-input/Impulse+Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Sep 22, 2022 3:11:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:05.426Z: Executing operation CoGroupByKey/GBK/Create Sep 22, 2022 3:11:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:08.196Z: Finished operation CoGroupByKey/GBK/Create Sep 22, 2022 3:11:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:08.397Z: Executing operation Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics (co-input)/ParMultiDo(TimeMonitor)+Window.Into()2/Window.Assign+CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+CoGroupByKey/GBK/Write Sep 22, 2022 3:11:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:08.433Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics (input)/ParMultiDo(TimeMonitor)+Window.Into()/Window.Assign+CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)+CoGroupByKey/GBK/Write Sep 22, 2022 3:11:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:17.604Z: Finished operation Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics (co-input)/ParMultiDo(TimeMonitor)+Window.Into()2/Window.Assign+CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+CoGroupByKey/GBK/Write Sep 22, 2022 3:11:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:18.458Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics (input)/ParMultiDo(TimeMonitor)+Window.Into()/Window.Assign+CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)+CoGroupByKey/GBK/Write Sep 22, 2022 3:11:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:18.540Z: Executing operation CoGroupByKey/GBK/Close Sep 22, 2022 3:11:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:18.608Z: Finished operation CoGroupByKey/GBK/Close Sep 22, 2022 3:11:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:18.683Z: Executing operation CoGroupByKey/GBK/Read+CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+Ungroup and reiterate/ParMultiDo(UngroupAndReiterate)+Collect total bytes/ParMultiDo(ByteMonitor)+Collect end time metrics/ParMultiDo(TimeMonitor) Sep 22, 2022 3:11:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:23.882Z: Finished operation CoGroupByKey/GBK/Read+CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+Ungroup and reiterate/ParMultiDo(UngroupAndReiterate)+Collect total bytes/ParMultiDo(ByteMonitor)+Collect end time metrics/ParMultiDo(TimeMonitor) Sep 22, 2022 3:11:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:24.025Z: Cleaning up. Sep 22, 2022 3:11:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:11:24.131Z: Stopping **** pool... Sep 22, 2022 3:13:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:13:54.348Z: Autoscaling: Resized **** pool from 5 to 0. Sep 22, 2022 3:13:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-09-22T15:13:54.414Z: Worker pool stopped. Sep 22, 2022 3:14:04 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-09-22_08_08_44-872219836300314312 finished with status DONE. Load test results for test (ID): 758ad7c4-6ee3-4648-a7a1-d1a5842aaddd and timestamp: 2022-09-22T15:08:37.795000000Z: Metric: Value: dataflow_v2_java17_runtime_sec 11.837 dataflow_v2_java17_total_bytes_count 4.0E8 > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220922150803 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ac4c9eb6beb19353301c02a3594ec31c5c33812f07040fd8a34cb0789c9e7ce Deleted: sha256:c8703178a9163d6419470c5d13e00c8d52a4aa0566c72b59c421a28d172dccf2 Deleted: sha256:f10128929f2170426a18b1ec021c2ac73ffd86aa23984549c3b5835d38a878ba Deleted: sha256:b172c542485fc1e833306d203f8757d1ab3987412e4ca29f97bbd1d3b3ed895b Deleted: sha256:7cded846b4f1bdbcf5aa88a02c36ac243c75a37b4bedde607b989d3a76f5a45c Deleted: sha256:c6be10a697486c763cd8c1575b56bc271dcfaf230ef4fae28b10fc617964da85 Deleted: sha256:af16876a1f556b3f2b2fc5fa6313f344481b41adc894c7881cd23c381c59c1ff Deleted: sha256:a545fbe18066236c482f248d689734f0e23ce809e23ed01c06ae67913ef881ee Deleted: sha256:499d6b127a5e7e17a89416821f030acef510b77f6637281ac0477a0a48044934 Deleted: sha256:055b260f9dd24db1e91f618429c7f144a5420099483f7138f8a4fb6106a9d44e Deleted: sha256:ab0b8c9c63511c1ea0e2eeddfebae69951cc881f5b5a06872e549ec16b885303 Deleted: sha256:021186ca97f8a36d03f2d8dda35658a750a0cf44c9d6e700f762421cc1125968 Deleted: sha256:9d9873f5df553ce9366d32cdf2ce9dedf8e2fe9119813d6d6a654f087c8f9abc Deleted: sha256:9aa25f04720aedd43db7f02283711a6ff18aa9f32ed60e95be0a53f0b0ac5b93 Deleted: sha256:a0219c87ab95f76f96a75540587935a937d7b8dcbf63196ae43ffd9f543810f1 Deleted: sha256:14b0a49df742e738f41ab6159ba687b8b9555968a3c680f8f34de6045e097397 Deleted: sha256:747b31f5755646efcd3f38a499dd1119c1e017cca538109c2783e726950daab5 Deleted: sha256:8c795770f1e1b92ce0c85e2bae6efb20d6476c63fceab9e5a692dac7f67a9bf8 Deleted: sha256:efe8eeb4296332d6d618e7574178f1a23ae660f85ac3f5651f6c96e4900c1fa4 Deleted: sha256:c4537c779991d6b402f9f37e70756024b78eef03f2eb36aa01d1edcfb80c97c3 Deleted: sha256:efe256e86916d01e3dcc499a26fcf4a070497063c8000381f47ae3a49872b252 Deleted: sha256:164a9c91050546c501a79953ad75e50f5edf2b53c8e0d529455873e18faf1904 Deleted: sha256:f3c138f9301fb247d9a9949e16e90974540b484d8d6a5c8b1bb23f9cd0539739 Deleted: sha256:ccdea347dac91819a15581a839ae98ef5ba744f113bcc070921bc81a7817f3bf Deleted: sha256:71fe373dc99fc5febdf0080898529a1c6d0d1cad94ccc1ac601c49f7b2271afa Deleted: sha256:280e97ea8e23b9340305175e780426715de8269902f5d3a6d01ec6aaa91846eb Deleted: sha256:30d836865aa376a6b3cadd63886e887bc7ba75628128650511edfedd08c559a0 Deleted: sha256:5c66703564565d7bdf83d91cb432e67317787ce26d359c7b9d3a9c68f0689038 Deleted: sha256:6f2e85513e372de35c8626776336501e3fad8d60a6470aad4d3d999931c5ed43 Deleted: sha256:885a7a52f27699a221f7c24d062ea9e44e259fa5155d5c7495c734afc3135616 Deleted: sha256:7a665bf77a6f90aaed119d9ec785519d8604c737530d06b97f2118e910c7348e Deleted: sha256:f88e337adf5d2fa391bbc50db2be4e529fcc6b9be2738fcb00674759ba67c28d Deleted: sha256:cc1cdda5e0a34064cde936aea0a1c0e18bd6acec0ffdbbe490dd6bd82094f44f Deleted: sha256:f6b43c711a7fbe89252c076a441472b3ae62e1b0c9a972edd94454225812de3c Deleted: sha256:4bae33812e9b7b51f0641a730557bab4b10d1b4684ad4b6a8cf073479deaf1dc Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220922150803] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ac4c9eb6beb19353301c02a3594ec31c5c33812f07040fd8a34cb0789c9e7ce] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220922150803] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ac4c9eb6beb19353301c02a3594ec31c5c33812f07040fd8a34cb0789c9e7ce])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ac4c9eb6beb19353301c02a3594ec31c5c33812f07040fd8a34cb0789c9e7ce Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ac4c9eb6beb19353301c02a3594ec31c5c33812f07040fd8a34cb0789c9e7ce Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ac4c9eb6beb19353301c02a3594ec31c5c33812f07040fd8a34cb0789c9e7ce]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:153d7f8352254a99780bbb34c419216c0d5d0aae0ed85a6c50130e4690f8bec6 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:153d7f8352254a99780bbb34c419216c0d5d0aae0ed85a6c50130e4690f8bec6 ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Thu, 22 Sep 2022 15:14:14 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'} Failed to compute blob liveness for manifest: 'sha256:153d7f8352254a99780bbb34c419216c0d5d0aae0ed85a6c50130e4690f8bec6': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Batch_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 302 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 6m 12s 105 actionable tasks: 8 executed, 97 up-to-date Publishing build scan... https://gradle.com/s/any5fbqbf3ga4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
