See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/40/display/redirect?page=changes>
Changes: [noreply] [BEAM-12656] Fix go-licenses build (#15215) [emilyye] add orjson and recommendations-ai packages to Python image [noreply] [Beam-10166] Improve execution time errors (#15206) [noreply] [BEAM-3878] Improve error reporting in calls.go (#15221) [noreply] [BEAM-12661] Fix stuck GetData Windmill calls (#15224) ------------------------------------------ [...truncated 66.29 KB...] 20210727124333: digest: sha256:627cc128ed959dd39bc70f62f0b1f173dbd6b3cbf5c9ff7f346d342975e84600 size: 4310 > Task :sdks:java:testing:load-tests:run Jul 27, 2021 12:48:12 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Jul 27, 2021 12:48:13 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged. Jul 27, 2021 12:48:13 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Jul 27, 2021 12:48:13 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Jul 27, 2021 12:48:15 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Jul 27, 2021 12:48:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <112699 bytes, hash 08154425c68389c94818ac9d71af20dd30cee4423eb8720ce4eaf2f0b436549e> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-CBVEJcaDiclIGKydca8g3TDO5EI-uHIM5Ory8LQ2VJ4.pb Jul 27, 2021 12:48:17 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution. Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 2 seconds Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Jul 27, 2021 12:48:19 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74170687, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68f0f72c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3d96fa9e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3b545206, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@77bb48d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@181d8899, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12d5c30e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@b887730, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@26586b74, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@52f57666, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6e041285, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@267dc982, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@439b15f2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3aa41da1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74fab04a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3c83468e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@272ce069, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3d7fb838, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1c26273d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3a37a501] Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s3 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Jul 27, 2021 12:48:19 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2abe9173, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@235d29d6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1fdca564, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@43f9dd56, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1d12e953, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@57cb70be, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2d4608a6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@20d87335, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2a8a4e0c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@26c89563, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3bd6ba24, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58f437b0, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@20f6f88c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4277127c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c7e978c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@354e7004, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@22ebccb9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5875de6a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@608fe01f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2687725a] Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Jul 27, 2021 12:48:19 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.33.0-SNAPSHOT Jul 27, 2021 12:48:20 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-07-27_05_48_19-11324485973340498397?project=apache-beam-testing Jul 27, 2021 12:48:20 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-07-27_05_48_19-11324485973340498397 Jul 27, 2021 12:48:20 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-07-27_05_48_19-11324485973340498397 Jul 27, 2021 12:48:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-07-27T12:48:28.608Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0cogbk01-jenkins-07-5wt2. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:34.526Z: Worker configuration: e2-standard-2 in us-central1-a. Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.284Z: Expanding SplittableParDo operations into optimizable parts. Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.316Z: Expanding CollectionToSingleton operations into optimizable parts. Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.411Z: Expanding CoGroupByKey operations into optimizable parts. Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.484Z: Expanding SplittableProcessKeyed operations into optimizable parts. Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.523Z: Expanding GroupByKey operations into streaming Read/Write steps Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.597Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.719Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.750Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.789Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.826Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.860Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.891Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.934Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:35.969Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.002Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.035Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.067Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.137Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.162Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.184Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jul 27, 2021 12:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.224Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.253Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.273Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.310Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.349Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.379Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.418Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.459Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.498Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Jul 27, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:36.903Z: Starting 5 ****s in us-central1-a... Jul 27, 2021 12:48:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:48:49.471Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jul 27, 2021 12:49:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:49:19.295Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Jul 27, 2021 12:50:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:50:11.354Z: Workers have started successfully. Jul 27, 2021 12:50:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T12:50:11.394Z: Workers have started successfully. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:37.206Z: Staged package aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar' is inaccessible. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:37.297Z: Staged package aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar' is inaccessible. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:37.356Z: Staged package aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar' is inaccessible. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:37.397Z: Staged package aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar' is inaccessible. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:37.472Z: Staged package aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar' is inaccessible. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:37.513Z: Staged package aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar' is inaccessible. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:38.286Z: Staged package commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar' is inaccessible. Jul 27, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:38.328Z: Staged package commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar' is inaccessible. Jul 27, 2021 3:54:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:39.720Z: Staged package ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar' is inaccessible. Jul 27, 2021 3:54:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-07-27T15:54:39.973Z: Staged package jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar' is inaccessible. Jul 27, 2021 3:54:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-07-27T15:54:41.043Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Jul 27, 2021 3:57:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-07-27T15:57:41.349Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Jul 27, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T16:00:34.666Z: Cancel request is committed for workflow job: 2021-07-27_05_48_19-11324485973340498397. Jul 27, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T16:00:34.693Z: Cleaning up. Jul 27, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T16:00:34.765Z: Stopping **** pool... Jul 27, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T16:00:34.807Z: Stopping **** pool... Jul 27, 2021 4:02:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T16:02:53.871Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Jul 27, 2021 4:02:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-27T16:02:53.916Z: Worker pool stopped. Jul 27, 2021 4:03:00 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-07-27_05_48_19-11324485973340498397 finished with status CANCELLED. Load test results for test (ID): e46e2d88-aebe-4ca2-bc3b-40e7cff0f419 and timestamp: 2021-07-27T12:48:13.340000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 11388.972 dataflow_v2_java11_total_bytes_count 2.08686792E10 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210727124333 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:627cc128ed959dd39bc70f62f0b1f173dbd6b3cbf5c9ff7f346d342975e84600 Deleted: sha256:d76b72e82221434861e0ac2155d27dcfbdd10be027ec00c012d9ed7d5681f28d Deleted: sha256:cddaef7f9f2fd4da7a1bb30ecbd657f4256816aa091f5a12ca64802482f929ac Deleted: sha256:4c76c146932b006effef15625cbce4dc0d3b022918e58d30952fd89f332d7ab0 Deleted: sha256:b8dab4f447912db5e9a53eabebed44bfb487e0c0cfcc33f551bde8f17eda26ba Deleted: sha256:67f04ecbd09562fc00ef34cf24241c5e9bafcccc084fbe137139f36036ba1cc5 Deleted: sha256:c555d0a69725a996cf517800e86d7714fea9f04bdd1e15d2a60c44a05460e780 Deleted: sha256:093d620248d4c38213c846af9e69234ed68969827e18520a6506b780a039e52c Deleted: sha256:51327e2af48a6ea14ca8d27578cac417e602eb699d573801d2c670a5e24834ff Deleted: sha256:9c34e355f7971c8ccb40da2f7327dd0484427bc1f057649445a9a6556d893164 Deleted: sha256:c5ce354148839f7d1b5843382932d5b33375d00e95d3a8b367eda001816ea3fa Deleted: sha256:767c276872c0234cfd2007043142e7c89242b98d6150f51cc22ba2081bc8a8cc Deleted: sha256:5d75cb09657f2d94c1516802115a1d68eb16b3de292eafc59389e67d7409af2f Deleted: sha256:3cfae38c6e274e6cb3942f60200c260002e84960524119b781e5c2cda10d6c59 Deleted: sha256:496c3bb4c43863858f110dca590f1133d4036dec0930cd3ffeb7a187bd69c98a Deleted: sha256:5ea75f9a44f67f4aa165688c1c4b1d15e7407426732cfea324bb1769959711da Deleted: sha256:dd32fe9f5e38fa001b5d10dd0104ac60a3b947e19fc32d7ce01386ece7d3d3e9 Deleted: sha256:cb91b9c853e837bcb6a9843fa14b3745a5df2a2b2096ab776920fff97047b6fe Deleted: sha256:334a430e4222ccdfd0486b7d0134206b11b42d3b7f3cf4dab1f2e72a211a8524 Deleted: sha256:bec8536a8b17d12bd79cd2e6637b75d01c2314b24253cdabb86abffb8695f881 Deleted: sha256:22aa05a294301799b2d78518837e26e9d727c9b6734e334f97928107b3a0e332 Deleted: sha256:0c32b55821e95f43d6c20808df6e1f8e6ebe47e37c227648fe32e19a4f5fc10e Deleted: sha256:75a4776fb9cf944834d21ee2d295b0d03dc24cba5be578a9a833d1f2619926cb Deleted: sha256:83ad183d83af04dc67fe8ef86b66c81fd9cd4ba83af4da9e26637852a9017a2b Deleted: sha256:4e961ebbf0623bd026faa8e44c8af91b2e47492bd2511f2b9f4d1e1b0caa561c Deleted: sha256:ae17509efe025e6999f680eecf251f28e80ed81ede9a48de9d41330b0f2b782c Deleted: sha256:55d88347e708614cf2fa9bc5dee6e7661ef12c3562ccb1430db63528fd22694e Deleted: sha256:b0ef5498164613138f4f7c4f923ece5ddc04713427cd7678e6e422d9cfef5c3a Deleted: sha256:15bb05967c6b47d2721e6010d17728bfdd91805f6ec59da12e763c14f9c460cc Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:627cc128ed959dd39bc70f62f0b1f173dbd6b3cbf5c9ff7f346d342975e84600 Associated tags: - 20210727124333 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210727124333 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210727124333]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:627cc128ed959dd39bc70f62f0b1f173dbd6b3cbf5c9ff7f346d342975e84600]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 19m 42s 107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/e5theyhx73pak Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
