See <https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Streaming/975/display/redirect?page=changes>
Changes: [relax] don't close streams in finalize [noreply] Loosen typing extensions bound [Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.135 [noreply] [BEAM-12092] Bump jedis to version 4.0.1 (#16287) [noreply] [BEAM-13534] Add automated port polling to expansion service runner if [noreply] Merge pull request #16344 from [BEAM-13536][Playground][Bugfix] CI step [noreply] Merge pull request #16359 from [BEAM-13545][Playground] Add [noreply] Merge pull request #16384 from [BEAM-13308] [Playground] Getting [noreply] Merge pull request #16306 from [BEAM-13447] [Playground] Add filling of [noreply] Merge pull request #16361 from [BEAM-13543][Playground] Add logic of [noreply] [BEAM-12562] Dataframe pipe implementation (#16256) [noreply] Merge pull request #16338 from [BEAM-13528][Playground] Add liveness [noreply] [BEAM-13626] Remap expanded outputs after merging. (#16471) [noreply] Merge pull request #16147 from [BEAM-13359] [Playground] Tag existing [noreply] [BEAM-3221] Improve documentation in model pipeline protos (#16474) [noreply] [BEAM-13614] Add OnWindowExpiration support to the Java SDK harness and [noreply] Merge pull request #16156 from [BEAM-13391] Fix temporary file format in ------------------------------------------ [...truncated 137.22 KB...] > Task :model:fn-execution:extractIncludeProto UP-TO-DATE > Task :model:job-management:extractIncludeProto UP-TO-DATE > Task :model:pipeline:shadowJar UP-TO-DATE > Task :model:job-management:generateProto UP-TO-DATE > Task :model:fn-execution:generateProto UP-TO-DATE > Task :model:job-management:compileJava UP-TO-DATE > Task :model:fn-execution:compileJava UP-TO-DATE > Task :model:job-management:classes UP-TO-DATE > Task :model:fn-execution:classes UP-TO-DATE > Task :model:job-management:shadowJar UP-TO-DATE > Task :model:fn-execution:shadowJar UP-TO-DATE > Task :sdks:java:core:compileJava UP-TO-DATE > Task :sdks:java:core:classes UP-TO-DATE > Task :sdks:java:core:shadowJar UP-TO-DATE > Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :sdks:java:fn-execution:compileJava UP-TO-DATE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:io:synthetic:compileJava UP-TO-DATE > Task :sdks:java:io:synthetic:classes UP-TO-DATE > Task :sdks:java:fn-execution:jar UP-TO-DATE > Task :sdks:java:extensions:arrow:compileJava UP-TO-DATE > Task :sdks:java:extensions:arrow:classes UP-TO-DATE > Task :sdks:java:io:synthetic:jar UP-TO-DATE > Task :sdks:java:extensions:arrow:jar UP-TO-DATE > Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar UP-TO-DATE > Task :sdks:java:io:kinesis:compileJava UP-TO-DATE > Task :sdks:java:io:kinesis:classes UP-TO-DATE > Task :sdks:java:io:kinesis:jar UP-TO-DATE > Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :runners:core-construction-java:compileJava UP-TO-DATE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:jar UP-TO-DATE > Task :runners:core-construction-java:jar UP-TO-DATE > Task :runners:core-java:compileJava UP-TO-DATE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE > Task :sdks:java:harness:compileJava UP-TO-DATE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar UP-TO-DATE > Task :runners:java-fn-execution:compileJava UP-TO-DATE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar UP-TO-DATE > Task :sdks:java:expansion-service:compileJava UP-TO-DATE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar UP-TO-DATE > Task :sdks:java:io:kafka:compileJava UP-TO-DATE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE > Task :sdks:java:testing:load-tests:compileJava UP-TO-DATE > Task :sdks:java:testing:load-tests:classes UP-TO-DATE > Task :sdks:java:testing:load-tests:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE > Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava > UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar UP-TO-DATE > Task :sdks:java:testing:load-tests:run Jan 11, 2022 12:42:41 PM org.apache.beam.runners.dataflow.DataflowRunner validateSdkContainerImageOptions WARNING: Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage. Jan 11, 2022 12:42:41 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Jan 11, 2022 12:42:42 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 203 files. Enable logging at DEBUG level to see which files will be staged. Jan 11, 2022 12:42:43 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Collect end time metric Jan 11, 2022 12:42:43 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Jan 11, 2022 12:42:45 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 204 files from PipelineOptions.filesToStage to staging location to prepare for execution. Jan 11, 2022 12:42:45 PM org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes forFileToStage INFO: Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.37.0-SNAPSHOT-HoKmZanH_5O4w8vR-XjUi706ly4Ab8VQuPSZeLzefik.jar Jan 11, 2022 12:42:46 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 204 files cached, 0 files newly uploaded in 0 seconds Jan 11, 2022 12:42:46 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Jan 11, 2022 12:42:46 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <183944 bytes, hash d97f79f429cc4969a64a3c927f84c21a4ac28d11c6bea0b8d5292a2c7795ca9f> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-2X959CnMSWmmSjySf4TCGkrCjRHGvqC41SkqLHeVyp8.pb Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Jan 11, 2022 12:42:48 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 64 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@575e572f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58015e56, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4d3c6593, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7426a448, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@516462cc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3456558, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2dfb885e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6cbe7d4d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1e3e1014, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3679d92e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@47b11ec7, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58fa5769, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36aa52d2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ee25d80, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@16a35bd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ba17be6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6f798482, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@332bcab0, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@633cc6b5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342ff7f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@403c3a01, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2daf06fc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@28237492, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5ceecfee, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7da31a40, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@28ee7bee, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1b5a1d85, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@31e130bf, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@54755dd9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@f1f7db2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4462efe1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7c3e4b1a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2db4ad1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@765d55d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2513a118, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2bfb583b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@73ae0257, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6fc1020a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5762658b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2629d5dc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2596d7f4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42a0501e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6aa3bfc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6e4599c0, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7dffda8b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3d1f558a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6abdec0e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@28f4f300, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2b5c4f17, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6ca8fcf3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@69f0b0f4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@66933239, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2f7efd0b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@41ad373, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6801b414, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@177c41d7, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4f327096, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1d61a348, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@78a515e4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@d2291de, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@51c8f62c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@41a374be, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@11f9535b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@8cc8cdb] Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metric as step s3 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect metrics as step s4 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s5 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 0/Map as step s6 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 0/GroupByKey as step s7 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 0/Combine.GroupedValues as step s8 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric as step s9 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 1/Map as step s10 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 1/GroupByKey as step s11 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 1/Combine.GroupedValues as step s12 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric2 as step s13 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 2/Map as step s14 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 2/GroupByKey as step s15 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 2/Combine.GroupedValues as step s16 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric3 as step s17 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 3/Map as step s18 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 3/GroupByKey as step s19 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 3/Combine.GroupedValues as step s20 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric4 as step s21 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 4/Map as step s22 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 4/GroupByKey as step s23 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 4/Combine.GroupedValues as step s24 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric5 as step s25 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 5/Map as step s26 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 5/GroupByKey as step s27 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 5/Combine.GroupedValues as step s28 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric6 as step s29 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 6/Map as step s30 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 6/GroupByKey as step s31 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 6/Combine.GroupedValues as step s32 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric7 as step s33 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 7/Map as step s34 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 7/GroupByKey as step s35 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 7/Combine.GroupedValues as step s36 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric8 as step s37 Jan 11, 2022 12:42:48 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.37.0-SNAPSHOT Jan 11, 2022 12:42:49 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-11_04_42_48-5597504634460573137?project=apache-beam-testing Jan 11, 2022 12:42:49 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-01-11_04_42_48-5597504634460573137 Jan 11, 2022 12:42:49 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-01-11_04_42_48-5597504634460573137 Jan 11, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-01-11T12:42:53.319Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java0dataflow0streaming0combine05-jenkins-01111-xsfz. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jan 11, 2022 12:42:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:54.890Z: Staged package bigtable-client-core-1.25.1-R9XChdK2IYUEN8w_njmeNrXxjlMB6j2ANhwdboSa_Yg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/bigtable-client-core-1.25.1-R9XChdK2IYUEN8w_njmeNrXxjlMB6j2ANhwdboSa_Yg.jar' is inaccessible. Jan 11, 2022 12:42:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:54.943Z: Staged package bigtable-metrics-api-1.25.1-FN2y3Z1OHE7Ebbi8Q0r5Dm3_X_Lt53KTtbaJBDMJwIY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/bigtable-metrics-api-1.25.1-FN2y3Z1OHE7Ebbi8Q0r5Dm3_X_Lt53KTtbaJBDMJwIY.jar' is inaccessible. Jan 11, 2022 12:42:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:55.075Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible. Jan 11, 2022 12:42:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:55.124Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible. Jan 11, 2022 12:42:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:55.320Z: Staged package datastore-v1-proto-client-2.1.3-ezmChW35F4Pi0HVJFcl4GqeI4GPNZbqxRxrtg10mY7M.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/datastore-v1-proto-client-2.1.3-ezmChW35F4Pi0HVJFcl4GqeI4GPNZbqxRxrtg10mY7M.jar' is inaccessible. Jan 11, 2022 12:42:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:56.450Z: Staged package gson-2.8.9-05mSkYVd5JXJTHQ3YbirUXbP6r4oGlqw2OjUUyb9cD4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/gson-2.8.9-05mSkYVd5JXJTHQ3YbirUXbP6r4oGlqw2OjUUyb9cD4.jar' is inaccessible. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:56.901Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:56.973Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:57.687Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:57.733Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:57.842Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2022-01-11T12:42:57.874Z: Workflow failed. Causes: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-11T12:42:57.927Z: Cleaning up. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-11T12:42:57.992Z: Worker pool stopped. Jan 11, 2022 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-01-11T12:42:59.162Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jan 11, 2022 12:43:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2022-01-11_04_42_48-5597504634460573137 failed with status FAILED. Jan 11, 2022 12:43:03 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric totalBytes.count, from namespace combine Load test results for test (ID): e8f9752f-df03-4bfc-9f09-ab43edb1d36d and timestamp: 2022-01-11T12:42:42.739000000Z: Metric: Value: dataflow_runtime_sec 0.0 dataflow_total_bytes_count -1.0 Exception in thread "main" java.lang.RuntimeException: Invalid job state: FAILED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139) at org.apache.beam.sdk.loadtests.CombineLoadTest.run(CombineLoadTest.java:66) at org.apache.beam.sdk.loadtests.CombineLoadTest.main(CombineLoadTest.java:172) > Task :sdks:java:testing:load-tests:run FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 27s 99 actionable tasks: 1 executed, 98 up-to-date Publishing build scan... https://gradle.com/s/nlfwdj5q22taa Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
