See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_Streaming/1538/display/redirect?page=changes>
Changes: [noreply] [YAML] Add optional output type parameter to mappings. (#29077) ------------------------------------------ [...truncated 14.65 KB...] > Task :sdks:java:extensions:protobuf:extractProto > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task > :runners:google-cloud-dataflow-java:****:windmill:createCheckerFrameworkManifest > Task :sdks:java:io:kinesis:createCheckerFrameworkManifest > Task :sdks:java:io:kinesis:processResources NO-SOURCE > Task :runners:google-cloud-dataflow-java:****:createCheckerFrameworkManifest > Task :sdks:java:io:synthetic:createCheckerFrameworkManifest > Task :sdks:java:core:processResources > Task :sdks:java:io:synthetic:processResources NO-SOURCE > Task :runners:google-cloud-dataflow-java:****:processResources > Task :runners:google-cloud-dataflow-java:processResources > Task :sdks:java:testing:load-tests:createCheckerFrameworkManifest > Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest > Task :sdks:java:testing:load-tests:processResources NO-SOURCE > Task :sdks:java:testing:test-utils:processResources NO-SOURCE > Task :sdks:java:transform-service:launcher:compileJava FROM-CACHE > Task :sdks:java:transform-service:launcher:processResources > Task :sdks:java:transform-service:launcher:classes > Task :sdks:java:transform-service:launcher:jar > Task :sdks:java:transform-service:launcher:shadowJar FROM-CACHE > Task :runners:google-cloud-dataflow-java:****:windmill:extractIncludeProto > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :runners:google-cloud-dataflow-java:****:windmill:extractProto > Task :runners:google-cloud-dataflow-java:****:windmill:generateProto > FROM-CACHE > Task :model:pipeline:generateProto FROM-CACHE > Task :runners:google-cloud-dataflow-java:****:windmill:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:****:windmill:processResources > Task :runners:google-cloud-dataflow-java:****:windmill:classes > Task :runners:google-cloud-dataflow-java:****:windmill:shadowJar FROM-CACHE > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :model:pipeline:jar > Task :model:pipeline:shadowJar FROM-CACHE > Task :model:fn-execution:extractIncludeProto > Task :model:job-management:extractIncludeProto > Task :model:job-management:generateProto FROM-CACHE > Task :model:fn-execution:generateProto FROM-CACHE > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:fn-execution:shadowJar FROM-CACHE > Task :model:job-management:shadowJar FROM-CACHE > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE > Task :sdks:java:extensions:protobuf:extractIncludeProto > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :sdks:java:io:synthetic:compileJava FROM-CACHE > Task :sdks:java:io:synthetic:classes UP-TO-DATE > Task :sdks:java:extensions:arrow:compileJava FROM-CACHE > Task :sdks:java:extensions:arrow:classes UP-TO-DATE > Task :sdks:java:extensions:arrow:jar > Task :sdks:java:extensions:avro:compileJava FROM-CACHE > Task :sdks:java:extensions:avro:classes UP-TO-DATE > Task :sdks:java:io:synthetic:jar > Task :sdks:java:testing:test-utils:compileJava FROM-CACHE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:io:kinesis:compileJava FROM-CACHE > Task :sdks:java:io:kinesis:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:jar > Task :sdks:java:extensions:avro:jar > Task :sdks:java:io:kinesis:jar > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:fn-execution:jar > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :runners:core-construction-java:jar > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:testing:load-tests:compileJava FROM-CACHE > Task :sdks:java:testing:load-tests:classes UP-TO-DATE > Task :sdks:java:testing:load-tests:jar > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:classes > Task :runners:google-cloud-dataflow-java:jar > Task :runners:google-cloud-dataflow-java:****:compileJava FROM-CACHE > Task :runners:google-cloud-dataflow-java:****:classes > Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE > Task :sdks:java:testing:load-tests:run Oct 26, 2023 1:23:05 AM org.apache.beam.runners.dataflow.DataflowRunner validateSdkContainerImageOptions WARNING: Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage. Oct 26, 2023 1:23:06 AM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Oct 26, 2023 1:23:07 AM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 231 files. Enable logging at DEBUG level to see which files will be staged. Oct 26, 2023 1:23:08 AM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Oct 26, 2023 1:23:08 AM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Oct 26, 2023 1:23:10 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 232 files from PipelineOptions.filesToStage to staging location to prepare for execution. Oct 26, 2023 1:23:10 AM org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes forFileToStage INFO: Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.52.0-SNAPSHOT-rzulcSNQHVCBwxVb2xE8wn9IAL9biOzNl7ezcZH95N4.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.14.1/2a6ad504d591a7903ffdec76b5b7252819a2d162/jackson-annotations-2.14.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/jackson-annotations-2.14.1-0lW0uGP_jscUqPlvpVw0Yh1D27grgtP1dHZJakwJ4ec.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-joda/2.14.1/94f235cfee219d21a8359241e4a8241b339b4d7b/jackson-datatype-joda-2.14.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/jackson-datatype-joda-2.14.1-QdVPnDxRMz2NdjSJKRjjyC8Ctn_Rm7YoBV05KzpezbY.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.14.1/7a07bc535ccf0b7f6929c4d0f2ab9b294ef7c4a3/jackson-core-2.14.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/jackson-core-2.14.1-ARQYfilrNMkxwb-eWoQVK2K_q30YL1Yj85gtwto15SY.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_Streaming/ws/src/sdks/java/transform-service/launcher/build/libs/beam-sdks-java-transform-service-launcher-2.52.0-SNAPSHOT-unshaded.jar> to gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-transform-service-launcher-2.52.0-SNAPSHOT-unshaded-a1fyRnxcx4EaxG8QYzwlK4HErwlao0SBRNBkQVUeoCQ.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_Streaming/ws/src/sdks/java/transform-service/launcher/build/libs/beam-sdks-java-transform-service-launcher-2.52.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-transform-service-launcher-2.52.0-SNAPSHOT-6oJuygwc2n-eOBgnrQIhcUXcvEGdJWF1Y02eUS5FFa4.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.14.1/268524b9056cae1211b9f1f52560ef19347f4d17/jackson-databind-2.14.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/jackson-databind-2.14.1-QjoMgG3ks_petKKGmDBeOjd3xzHhvPobLzo3YMe253M.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.damnhandy/handy-uri-templates/2.1.8/170102d8e1d6fcc5e8f9bef45de923285dd3a80f/handy-uri-templates-2.1.8.jar to gs://temp-storage-for-perf-tests/loadtests/staging/handy-uri-templates-2.1.8-a4OEby_2HQqqZpl7ZLiD7HtlzxO1Ck1_WCUJltQpvi4.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-yaml/2.14.1/cf6d18651659a2e64301452c841e6daa62e77bf6/jackson-dataformat-yaml-2.14.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/jackson-dataformat-yaml-2.14.1-nhV-JiXthVq3OveRXiVvaCOZOjCYL0kjycqCu3UqAwM.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-csv/2.14.1/ff08d648dab89f8a28ae9db3ae8ce7bfd7b25afd/jackson-dataformat-csv-2.14.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/jackson-dataformat-csv-2.14.1-LyrsP7EWvuGxcq5LzCEDjKBL3QQ9g01j1UcTDJsPkUs.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/grpc-gcp/1.4.1/14b35eed70f1911fdc046c4a21ee403386828c6a/grpc-gcp-1.4.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/grpc-gcp-1.4.1-mLrHxEKqkfdvaRizrmCHodqmppHbk7NOLRg9E1orGV8.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/commons-validator/commons-validator/1.7/76069c915de3787f3ddd8726a56f47a95bfcbb0e/commons-validator-1.7.jar to gs://temp-storage-for-perf-tests/loadtests/staging/commons-validator-1.7-TXT0zk-2iyYX7a0Ibfbe_fkzhGfSN30sYuaQOOHE8C8.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/commons-digester/commons-digester/2.1/73a8001e7a54a255eef0f03521ec1805dc738ca0/commons-digester-2.1.jar to gs://temp-storage-for-perf-tests/loadtests/staging/commons-digester-2.1-4LK5gKhPxlM8XOKR8ZF7MsUH9ivK1kGY__RDaMIZaj0.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.threeten/threeten-extra/1.7.2/b2e5f470c6c97fee4c05c03eb9c546695a7784c2/threeten-extra-1.7.2.jar to gs://temp-storage-for-perf-tests/loadtests/staging/threeten-extra-1.7.2-oQRf6YFx3YTHloK0Etv91-TdckFeze4UE19ybhFgToA.jar Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 219 files cached, 13 files newly uploaded in 0 seconds Oct 26, 2023 1:23:11 AM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Oct 26, 2023 1:23:13 AM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles: [SyntheticUnboundedSource{startOffset=0, endOffset=1000000}, SyntheticUnboundedSource{startOffset=1000000, endOffset=2000000}, SyntheticUnboundedSource{startOffset=2000000, endOffset=3000000}, SyntheticUnboundedSource{startOffset=3000000, endOffset=4000000}, SyntheticUnboundedSource{startOffset=4000000, endOffset=5000000}, SyntheticUnboundedSource{startOffset=5000000, endOffset=6000000}, SyntheticUnboundedSource{startOffset=6000000, endOffset=7000000}, SyntheticUnboundedSource{startOffset=7000000, endOffset=8000000}, SyntheticUnboundedSource{startOffset=8000000, endOffset=9000000}, SyntheticUnboundedSource{startOffset=9000000, endOffset=10000000}, SyntheticUnboundedSource{startOffset=10000000, endOffset=11000000}, SyntheticUnboundedSource{startOffset=11000000, endOffset=12000000}, SyntheticUnboundedSource{startOffset=12000000, endOffset=13000000}, SyntheticUnboundedSource{startOffset=13000000, endOffset=14000000}, SyntheticUnboundedSource{startOffset=14000000, endOffset=15000000}, SyntheticUnboundedSource{startOffset=15000000, endOffset=16000000}, SyntheticUnboundedSource{startOffset=16000000, endOffset=17000000}, SyntheticUnboundedSource{startOffset=17000000, endOffset=18000000}, SyntheticUnboundedSource{startOffset=18000000, endOffset=19000000}, SyntheticUnboundedSource{startOffset=19000000, endOffset=20000000}] Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s3 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Oct 26, 2023 1:23:13 AM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles: [SyntheticUnboundedSource{startOffset=0, endOffset=100000}, SyntheticUnboundedSource{startOffset=100000, endOffset=200000}, SyntheticUnboundedSource{startOffset=200000, endOffset=300000}, SyntheticUnboundedSource{startOffset=300000, endOffset=400000}, SyntheticUnboundedSource{startOffset=400000, endOffset=500000}, SyntheticUnboundedSource{startOffset=500000, endOffset=600000}, SyntheticUnboundedSource{startOffset=600000, endOffset=700000}, SyntheticUnboundedSource{startOffset=700000, endOffset=800000}, SyntheticUnboundedSource{startOffset=800000, endOffset=900000}, SyntheticUnboundedSource{startOffset=900000, endOffset=1000000}, SyntheticUnboundedSource{startOffset=1000000, endOffset=1100000}, SyntheticUnboundedSource{startOffset=1100000, endOffset=1200000}, SyntheticUnboundedSource{startOffset=1200000, endOffset=1300000}, SyntheticUnboundedSource{startOffset=1300000, endOffset=1400000}, SyntheticUnboundedSource{startOffset=1400000, endOffset=1500000}, SyntheticUnboundedSource{startOffset=1500000, endOffset=1600000}, SyntheticUnboundedSource{startOffset=1600000, endOffset=1700000}, SyntheticUnboundedSource{startOffset=1700000, endOffset=1800000}, SyntheticUnboundedSource{startOffset=1800000, endOffset=1900000}, SyntheticUnboundedSource{startOffset=1900000, endOffset=2000000}] Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Oct 26, 2023 1:23:13 AM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.52.0-SNAPSHOT Oct 26, 2023 1:23:14 AM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-10-25_18_23_13-16966081233674870748?project=apache-beam-testing Oct 26, 2023 1:23:14 AM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2023-10-25_18_23_13-16966081233674870748 Oct 26, 2023 1:23:14 AM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2023-10-25_18_23_13-16966081233674870748 Oct 26, 2023 1:23:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2023-10-26T01:23:21.631Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java0dataflow0streaming0cogbk01-jenkins-1026012-as2b. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Oct 26, 2023 1:23:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2023-10-26T01:23:25.366Z: Staged package google-api-services-iamcredentials-v1-rev20211203-2.0.0-TYvhaxLa_N4Oj21MCWmXYMCvG18lkgXkJcXPynMhjYU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-services-iamcredentials-v1-rev20211203-2.0.0-TYvhaxLa_N4Oj21MCWmXYMCvG18lkgXkJcXPynMhjYU.jar' is inaccessible. Oct 26, 2023 1:23:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2023-10-26T01:23:29.014Z: Workflow failed. Causes: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Oct 26, 2023 1:23:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-10-26T01:23:29.042Z: Cleaning up. Oct 26, 2023 1:23:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-10-26T01:23:29.106Z: Worker pool stopped. Oct 26, 2023 1:23:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-10-26T01:23:30.720Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 26, 2023 1:23:48 AM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2023-10-25_18_23_13-16966081233674870748 failed with status FAILED. Oct 26, 2023 1:23:48 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric totalBytes.count, from namespace co_gbk Load test results for test (ID): 3491b2da-3701-4840-8f9a-c7720fcab197 and timestamp: 2023-10-26T01:23:07.959000000Z: Metric: Value: dataflow_runtime_sec 0.0 dataflow_total_bytes_count -1.0 Exception in thread "main" java.lang.RuntimeException: Invalid job state: FAILED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157) > Task :sdks:java:testing:load-tests:run FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 1m 16s 103 actionable tasks: 65 executed, 38 from cache Publishing build scan... https://ge.apache.org/s/wcc2db3bmbfgc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
