See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/100/display/redirect?page=changes>
Changes: [Robert Bradshaw] [BEAM-12934] Use environment capabilities to determine length prefixing. [Brian Hulette] Add missing comma [ryanthompson591] Update tensorflow to version 2.6.0 [zhoufek] [BEAM-9487] Fix incorrected Repeatedly.may_finish implementation [noreply] Cleanup use of futures. (#15043) [noreply] Go Lint fix for wordcount and metrics (#15580) [Brian Hulette] Fix whitespace lint [noreply] [BEAM-3304] Snippets for trigger in BPG (#15409) [noreply] [BEAM-12832] Add Go SDK xlang info to programming guide. (#15447) [noreply] [BEAM-11097] Add SideInputCache to StateReader (#15563) [Robert Bradshaw] Revert "Avoid apiary submission of job graph when it is not needed. [noreply] [BEAM-12769] Java-emulating external transform. (#15546) [noreply] [BEAM-12913] Pass query priority from ReadAllFromBigQuery (#15584) [noreply] [BEAM-11982] Java Spanner - Implement IO Request Count metrics (#15493) ------------------------------------------ [...truncated 104.07 KB...] Sep 25, 2021 1:58:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-25T13:58:29.303Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Sep 25, 2021 2:01:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-25T14:01:29.756Z: Staged package snakeyaml-1.27-fnzOZ0DtcFv9-qx7RCwTddKYbS8pNZNqW9QMFOGP1zY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/snakeyaml-1.27-fnzOZ0DtcFv9-qx7RCwTddKYbS8pNZNqW9QMFOGP1zY.jar' is inaccessible. Sep 25, 2021 2:01:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-25T14:01:29.934Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Sep 25, 2021 2:04:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-25T14:04:29.462Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Sep 25, 2021 2:13:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:13:33.940Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:14:37.420Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:17:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:17:36.776Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:19:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:19:42.048Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:24:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:24:42.624Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:25:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:25:46.034Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:26:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:26:45.357Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:27:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:27:50.091Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:35:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:35:50.905Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:41:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-25T14:41:40.054Z: generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 generic::aborted: SDK harness sdk-0-0 disconnected. generic::aborted: SDK harness sdk-0-0 disconnected. passed through: ==> dist_proc/dax/workflow/****/fnapi_service_impl.cc:644 Sep 25, 2021 2:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:42:51.791Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:50:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:50:56.322Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 2:58:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T14:58:55.483Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 3:12:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T15:12:00.702Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 3:20:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T15:20:01.359Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 3:28:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T15:28:06.132Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 3:36:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T15:36:05.318Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 3:44:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T15:44:11.748Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 3:52:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T15:52:12.956Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 4:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T16:00:12.645Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 25, 2021 4:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T16:00:24.356Z: Cancel request is committed for workflow job: 2021-09-25_05_16_10-8558289407348680288. Sep 25, 2021 4:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T16:00:24.392Z: Cleaning up. Sep 25, 2021 4:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T16:00:24.494Z: Stopping **** pool... Sep 25, 2021 4:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T16:00:24.562Z: Stopping **** pool... Sep 25, 2021 4:02:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T16:02:46.285Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Sep 25, 2021 4:02:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-25T16:02:46.326Z: Worker pool stopped. Sep 25, 2021 4:02:51 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-09-25_05_16_10-8558289407348680288 finished with status CANCELLED. Load test results for test (ID): 8a09f8bd-6077-4958-acf0-9119fb468eec and timestamp: 2021-09-25T12:16:03.217000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 8046.287 dataflow_v2_java11_total_bytes_count 5.14594576E9 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210925121404 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4f528444c8d83f3c025b91412f35af363629beca72530448868d26cb5f4dd44 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210925121404] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4f528444c8d83f3c025b91412f35af363629beca72530448868d26cb5f4dd44] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210925121404] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4f528444c8d83f3c025b91412f35af363629beca72530448868d26cb5f4dd44])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4f528444c8d83f3c025b91412f35af363629beca72530448868d26cb5f4dd44 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4f528444c8d83f3c025b91412f35af363629beca72530448868d26cb5f4dd44 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d4f528444c8d83f3c025b91412f35af363629beca72530448868d26cb5f4dd44]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 49m 5s 101 actionable tasks: 73 executed, 26 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/rghpmkdsllpfg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
