See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/145/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13155][Playground]
[25622840+adude3141] [BEAM-13157] add regression test for hadoop configuration
on
[noreply] Merge pull request #15873 from [BEAM-13181] Remove Sharding from
[noreply] Merge pull request #15813 from [BEAM-13071] [Playground] Update run
code
[Kyle Weaver] [BEAM-5172] Temporary ignore testSplit and testSizes tests
waiting for a
------------------------------------------
[...truncated 214.31 KB...]
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Nov 09, 2021 3:30:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:30:23.544Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:31:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:31:28.618Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:32:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:32:16.301Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:33:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:33:19.382Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:34:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:34:22.252Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:39:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:39:22.554Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:41:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:41:25.964Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:42:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:42:24.936Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:43:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:43:38.284Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:44:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:44:32.506Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:48:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:47:57.651Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:49:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:49:37.228Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:51:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:51:36.543Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:52:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:52:39.629Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:56:44 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:56:43.211Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:57:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:57:42.603Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:58:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:58:46.944Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 3:59:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T15:59:46.504Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 09, 2021 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T16:00:34.569Z: Cancel request is committed for workflow job:
2021-11-09_04_14_45-2342463789495010457.
Nov 09, 2021 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T16:00:34.600Z: Cleaning up.
Nov 09, 2021 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T16:00:34.702Z: Stopping **** pool...
Nov 09, 2021 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T16:00:34.761Z: Stopping **** pool...
Nov 09, 2021 4:03:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T16:03:39.309Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Nov 09, 2021 4:03:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-09T16:03:39.356Z: Worker pool stopped.
Nov 09, 2021 4:03:45 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-11-09_04_14_45-2342463789495010457 finished with status
CANCELLED.
Load test results for test (ID): c6a021ff-2b44-4813-826b-c7ff896a6620 and
timestamp: 2021-11-09T12:14:38.645000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 12560.251
dataflow_v2_java11_total_bytes_count 1.274818976E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211109121201
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d17f96c6d3cd262997420ebacf2c6dfa5bd905dbc709ceb4cfe85151aa15c59d
Deleted: sha256:4ee381c7586c3668619fc74db0595bae1fc38aceccf8150b8e520b69828fada2
Deleted: sha256:fa352263f6c548977baf1488aa037bc6ec782b0acaafdef765277b452018531d
Deleted: sha256:ba3adf9d6c4101ff53230c3b4bebd98fb87d1843ca1328dd2a86b56123a25cc2
Deleted: sha256:604a9c555b8bf21b4bd89bf9d91260ad4c6f111e54cfd6ddcc6773384f2c9f70
Deleted: sha256:2da06d6df9c47cfb397454f90c3002b0ca065b441ffb33dee74d5167df9a7f92
Deleted: sha256:ef0ac6a8517e40542ecae9c88402f981dece3e8b8243d6848cf381ebdb079e23
Deleted: sha256:d014dd39efacf9cb48cc2426dd4f1f4a4af79cc7fbfa883b9419042e5b5989c1
Deleted: sha256:612c6249cde27939318a64684339847d6a30a91f685aabafb7fdaf44af3d6cbc
Deleted: sha256:9c27f76042efc4595404604d3ddcf6f99ee61b5450eca16e054917981c39f84f
Deleted: sha256:42193f5b7aa8e2aedbf0d3dd4d123b9a55ebe87e442377584ce6a0659659cc94
Deleted: sha256:df647be68a7213fd714f1cc3834bfaa9db00cfeed3cba71d4360e239bc3cf138
Deleted: sha256:f2e4f0832ffbdd10db89b383143f9af104d8782a688ea8f9ec4167cdab444acd
Deleted: sha256:3bd13f894187aa8906791c09c0eeb17a683e70ab92d13aa34e6d4388e3832b36
Deleted: sha256:8dfe5cd05b55b4545e1daa8586d5aac3c2d206717960e6a3128caee22e9df7d8
Deleted: sha256:ab8af8b996bc33a0031a592a65d45cdfa181b021ca5834ee066b9d1758b30520
Deleted: sha256:4c249ef282fe44b9f125e2b5f9c0a324f2e3abaf1e54988a368b763dcd138a1b
Deleted: sha256:6996ac14a980575e594639ea6a3ff80a2a8fb233bd2ef383da96cb4ff16477cc
Deleted: sha256:f468bad37114822fae5d7c0d5f95e4920592a27b0195243c544f21530ca34e0f
Deleted: sha256:a7c8f2e26e485785a30d8ae683ebe81df43d216e8ab088cdcc6c83b3ecf6461a
Deleted: sha256:31d1edbb53daedc1e95874409abf7c990796623608c741763913fdab0fefcd4e
Deleted: sha256:69c7f445d40f101b8fd785bbc6997901013b7d9ffba1bf9e07f025c57716226a
Deleted: sha256:51330430480d41df0432c7015ad618472f4a769103974c1af9cf34d3828a74f2
Deleted: sha256:107ac31d73ebdf9b34cb1991e2c976677cfa38cdf2f6d40e10d805beffcb9f5a
Deleted: sha256:7ef1cd31342c80f24c245f1ed990d708fa9e621b678ac439525ebcc199e1b8d1
Deleted: sha256:e56d88c120fc2413ca0a84375ffc65cf510c152d0fbbb03f9bbc2c42b080b75a
Deleted: sha256:51473a74c50b871ccab8b025ea1fa89c33eca46179988608427540e7b3693992
Deleted: sha256:9bbce7febb5ac4d72722460e3492b374ed95afe0351b8cf3f57add51fc8e622f
Deleted: sha256:324d29ea836880b7991ed6bfb2f2f12c279808a3b86312c9c0b2b7df3a77b715
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211109121201]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d17f96c6d3cd262997420ebacf2c6dfa5bd905dbc709ceb4cfe85151aa15c59d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211109121201]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d17f96c6d3cd262997420ebacf2c6dfa5bd905dbc709ceb4cfe85151aa15c59d])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d17f96c6d3cd262997420ebacf2c6dfa5bd905dbc709ceb4cfe85151aa15c59d
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d17f96c6d3cd262997420ebacf2c6dfa5bd905dbc709ceb4cfe85151aa15c59d
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d17f96c6d3cd262997420ebacf2c6dfa5bd905dbc709ceb4cfe85151aa15c59d].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 52m 5s
101 actionable tasks: 71 executed, 28 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wftreuqpao3nm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
