See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/190/display/redirect?page=changes>
Changes:
[alexander.zhuravlev] [BEAM-13489] Updated manifest.json and index.html to
follow best
[stranniknm] [BEAM-13531] playground - fetch example info only once
[mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v2)
[mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v1)
[noreply] [BEAM-13399] Disable expansion service integration test on Samza and
[noreply] [BEAM-13430] Upgrade beam to gradle 7.3.2 (#16319)
[noreply] Merge pull request #16320 from [BEAM-13512] [Playground] send request
to
[noreply] Merge pull request #16209 from [Playground][BEAM-13304]Deploy Python
[noreply] Merge pull request #16105 from [BEAM-13328] [Playground] Add
[noreply] Merge pull request #16103 from [BEAM-13252] [Playground] Feedback
Thumbs
[noreply] Better type inference for GroupBy. (#16318)
[noreply] [BEAM-13534] Update TestAutomatedExpansionService liveness check to
not
[noreply] [BEAM-13490] Bump log4j version to 2.17.0 (#16276)
------------------------------------------
[...truncated 77.39 KB...]
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Dec 24, 2021 3:12:02 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:12:01.022Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:16:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:16:03.077Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:18:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:18:06.064Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:19:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:19:12.397Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:20:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:20:20.418Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:21:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:21:23.313Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:25:02 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-12-24T15:25:00.042Z: generic::aborted: SDK harness sdk-0-0
disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Dec 24, 2021 3:26:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:26:18.171Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:30:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:30:23.161Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:31:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:31:22.554Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:34:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:34:23.417Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:37:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:37:27.901Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:38:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:38:25.792Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:39:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:39:30.229Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:43:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:43:30.778Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:44:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:44:33.890Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:52:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:52:38.844Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:53:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:53:37.931Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:56:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:56:41.234Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 3:58:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T15:58:42.262Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 24, 2021 4:00:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T16:00:38.767Z: Cancel request is committed for workflow job:
2021-12-24_04_14_23-15660209256214297893.
Dec 24, 2021 4:00:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T16:00:38.798Z: Cleaning up.
Dec 24, 2021 4:00:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T16:00:38.876Z: Stopping **** pool...
Dec 24, 2021 4:00:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T16:00:38.919Z: Stopping **** pool...
Dec 24, 2021 4:03:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T16:03:27.966Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Dec 24, 2021 4:03:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-24T16:03:27.993Z: Worker pool stopped.
Dec 24, 2021 4:03:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-12-24_04_14_23-15660209256214297893 finished with status
CANCELLED.
Load test results for test (ID): a751870f-c4ab-4f09-9853-2bb3b9d5003a and
timestamp: 2021-12-24T12:13:59.340000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 12604.995
dataflow_v2_java11_total_bytes_count 5.86754598E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211224120930
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d55d93f1cf17fee52be5397228d1bf32ac963a69234382c174096d3862c6389
Deleted: sha256:23def00d570903df1fd1e177a2028bee8665d27a9f7af97dcfadd2697a587795
Deleted: sha256:0c27de15f3343b0deeeff30b4a468fd58ea29c5cb08a01837b9fcc40ffe38559
Deleted: sha256:0add20723b214a34b2da4bcb0855a4b4f8552cfb7ea34ed55555be7bde3a3bc9
Deleted: sha256:455129d0ef0b30182ac3ede8851db041f40da0880864065e4906e0151d421c8b
Deleted: sha256:ebe03c8ccd6b18f4b67ab93cbc3b8a007098d1d8d953d0954eeab466fcf641bd
Deleted: sha256:b66cd0c9bab93541f8812525091609a3f4a56b8687565bb92e84a50b65b7491b
Deleted: sha256:08e262f054e3cb60eb322b1e453bd4d8bf27eb2db75dfd7f28b70b496bb96cff
Deleted: sha256:08661360c0244b2b5fe11d23d94cb3f9134c19e16e2d6007b3543dcf32584c17
Deleted: sha256:bc888b3a07008f08b3b2aa93b032218a4082ddb5012f6dd67205bd953a92a07b
Deleted: sha256:7c28e47d9ac990f2513504f19bf56907abb8be19c79077ca40b3727e980ed042
Deleted: sha256:8936bc9ba83197937a82772cde40fa4f0c1d2b1d645cbec1cd947d7bc4181371
Deleted: sha256:3a272f89731febf5c3ebf7727eb6ea5513e0ca5c5cf751a2b3fdb992aded1081
Deleted: sha256:4ec437cc803b06069d71ced2d52e4ca97a90b6fa67a2c0462d45de64d80fe173
Deleted: sha256:20b2d13a031049aa025cfc150dfcaec3c8f058e6c58a66d5abbb41a6fc139a9c
Deleted: sha256:362f68d98cda7092b1accc19eb7fee42c0d97fd7c50f021f01193b7bc8a34329
Deleted: sha256:218edcefafdc4ff98e540f309fd47ee552e589c2f186505ab4b1628bdf382eff
Deleted: sha256:484fa27e0da29d017f776797581b9880bffcfcc00d1c5b8c49592a1a0fe2e962
Deleted: sha256:34668acd2a9e89f9902dd6e9a06c1b25f5d58b575cf8d4c3c3ed40ee14e7b242
Deleted: sha256:be1bce2a087afc1bec2b180275437a0d33d39116fbfa9609db4ab2219c2356b4
Deleted: sha256:d60de0a44c0fc8651cbccbdd57112bfdd23b44c3303af30db799ebad78f77933
Deleted: sha256:d8de64832ef73c431925f9df08c0f3ec1b65445435152eebdd9fc744a466b47a
Deleted: sha256:e3b1cc38ff8d847f54d57c6c5497211ecb0a8f2ef252f03b8e7dce183af39daa
Deleted: sha256:ec40157bba1ccc111a87157f7c54b2fdd22cf35bbfe4f33dd40654ee5e273746
Deleted: sha256:1ea97275ab502771ce28c88cd28995622e5759f1108217b37c764499ff8ecb62
Deleted: sha256:7783c2d56f3394630a3f21527ce925d8252bd02add9b3487085682ff913f9fca
Deleted: sha256:bd7e46794ae9e6c8d2968934d8b34835b0191b40326895fc80fdd36174e83212
Deleted: sha256:69208a886c5f25636167d951e31e84b546fb8c14fcef94166edb430cec2c566a
Deleted: sha256:4a55a3e347d03d81c765f29952aaee05bcfdbaa303dd9e54ff5655b66ff097de
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211224120930]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d55d93f1cf17fee52be5397228d1bf32ac963a69234382c174096d3862c6389]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211224120930]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d55d93f1cf17fee52be5397228d1bf32ac963a69234382c174096d3862c6389])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d55d93f1cf17fee52be5397228d1bf32ac963a69234382c174096d3862c6389
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d55d93f1cf17fee52be5397228d1bf32ac963a69234382c174096d3862c6389
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3d55d93f1cf17fee52be5397228d1bf32ac963a69234382c174096d3862c6389].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 55m 36s
89 actionable tasks: 54 executed, 31 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/hss2xtl6z3up6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
