See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/181/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13438][Playground]
[stranniknm] [BEAM-13446]: fix incorrect tab symbol
[noreply] Removes the comment that seems no longer relevant.
[Valentyn Tymofieiev] Update a few dependencies that may depend on log4j
transitively.
[noreply] [BEAM-13159] Add Redis Stream (XADD) Write Support (#15858)
[noreply] Merge pull request #15994: [BEAM-13263] Support OnWindowExpiration in
[noreply] Bump dataflow container version to beam-master-20211213 (#16213)
[noreply] Merge pull request #16198 from [BEAM-13437][Playground] Add
[noreply] Merge pull request #16195 from a[BEAM-13436][Playground] Add
[noreply] [BEAM-13355] add Big Query parameter to enable users to specify load_…
[noreply] Updated the base images to use debian:bullseye (#16221)
[noreply] [BEAM-13434] Bump log4j to 2.16.0. (#16237)
[mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success
[mmack] [BEAM-13209] Fix DynamoDBIO.write to properly handle partial success
------------------------------------------
[...truncated 139.38 KB...]
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Dec 15, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-15T16:00:33.248Z: Cancel request is committed for workflow job:
2021-12-15_04_13_24-12996129804389175678.
Dec 15, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-15T16:00:33.277Z: Cleaning up.
Dec 15, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-15T16:00:33.348Z: Stopping **** pool...
Dec 15, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-15T16:00:33.396Z: Stopping **** pool...
Dec 15, 2021 4:03:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-15T16:03:24.153Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Dec 15, 2021 4:03:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-15T16:03:24.182Z: Worker pool stopped.
Dec 15, 2021 4:03:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-12-15_04_13_24-12996129804389175678 finished with status
CANCELLED.
Load test results for test (ID): 70ef303c-8f38-473a-b57b-493d40a2ea14 and
timestamp: 2021-12-15T12:13:19.822000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 13362.976
dataflow_v2_java11_total_bytes_count 5.07789537E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211215121124
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3ae598004ad3cdef49bd4cc44a778e7424d82af436f6cf0f11615ae690eec1c
Deleted: sha256:021586ef6eda6de8024b7482e0e3a892b9861df897e484ace4c49464a5fe9c39
Deleted: sha256:7593cd0dd724368fa66aabe9f921ec43235698238ed5c677f471bccf4870539a
Deleted: sha256:cb3d79d3b8df06baf277f74e4b3350a92498a1c1c9aa44fa2ef56e3d561d8bc5
Deleted: sha256:0c34037c842d1bcc19d68e1708b6c9c3ee8998474555ebf4384d47a71fd279b1
Deleted: sha256:c7b89cd1067a0351e9c1d4e3e3c20adc3d2fa774eb76919f7e3f94da2aaa5f5d
Deleted: sha256:a51307820d653b08cfebab7967e405063796f3786f120041f3b0581819e09b4e
Deleted: sha256:8f2668ca91f52ee1e3a8523a6447ad557c49a91a9f23705710b4d3e1074c3b36
Deleted: sha256:9c9191e64ae9c7d7f318ef50699563707442b8e6ac685d198ab97a9b6c6ac878
Deleted: sha256:9b78835c02406c620a80599bceaae069ae160e7cc5a5f28432c120b9b9806fc0
Deleted: sha256:8f9ace5f516a60c8cd81e867acfadf141f20a81da2f1c2f01ffb06252502a415
Deleted: sha256:6e54bd534bc951c65505aae6d943d48b90d090cb6521131bb3a5ed42437e816a
Deleted: sha256:ef9417e5d62649862270d552f5d6e35377f5d2b406fea6e243225e119c96bde2
Deleted: sha256:0886facc86858914cc0c02a823d5800d7a571642121802715a2302f9c64e2bc2
Deleted: sha256:b5371b8cc59417cb2ab8d2e25cb286b2ccb6949d2206c3325596d0a52342db15
Deleted: sha256:0cad35b8f888f4a60fb82b682825e70dd896e4026a95bdf16e1602ba9e78ccc1
Deleted: sha256:3ab1e970e70faacb959f86f031ea7cf97bd1976a062451a56d6c1e6d538bdb08
Deleted: sha256:b1294589beac2aa5b5f1ba06094485ce898e6f1df59f6f685a88e46e8f49aa42
Deleted: sha256:8fdd2dd89eff74963860e0ba7fa5b56c8e35ed434df46155ee3b72c63bca823b
Deleted: sha256:6d8d1822cfb6439ca9d8a5ba4c841e11bb099da9b009cf3a58301caa0d29eb3c
Deleted: sha256:b30ae1750d051e430662586a24f1ccefc70bdd90bc8f8f6a8bbd67d1893ca784
Deleted: sha256:8ae73c11142d7ddfb864c4e23f2df1b94059c88cc0ad944a01611548929304bf
Deleted: sha256:8778b28a280d504579e11c3507f0e6292c35a2647a265ea8712e754e1b7f1398
Deleted: sha256:a43023855a751a508e08b5dce9727a4a844f31dadd2f72674041f1f8fce7dc87
Deleted: sha256:093ca5994d67ba1cd38eb06364a6cc06285704dc78c2931a59d1d312f2217874
Deleted: sha256:6973723ff3507c5d663c21c7a1150e64a9e65c79f6e7e21195909100d1ef1281
Deleted: sha256:e6804b4023a17a4356f06646f1ee8de71d6cef9a941ab7766ddd5f751fcf1295
Deleted: sha256:c8f174cb08f35fcc4b96b964a94ca68047b33789f1d653ad0050ac493b034362
Deleted: sha256:fc50fe46f6c6c30b15631604e2c87dbe56b87aa18cf099d8d8a696cc77295874
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211215121124]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3ae598004ad3cdef49bd4cc44a778e7424d82af436f6cf0f11615ae690eec1c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211215121124]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3ae598004ad3cdef49bd4cc44a778e7424d82af436f6cf0f11615ae690eec1c])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3ae598004ad3cdef49bd4cc44a778e7424d82af436f6cf0f11615ae690eec1c
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3ae598004ad3cdef49bd4cc44a778e7424d82af436f6cf0f11615ae690eec1c
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3ae598004ad3cdef49bd4cc44a778e7424d82af436f6cf0f11615ae690eec1c].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 52m 25s
101 actionable tasks: 72 executed, 27 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2fpaal3ma7f4w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]