See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/207/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.106
------------------------------------------
[...truncated 121.61 KB...]
Jan 10, 2022 3:31:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:31:45.563Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:32:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:32:48.625Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:34:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:34:54.652Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:39:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:39:55.990Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:41:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:41:01.170Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:45:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:45:01.259Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:47:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-01-10T15:47:19.100Z: generic::aborted: SDK harness sdk-0-0
disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Jan 10, 2022 3:48:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:48:01.258Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:49:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:49:04.656Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:53:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:53:10.268Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 3:56:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T15:56:08.438Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2022 4:00:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T16:00:42.707Z: Cancel request is committed for workflow job:
2022-01-10_04_30_42-2389609333560828812.
Jan 10, 2022 4:00:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T16:00:42.832Z: Cleaning up.
Jan 10, 2022 4:00:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T16:00:42.974Z: Stopping **** pool...
Jan 10, 2022 4:00:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T16:00:43.027Z: Stopping **** pool...
Jan 10, 2022 4:03:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T16:03:38.071Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Jan 10, 2022 4:03:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-01-10T16:03:38.099Z: Worker pool stopped.
Jan 10, 2022 4:03:43 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-01-10_04_30_42-2389609333560828812 finished with status
CANCELLED.
Load test results for test (ID): 785d6573-1e8e-4741-a30e-7f4ebb78b2f7 and
timestamp: 2022-01-10T12:30:25.419000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 11890.062
dataflow_v2_java11_total_bytes_count 5.94515335E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110122546
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6c9463ef80c994fa04e3e5ea32340cd1dbfa9cee8652659b6880208d2145cdb6
Deleted: sha256:be9b700002aed869270e5cc65d50d654c71bc78b67206dba4d5d7ee2d168158a
Deleted: sha256:134265adb3ccafcb0ae9344a65c64f7d1a612d880ff391c90acc7354396fcff2
Deleted: sha256:29b7e0b7447c18b12e3228a84bfcb168824494771db5b0ddfc97d11798e71e02
Deleted: sha256:ebd90a1ca65738ff6f6a6b371551d5911e48104c22ce4fbbb21deef63ee4e174
Deleted: sha256:dad5f77d62865595261eba4814ea4900e0c87a615331a9777b07b9e63ae1ff4f
Deleted: sha256:ea1edc4110a4044643ed5e62e2dc573feb40eff01bbdcc872243c31f34f7ac51
Deleted: sha256:b5947e112a960644b42b1aab1dbb2e5f3c3fe410fd2f2db9db7be1b1744adc9d
Deleted: sha256:0699afbe57765faab38049e14b1f7cc0962886cfee0e18923835f737f760cfca
Deleted: sha256:16459e07f9dee18506c6d47f3919b0b4a25b84a951f53a8e27b3c2d1b41fe56e
Deleted: sha256:955fcb865479b1b08166ce88e54f11e9e2b2d5086b074a6b7d8de324185430a9
Deleted: sha256:fa57ef7d4bc949e066c30b1fd3d74f05c3efd9384a44085c57a2f6cdddaf5a36
Deleted: sha256:508fa80b420578f401d749b9db71414a83dc5eac7ec94d0779e95b74d888fec9
Deleted: sha256:d14a49793e7a29b1ea46759be649a5b63c8b08adb7afb38a787c8f3e766982d3
Deleted: sha256:4fd70f0229d4142a5c8a4dbf359d80c82724278640e4833fbfc02ce9bf9a846c
Deleted: sha256:284f55d8e9ef954c8b076322f6b90253f2a37e3c983c430fe6cb58307f0a13c4
Deleted: sha256:6dcb4adbc431550f65615a6b3ab4ea2b456554d581dd9c974dea25c0aeece9f6
Deleted: sha256:982b6e06322f1011cae5adc572599f4dbd7fa0ceabb1fb0871d82f153f834786
Deleted: sha256:6dc54e7a3dc589d7df8429d4db2b63bdd3139986c77f7a51646a46449043953a
Deleted: sha256:20c90fa1682fba4faa524b20b8cce7f81b74661dbaf510a701631d8a119fe070
Deleted: sha256:54ab2df1c34dfc4cbf3a7cc072a869e66c406e92a11b08c5ffec383f585ae00c
Deleted: sha256:fd55a979550702387da2197c0ca360f559b5312bc44c9948dd5affed5f52bda2
Deleted: sha256:4072062a91305c793c59d0bbd7a92e109a89c0dc185850f014b1dbd3e7043e84
Deleted: sha256:8c0201cec04e7044e321506a802a1205d936c558743ec6960673909924cfcc86
Deleted: sha256:0095eaa0dc1d2cd9ec3902f2e32c28999223e690857e0f1d932a4c5fb59ae858
Deleted: sha256:72f97a34edfc8be426a0417c30c063118965bd59e6ee93e905988bd3b2ca08fe
Deleted: sha256:6cbc92d303db43f64ded4621d4726444906129952da298eaaa37f4e7fd30d167
Deleted: sha256:5b2dc960c2dc5410d3801bb5cd10a376b2e9c420de5ce0b3576ef6e85f6b356f
Deleted: sha256:654f0c91bbd425e371e1f27da43e68e1c1e0fe75f3c5f90b5af4dac6946ce219
Deleted: sha256:236286940b063ac4ce65969d70395316c8b55704e3540eb9104210ca135868ce
Deleted: sha256:a07248fd2b05f2795f41c2221137c9770c5726818e2e4936633988f8060d6f33
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110122546]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6c9463ef80c994fa04e3e5ea32340cd1dbfa9cee8652659b6880208d2145cdb6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220110122546]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6c9463ef80c994fa04e3e5ea32340cd1dbfa9cee8652659b6880208d2145cdb6])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0fea859cd5bf6fe50d01a96741742d148f794e15cb75d3e1f9c94f260a4094d5
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0fea859cd5bf6fe50d01a96741742d148f794e15cb75d3e1f9c94f260a4094d5
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0fea859cd5bf6fe50d01a96741742d148f794e15cb75d3e1f9c94f260a4094d5].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6c9463ef80c994fa04e3e5ea32340cd1dbfa9cee8652659b6880208d2145cdb6
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6c9463ef80c994fa04e3e5ea32340cd1dbfa9cee8652659b6880208d2145cdb6
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6c9463ef80c994fa04e3e5ea32340cd1dbfa9cee8652659b6880208d2145cdb6].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 38m 50s
109 actionable tasks: 74 executed, 31 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/bji7amtkl6jky
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]