See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/56/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-9195] Bump org.testcontainers to 1.16.3
------------------------------------------
[...truncated 1.42 MB...]
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already c
Feb 13, 2022 3:26:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-13T15:26:37.007Z: generic::internal: The work item requesting
state read is no longer valid on the backend. The work has already completed or
will be retried. This is expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
Feb 13, 2022 4:01:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-13T16:01:04.299Z: Cancel request is committed for workflow job:
2022-02-13_04_32_57-17054085345386009290.
Feb 13, 2022 4:01:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-13T16:01:04.329Z: Cleaning up.
Feb 13, 2022 4:01:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-13T16:01:04.398Z: Stopping **** pool...
Feb 13, 2022 4:01:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-13T16:01:04.444Z: Stopping **** pool...
Feb 13, 2022 4:03:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-13T16:03:27.772Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Feb 13, 2022 4:03:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-13T16:03:27.812Z: Worker pool stopped.
Feb 13, 2022 4:03:35 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-02-13_04_32_57-17054085345386009290 finished with status
CANCELLED.
Load test results for test (ID): 89ea341a-d48c-4d4f-a68a-835fd3c80afa and
timestamp: 2022-02-13T12:32:51.044000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 12351.654
dataflow_v2_java17_total_bytes_count 2.45877318E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220213123036
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c78fa28d22ea2ecabe9ebcf56db510e02ec0ac86d00649e4c76b38678cf50423
Deleted: sha256:b38900ddaa3744c3412364ade4945a28d05f61902c8a65d92e9585be13360d22
Deleted: sha256:116368e088109b3cf43860ef7bd64173f04cb5ec2c0e1a1e4c83fe799cbafa91
Deleted: sha256:88ae632e197f64b6ea5e8857f812e0eb0edc4511077c8b333fc14718c78cbae9
Deleted: sha256:507dc1495395eb9ff915fe353cc52f8e4d16223abdb86d887403d8049edac62c
Deleted: sha256:8e575a9ef573c3fc9b90adf0be557d452e9d558ed85a140b146a1f92113028b8
Deleted: sha256:1c09bc4b47f058ad6d4792b4af872ee16a9721ed551ab79088eb92f6cbf82984
Deleted: sha256:e8aa285ac53e9355c298c239dcf095b12ecbaf900d84c71801e153d0cdc17c46
Deleted: sha256:967a551ecf455a99ad89c1cd90dcd7611cb94e6da9dcf2026aedb97c732c9e90
Deleted: sha256:2a14a5bf1bad8c4325e75c6ecd80a7d16ccfad980dfe082d26bf89faa0eb03fc
Deleted: sha256:a696761ea3a383b28ca46f462a2cdf89199e6477f3db3263456880c4cf54cdf3
Deleted: sha256:69d0d70d94d7ba9a075e52f0467a7b80b06ad6fa25ce3a36d55cb4f173ec0629
Deleted: sha256:1f54fd3e21e08ba50fb9e443d703ea7c1ffdc7940a9ef933fe7d840cb5b2013e
Deleted: sha256:cdaa481df1ba52f7eab9fceda685bdddf54fc60a8ff850a31b581e084c24b3d9
Deleted: sha256:677ee4a7e7cc96b04f7e3c2521038a1aef9cc2bf89135b16db0424f4b1b3455e
Deleted: sha256:1093766a6c348b424083612a6b4c72587fedf82ebff6c1b7e444a835bc91d306
Deleted: sha256:9d2a34412fe0091c943de4ac27ba31e0ce4962dd8988d261ded53bae11450a9e
Deleted: sha256:c38a91e024fe7eed035920c40ec03a6fe0a706fd0d107f2f41600e43880f3bfc
Deleted: sha256:33d786122483441fe491b5b9dc332a6295eb9cc2c0a33e8da950030ceefef37c
Deleted: sha256:63995908f7e73e2442a663afb7d7be641eeea87811a1ec127654974ee9f59af8
Deleted: sha256:649df3ea8ff86884b7d9ee64ddf02af24dd5186ac66501f659413a904ab802e3
Deleted: sha256:fd5aed5a550a1487192af1d38dfccb1c6688d8e91c48b372e935cce297b3fb2a
Deleted: sha256:3ee0d037dc91aefa2701735324d1fad4470c2209d7152e76b54b3761950a89e4
Deleted: sha256:fe8173898264ab1628c85b73ac6c7a41f0409122ad3468d0801d8180d5e6fae8
Deleted: sha256:9975e1a2e920e7c63e3f5e456a2957e8a91d9ab871b7cdfbc522928bf892a4cf
Deleted: sha256:2c910015e66651cd4793fb920fb0c1173a10dc8dbb40adfa9eb20734965117cd
Deleted: sha256:d648e0e5378f38662c0bb68766f9bcfa4e0645e6136dc1b03aa1b59b4576c83d
Deleted: sha256:acc3e8ce99aabc18a0f9fbfb901148e95464b2dc6141e0e9152f5fd9f339d6f7
Deleted: sha256:1642cc3fcf019bed2dd31fc9164e9b1d1130a048d47be8e50e8e7cefb1a470aa
Deleted: sha256:0eb40d3513aa178f72b7aff1865f5a150504f8d81dc156fdce0809c5390dcf9b
Deleted: sha256:249e6fb5cee4fca168ee01915583e5bd51744774bf667cc442d281841e8b2e23
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220213123036]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c78fa28d22ea2ecabe9ebcf56db510e02ec0ac86d00649e4c76b38678cf50423]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220213123036]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c78fa28d22ea2ecabe9ebcf56db510e02ec0ac86d00649e4c76b38678cf50423])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:46392edaf7ded0ab88c2474a6b01107b71ec81f34c489bc1030a5d2c3cdc0bab
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:46392edaf7ded0ab88c2474a6b01107b71ec81f34c489bc1030a5d2c3cdc0bab
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:46392edaf7ded0ab88c2474a6b01107b71ec81f34c489bc1030a5d2c3cdc0bab].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c78fa28d22ea2ecabe9ebcf56db510e02ec0ac86d00649e4c76b38678cf50423
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c78fa28d22ea2ecabe9ebcf56db510e02ec0ac86d00649e4c76b38678cf50423
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c78fa28d22ea2ecabe9ebcf56db510e02ec0ac86d00649e4c76b38678cf50423].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 33m 22s
109 actionable tasks: 73 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/axhex3yhbp7fy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
