See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/273/display/redirect?page=changes>
Changes:
[Kiley Sok] Add Java 17 Nexmark metrics to Grafana
[yiru] .
[yiru] .
[yiru] .
[yiru] format fix
[yiru] .
[yiru] make DoFn into a separate class
[yiru] .
[yiru] fix setting
[mmack] [adhoc] Minor cleanup for aws2 tests
[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs
[noreply] [BEAM-14128] Eliminating quadratic behavior of
[noreply] [BEAM-13972] Add RunInference interface (#16917)
[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in
[yiru] fix checkstyle
[yiru] spotlessapply
[noreply] Deprecate tags.go (#17025)
[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)
[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for
[noreply] [BEAM-13925] Add weekly automation to update our reviewer config
[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile
[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)
[noreply] Pin setup-gcloud to v0 instead of master (#17123)
[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)
[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API
[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link
[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam
[noreply] Update Changes.md w/Go pipeline pre-process fix.
[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)
[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition
------------------------------------------
[...truncated 70.79 KB...]
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
Mar 19, 2022 12:53:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-19T12:53:07.871Z: generic::internal: The work item requesting
state read is no longer valid on the backend. The work has already completed or
will be retried. This is expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
Mar 19, 2022 4:00:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-19T16:00:56.135Z: Cancel request is committed for workflow job:
2022-03-19_05_47_24-5863629577210895251.
Mar 19, 2022 4:00:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-19T16:00:56.205Z: Cleaning up.
Mar 19, 2022 4:00:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-19T16:00:56.285Z: Stopping **** pool...
Mar 19, 2022 4:00:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-19T16:00:56.331Z: Stopping **** pool...
Mar 19, 2022 4:03:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-19T16:03:26.974Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 19, 2022 4:03:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-19T16:03:27.012Z: Worker pool stopped.
Mar 19, 2022 4:03:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-19_05_47_24-5863629577210895251 finished with status
CANCELLED.
Load test results for test (ID): 9ad8457e-0c66-4428-94b2-96540ca6eccb and
timestamp: 2022-03-19T12:47:18.418000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 11478.827
dataflow_v2_java11_total_bytes_count 3.84489071E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220319124442
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e86a4495494816abe21da39a5ca73fa60554abdb3f3af238548d4e70d5f8647c
Deleted: sha256:1298de5eb7d966731aad43b36c80ba13320ae3b599322fe304051992d15fe6ef
Deleted: sha256:5b063d86a9103d938e3da9bb9fb84afbc261b079064b2fda2ba79e23b3ff9195
Deleted: sha256:052eaeaeb83c75c05c2f7b8c8cfabf21a4e174051cc052104b9cdb1c92d6354f
Deleted: sha256:01ffaa4b2bd3fae1b11a47d2f500ef12570b78c8572b6563e5e5fce038461665
Deleted: sha256:3d0c68bdf589ee66fc5595024cdd2a6c8b0b60735565ff00dd1ff20021b16c87
Deleted: sha256:72c8cd5ae5c602e80fb86e4f69f83be2bfd57d1098d910e86231f3494ba70e2f
Deleted: sha256:08264aecae2257ed4a42898e2eedea7a3420b5a016f7c2318a4e8662ab6fc775
Deleted: sha256:027654594ade49d09f7b9db521dfe498d91650dfb663d547f2b80d12338f3664
Deleted: sha256:5d93eaeb8ab6b19d26e3d6e37208ccd59f34f8248c3644d49e58d645f9762f9e
Deleted: sha256:0a72533f76a5113fba3da2a3dc26fb4c1d8b1d1ebc81cfa0f0e962c4ff481f10
Deleted: sha256:e9a6161df81b362f62a131767338696c23de5f0f63c23ce03c0ff29159a64093
Deleted: sha256:0ab5d28255607cffdd639d82dfaf699699cf8fa1632c10bae413947f2225d4a4
Deleted: sha256:d3b378115e484072d01a2fbc216241608774175ee156acf7a40a4f331cc0fc10
Deleted: sha256:7688fe78b32544ece3000cf0db490fb7c1954105891dc3e9fd4ec339d5a693d3
Deleted: sha256:46c8143528278b408625c1b5500a635b93e60daeb688afb1ff21def5d1700bcc
Deleted: sha256:4083eb54b9e866cfbf2ee11fa685cb6f9b36ff1668583e5818e985c68379716f
Deleted: sha256:4fe7b6f971b08cb97e52f6b3e496a14f670288c2d708f1921d2b6af8f9077e18
Deleted: sha256:9e879f6a88e8a51bc0dbb72231602aaf7396eb4e35d3536c6f00af65f73e2fa7
Deleted: sha256:f7051bb901146e23c65acdbdd13421aedb58c2490a361663b105914037bd5019
Deleted: sha256:30bb46f8c49bd605dce7ed3db08832729fb9722fa7405e8fbfc054c34e5fe22e
Deleted: sha256:72d3081f8ad9038ed4237eb81247b742327386286ef2bd0b7530d7c811591287
Deleted: sha256:95b0bc70d8f49ec5c3861aa1ec8acb1a074add1d0c86ff6bc7bf227d6b55c543
Deleted: sha256:68e24f3813b2980a19815e3a06621661209a28b6c26b88c03d63aa4314d6eee4
Deleted: sha256:c59130b2a9546e766601d219c946adbe871b7c838c4d6c7262f6d017a236fe60
Deleted: sha256:575c0a4f07fbaf06e2edebf785a4e15ba55600f3f44f24849188170475269212
Deleted: sha256:1085342f9feefc4ef92862b7593398cb4a2d22f6f347877dde1a8d7e8c33c816
Deleted: sha256:7ba9352094444b07c4d698fbf0a3076e2f1046516506dfd235eed978514faaea
Deleted: sha256:e15012f1428eec0e33d6e33d32de3e6e05e22708b8e13703b5f8e118da0dbb5d
Deleted: sha256:4235a26604f41a0ecd9663c43994446e5b13988467ac80057da4d2481de3ec31
Deleted: sha256:12236b43581ad9330274d6ac158951c5f75c839ba22585c837470a4b818ef5a7
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220319124442]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e86a4495494816abe21da39a5ca73fa60554abdb3f3af238548d4e70d5f8647c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220319124442]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e86a4495494816abe21da39a5ca73fa60554abdb3f3af238548d4e70d5f8647c])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e86a4495494816abe21da39a5ca73fa60554abdb3f3af238548d4e70d5f8647c
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e86a4495494816abe21da39a5ca73fa60554abdb3f3af238548d4e70d5f8647c
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e86a4495494816abe21da39a5ca73fa60554abdb3f3af238548d4e70d5f8647c].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 19m 40s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/uvuay4e3xnyym
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
