See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/75/display/redirect?page=changes>
Changes:
[rahuliyer573] py: Import beam plugins before starting SdkHarness
[stephen.patel] BEAM-14011 fix s3 filesystem multipart copy
[Valentyn Tymofieiev] Bump numpy bound to include 1.22 and regenerate container
deps.
[github-actions] [BEAM-13925] months in date constructor are 0 indexed
[noreply] Merge pull request #16842 from [BEAM-13932][Playground] Container's
user
[noreply] Doc updates and blog post for 2.37.0 (#16887)
[noreply] Remove resolved issue in docs + update class path on sample (#17018)
[noreply] [BEAM-14016] Fixed flaky postcommit test (#17009)
[noreply] Remove resolved issue in notebook
[noreply] [BEAM-13947] Add split() and rsplit(), non-deferred column operations
on
[noreply] BEAM-14026 - Fixes bug related to Unnesting nested rows in an array
------------------------------------------
[...truncated 932.24 KB...]
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
Mar 05, 2022 4:03:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-05T16:03:23.842Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 05, 2022 4:03:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-05T16:03:23.902Z: Worker pool stopped.
Mar 05, 2022 4:03:30 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-05_04_32_42-774827235346324432 finished with status CANCELLED.
Load test results for test (ID): faafe6e8-722c-4c48-be5a-33c3a1c4f806 and
timestamp: 2022-03-05T12:32:37.558000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 12350.024
dataflow_v2_java17_total_bytes_count 3.67828715E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220305123041
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc15099965a6bde5329dde01fde5be7e0a676e96474f44f9c7ac11530be9ac6c
Deleted: sha256:489af3c4c488f8d7161f7ed73bddf90c910bb996ad62f2d2f689f4c4e2834f35
Deleted: sha256:185f53adaf6f5f86f5f490282eaece40a6cc295c297179caccf089f9d00861fa
Deleted: sha256:40c6d1631e3f21981e9c93cbb5595b32ab7b3f487a52dd230cb73c6c5d6b12ea
Deleted: sha256:4fa859ed747c1a3e57c54612fc4119d55bc247f9471bdc8826ebecebc1a06196
Deleted: sha256:587f28971c6bfe5fb1ead6b4bf629508f1588ace27773f34e60cde0298a8e732
Deleted: sha256:16c126b118fecdd19b061e68cf69ceea0be82d39792af4a8332e3a153182dec9
Deleted: sha256:7fc61ba63a07a90687a72ae39f5a9630c73c22ce0128cba7b545ef612b331ed7
Deleted: sha256:14696a23a947e7d814094dddccebbf8d761945cf257d2e814a6736429df970e2
Deleted: sha256:1d7da97a9f2c15bb6013f1b5091e720808b7ca822a811b4900fd4abc612864dd
Deleted: sha256:3b23abe8debfd8f04a4d51cb29891e46350addeece0d1ed25cd587cb658331b8
Deleted: sha256:a19b6d67110f1c84c64940f70141714f129ab04b3cb28ced462f337bcb4674af
Deleted: sha256:82efce9803e3f9ca2de002359e89e1002875b5feadba22d8a5bc552890cd114c
Deleted: sha256:eabb9f4fa81f144ef2292bb955c7b99a0a0609f39aa88c4433e370ac80542dd4
Deleted: sha256:9ea3b67b6810aa80e9ceb0c6f62a8c2bc06b1c1dabac84c8780c73b491c59e48
Deleted: sha256:acf3e2066aa64e35ceb5ff35300765a6d0429a685ef41a25c42f69296ba4fe23
Deleted: sha256:0871ec7925a4d080eacf0540036bcba3eeaad2fba834c13c6306a57ff93a1c74
Deleted: sha256:307a4d39d880e851c5ccc83bf1ff0007a6d10192284c7677e6168a7641884f8e
Deleted: sha256:3a8ea44c2e724195c18ecb483121f946ed6ddeaccb770aaf929286bfcb7d51bb
Deleted: sha256:c67786088dd42ed14b6661a2630ab3852b6dffc730c56dfdfa60f8e4d96d05ab
Deleted: sha256:27d5be10d56180ce94822b1b14728a159965ae4af5ed91f8d64eb759cc48c806
Deleted: sha256:2439a7539b493adc3ec771de6449a947030b8141d9fb3504ebef7751408e9464
Deleted: sha256:70ebcfe87fd4076a39c8c5249a9059b3ee59e12c823287cd53af43d03e36c4e0
Deleted: sha256:6297924ea911d496f223c36582e6d84abbaf4bc633db6acc3ee1f9956c91780c
Deleted: sha256:8e93c5aaa8ae37fe38bd0f3d9b3afb26f824f7b7ea0d2be568434449e1cb7ab9
Deleted: sha256:e50382346fc5dd4b5f52ece7c09ac8b4c2e3dfc3eb8976e5b67eb0bb025c5db9
Deleted: sha256:0513dfb6338d6ca0b017f7c4efa776afb14c48ad1601434326796c80ae47693d
Deleted: sha256:b4b9a0b1419f49663ed7e8bf9f30ba5cad0b2580ceb330fbbabed4cdd9022574
Deleted: sha256:d3a24da1fec874f2ed40b37ede58bfcbc616744ab315d9d3fad293e7d995e58b
Deleted: sha256:011d6e13098f2f80c106bd98796843690ce936e037be092114d0034fb274956c
Deleted: sha256:469e1fff2e2cfe716009361c1e17b7b2bf770ca75a642e9b90cd08e2ee8cb117
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220305123041]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc15099965a6bde5329dde01fde5be7e0a676e96474f44f9c7ac11530be9ac6c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220305123041]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc15099965a6bde5329dde01fde5be7e0a676e96474f44f9c7ac11530be9ac6c])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc15099965a6bde5329dde01fde5be7e0a676e96474f44f9c7ac11530be9ac6c
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc15099965a6bde5329dde01fde5be7e0a676e96474f44f9c7ac11530be9ac6c
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:bc15099965a6bde5329dde01fde5be7e0a676e96474f44f9c7ac11530be9ac6c].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 33m 11s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/4ib4fyyab3thw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
