See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/100/display/redirect?page=changes>
Changes:
[vachan] Update display data to include BQ information.
[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to
[chamikaramj] Convert URLs to local jars when constructing filesToStage
[Valentyn Tymofieiev] Ensure the removed option
prebuild_sdk_container_base_image not used on
[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline
[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for
[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test
[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test
[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)
[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll
imports
[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)
[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go
x-lang
------------------------------------------
[...truncated 524.19 KB...]
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retri
Mar 30, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:33.391Z: Cancel request is committed for workflow job:
2022-03-30_05_59_40-829164874279256936.
Mar 30, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:33.463Z: Cleaning up.
Mar 30, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:33.561Z: Stopping **** pool...
Mar 30, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:33.642Z: Stopping **** pool...
Mar 30, 2022 4:03:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:03:25.900Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 30, 2022 4:03:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:03:25.963Z: Worker pool stopped.
Mar 30, 2022 4:03:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-30_05_59_40-829164874279256936 finished with status CANCELLED.
Load test results for test (ID): db579866-19cd-4797-af0e-8b90223245d2 and
timestamp: 2022-03-30T12:59:35.391000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 10490.05
dataflow_v2_java17_total_bytes_count 6.14570242E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220330125734
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:800ec478f6a5572c6858dffca28d69e25fcb7a82b06a1a8011c00e508659f511
Deleted: sha256:798d4049235e3dd79e491baa4d6eaa791d8e5d7b5c8ec4ab2766c38d5af7051d
Deleted: sha256:f8770f541baf02d2d60a155a8b93c7b2663c95270f98ec87b5875e513cca6a23
Deleted: sha256:2fd819a1597e267188ae47943db474707106a461e8b895cb49eadb7c1f48a9f5
Deleted: sha256:0a90468ad5329151bc485c9440ee1af82be59afb617d004452271811ffd71071
Deleted: sha256:4dc69d90049d0cf073ad4b228fb09a5e8a56ed313ef39b03842727f46a3a19d9
Deleted: sha256:bb618c1ad744765c49802e079ab9c159eb665cb409f3d67aaa7744de4c486b05
Deleted: sha256:7ef19539d763b5ea03b2b5f4c82046c0bdced47b90dad3aa70817bf41b99df68
Deleted: sha256:6d51c2c40f845d3200949e20539ad45960ba544f19937bab33ac80d6dc905ef3
Deleted: sha256:b1ee5e9c1c5ed2bb9bf791fb88c1163345fefe07af1b0c95f4c35390ea4bd367
Deleted: sha256:9b7e9ab44ccf704004a1cd6142d3ec15215f0ac043e4e77bacd6a030db7eb4ab
Deleted: sha256:e9ae5841aa7d4171e401cd675f8b90beb41f89a3d603d81d82bda43964ff6c7c
Deleted: sha256:9f6a5333b1dca0fca2c024b5f37cd004ddded1e458bcabb45765ffa6f9c22086
Deleted: sha256:3617377cf8ad59e3410d41c021823072c4a998549774608501467bcbafa59163
Deleted: sha256:aea2b919f60f58903119ca07ba00a3781639ba1f40fb4619f341b401e6e5f647
Deleted: sha256:958453c7577fb8ec201f8007c61697e13c7aa5c12a97402ea10ac4609f70f717
Deleted: sha256:403a568577333ea6844d20ae21b1ea6722ee80058fd8bc0ea548b7efc2381f46
Deleted: sha256:d60133ef5380fd39557d57dba7f0968ea543ba78435615479dd1eee5b567cbd6
Deleted: sha256:ff8528688e3fb385e8744c8c06329f3b3837973c749fd96f297e23fd1dc44c0f
Deleted: sha256:48d17d76f292b2fbef66e7db01d5738a29445c81800f85287135ebeb1a188910
Deleted: sha256:c260f48d577651e4aa1aa9caaa0c521f249ee68c314c641bb5637f3169b504f7
Deleted: sha256:ee6c97197cf64191d1cdc654d2f77fc58f7b9242f3408c11b3f656f3b633a97c
Deleted: sha256:2614bc92f8bb9cc51811f650b05c84e59d799ef2814a46fdceb2cac9d6d32808
Deleted: sha256:3bc09cf5aa444987551ecb046f79d6c51f3a9554311fa1e48518a9521a86a7ab
Deleted: sha256:f04217f18e98c7a0768446a26e0ae4d517e89b8a31491ea60172e864b4c98171
Deleted: sha256:20fa1cacb9eac7cb699a56ecd2325d888956b624dfce82d547cd8f0fd9f53f43
Deleted: sha256:830e1fadf501f1efee137340f7475b23cea32f194a52e50ecd587922fe44f60c
Deleted: sha256:fa248ea9488882dec26a1cae34404b60d1c07189e5f26dbc9732b1b9f1468e5c
Deleted: sha256:84b48d63a16d71063ba76236305c71d590c11156b75e7900000134ed0b8797df
Deleted: sha256:f39c721bd81be7105e902847dfe068433512ff1f592d8d387229311ed5a36f62
Deleted: sha256:8d4b458ee520bce4cfbca46885e59f6e4b913b7392c862eee8c0b33a980edfa6
Deleted: sha256:6e299dc40d9a09ee18bfed05ba701cdb45a74d7793c193c19f3ac807ae005801
Deleted: sha256:33db08decaf3de3eb8302fd1b94934738b3460ca5ba37871d6199c155a52f5d3
Deleted: sha256:d96af142ff31f7a4007cdf9deeeddbf5142b7a76577bc7ed6d31aced961cb27f
Deleted: sha256:bba223f3c1cf3548492e6004b6628af5f63651f71f005592aac12cbe6162061b
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220330125734]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:800ec478f6a5572c6858dffca28d69e25fcb7a82b06a1a8011c00e508659f511]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220330125734]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:800ec478f6a5572c6858dffca28d69e25fcb7a82b06a1a8011c00e508659f511])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:800ec478f6a5572c6858dffca28d69e25fcb7a82b06a1a8011c00e508659f511
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:800ec478f6a5572c6858dffca28d69e25fcb7a82b06a1a8011c00e508659f511
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:800ec478f6a5572c6858dffca28d69e25fcb7a82b06a1a8011c00e508659f511].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 6m 19s
110 actionable tasks: 73 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/qf2bspoxzjmu2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]