See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/88/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.
[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner
[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)
[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,
[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.
[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource
(#17100)
[noreply] Populate environment capabilities in v1beta3 protos. (#17042)
[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in
BQ IO.
[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on
Dataflow,
[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)
[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.
[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)
[noreply] Merge pull request #16977 from [BEAM-12164] Added integration test
for
------------------------------------------
[...truncated 158.99 KB...]
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
Mar 18, 2022 12:46:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-18T12:46:19.877Z: generic::internal: The work item requesting
state read is no longer valid on the backend. The work has already completed or
will be retried. This is expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
Mar 18, 2022 4:00:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:58.030Z: Cancel request is committed for workflow job:
2022-03-18_05_38_38-10321091201345048590.
Mar 18, 2022 4:00:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:58.160Z: Cleaning up.
Mar 18, 2022 4:00:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:58.433Z: Stopping **** pool...
Mar 18, 2022 4:00:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:58.519Z: Stopping **** pool...
Mar 18, 2022 4:03:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:03:15.317Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 18, 2022 4:03:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:03:15.409Z: Worker pool stopped.
Mar 18, 2022 4:03:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-18_05_38_38-10321091201345048590 finished with status
CANCELLED.
Load test results for test (ID): bf0dd004-d93c-43d0-8e9c-88e0ffb6dd4b and
timestamp: 2022-03-18T12:38:26.092000000Z:
Exception in thread "main" Metric: Value:
dataflow_v2_java17_runtime_sec 11989.959
java.lang.RuntimeException: Invalid job state: CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
dataflow_v2_java17_total_bytes_count 3.07381204E10
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318123610
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:285da2d04e1dba971666500a8615417be3837c780c160035b2a5e3f9be5365a7
Deleted: sha256:4f791f237666227d50370490c25951202c7d9eb70e1a6821ff4599b97440c2be
Deleted: sha256:cedb018695816e4152849a83aafa34588bf745823ffb9cfbcea90f84ce6731c7
Deleted: sha256:d5a75997369103c972dfdaf21d29f2f2fb853471d8afb9d6404d2df913a93958
Deleted: sha256:1568afad16ed6f8dd7bda800c1581430d9fec5e8fc1a966ccb41ccd97a113ea8
Deleted: sha256:f20c16a2d9195bfba3adc483d98eb12bf70dfba113b77fd86609d763c8586c86
Deleted: sha256:31e4b8d8145bc014f424545d07226a45e6e4b475a6ef75e3ef4b49ecb83c3178
Deleted: sha256:307d29ecd9be3c96874baae5d9155377dc1d90e0cd5314c00dad3c7f69633d09
Deleted: sha256:7d57958fc3c3bbd2677e9183fba5741faaf447c0d38695ad2cc40b61436b73a4
Deleted: sha256:ff2f276961425725e8961c2c048233186c0ab0d57a63eb5df5fe6a1c9fcbee23
Deleted: sha256:d827fe1ba91df62aff1e013f379749f51cf1c3decbc38e99977d8a16019fead7
Deleted: sha256:6d5c1aaa2cc08abad7f0412460ed56611581e283ce953818ac01238170737376
Deleted: sha256:5e275235333f94be51ab3f2cd95dd4604b9a86876e4d6c75795369af11f22f9f
Deleted: sha256:7d401f06147577f36fe4ba0c88e8c15128244524804979d58ba0972d5e828d18
Deleted: sha256:fa9c88d08090f2a77af22be795df76771875344a262118a8c1067bcbba6228ad
Deleted: sha256:5444047e11eb0135ba711f91327fa5f10a44aa4464dd980fb57eb9e2409ec414
Deleted: sha256:ac73387e66d3b062b425e84c6c256d57fdaff556fe8fd7dbe546b49ae7cff901
Deleted: sha256:ee201c319449b40e7efe283100a5fe7fab679c630db29a00bc71dda9c66354df
Deleted: sha256:14db9c3b1c771e5666bfac159351e3986ee7a9fc0c888a784f1d2c7ee0f3c8e6
Deleted: sha256:1ec9d674004b48fa020770297fe4d3675f29dc337aec8b9b7f6f587d075515d8
Deleted: sha256:2155081bd5f4c30eedaec35ddf57244708551f0df0544691e7f564908ff6108a
Deleted: sha256:10bfc6d88eeff9e82a93bf539195f116b7fe459bac4d55e1f7722076c8aec204
Deleted: sha256:233f2f34f4db1df6466eddb2dce1ab0e9f4c18013d1d3ab75bef30cb25b8ca55
Deleted: sha256:296ec1bebad6c36c9bd11544dfd3f98e8e8d1275a0f830916238f9842e29d15e
Deleted: sha256:7be9c6cec3062bfdb9b39d8fc0bc55da3eeeaaf5ab5a0ba4b6dd6a93ca828d78
Deleted: sha256:6a03fd9328e09ff073b2890ec38d99baff5d6890a52681a331b92ab468912351
Deleted: sha256:75f858462c4f17617d41446a7848705eded17a2f2a314bb764d9b14c89a74f73
Deleted: sha256:3cd85c6ffc59068d18f73016c8167d1a7cf06e41adc57b7a19391114034cfbac
Deleted: sha256:c81626450806646ecea50750e84940811a17ff18c5e7766fe48a48a569fbe62c
Deleted: sha256:36bea53e17bfa5d5d054a093a6e85840eb86ac6f61d977b5d0968464a57558b4
Deleted: sha256:e49c32c396234d40f7e32171bf12383bf69d6ee1185e9e20a25d1ae029f54636
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318123610]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:285da2d04e1dba971666500a8615417be3837c780c160035b2a5e3f9be5365a7]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318123610]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:285da2d04e1dba971666500a8615417be3837c780c160035b2a5e3f9be5365a7])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:381df7627f67811583b68d338f48b25b8f4b4b8cf3e17c3473aff098bddd27c5
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:381df7627f67811583b68d338f48b25b8f4b4b8cf3e17c3473aff098bddd27c5
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:381df7627f67811583b68d338f48b25b8f4b4b8cf3e17c3473aff098bddd27c5].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:285da2d04e1dba971666500a8615417be3837c780c160035b2a5e3f9be5365a7
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:285da2d04e1dba971666500a8615417be3837c780c160035b2a5e3f9be5365a7
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:285da2d04e1dba971666500a8615417be3837c780c160035b2a5e3f9be5365a7].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 27m 26s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/i3yeutqsaa3bm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
