See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/86/display/redirect?page=changes>
Changes:
[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged
jars
[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored
java
[dhuntsperger] adding a list of example pipelines
[dhuntsperger] removing unnecessary `ls` command from maven project generation
[dhuntsperger] fixing filename formatting in response to feedback
[dhuntsperger] adding extra step emphasizing runner setupt
[dhuntsperger] reorganized instructions to emphasize setup steps for runners
[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…
[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support
[noreply] Adding pydoc for StateHandler (#17091)
[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)
------------------------------------------
[...truncated 658.21 KB...]
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/windmill_cache_access.cc:40
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed throu
Mar 16, 2022 1:50:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-16T13:50:37.335Z: Staged package
gax-grpc-2.8.1-Oaqma5KQUeKekzhWvuQ9BCsF3Uf1NF_DCF0Um3fxw3s.jar at location
'gs://temp-storage-for-perf-tests/loadtests/staging/gax-grpc-2.8.1-Oaqma5KQUeKekzhWvuQ9BCsF3Uf1NF_DCF0Um3fxw3s.jar'
is inaccessible.
Mar 16, 2022 1:50:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-16T13:50:37.863Z: Staged package
google-cloud-spanner-6.17.4-NvG_91cO2RfpEp9bgh1dl-N3SCcaKXMAoFmtVb0nBzY.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-spanner-6.17.4-NvG_91cO2RfpEp9bgh1dl-N3SCcaKXMAoFmtVb0nBzY.jar'
is inaccessible.
Mar 16, 2022 1:50:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-03-16T13:50:41.910Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Mar 16, 2022 1:53:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-03-16T13:53:40.223Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Mar 16, 2022 1:56:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-16T13:56:37.366Z: Staged package
gax-grpc-2.8.1-Oaqma5KQUeKekzhWvuQ9BCsF3Uf1NF_DCF0Um3fxw3s.jar at location
'gs://temp-storage-for-perf-tests/loadtests/staging/gax-grpc-2.8.1-Oaqma5KQUeKekzhWvuQ9BCsF3Uf1NF_DCF0Um3fxw3s.jar'
is inaccessible.
Mar 16, 2022 1:56:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-16T13:56:37.961Z: Staged package
google-cloud-spanner-6.17.4-NvG_91cO2RfpEp9bgh1dl-N3SCcaKXMAoFmtVb0nBzY.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-spanner-6.17.4-NvG_91cO2RfpEp9bgh1dl-N3SCcaKXMAoFmtVb0nBzY.jar'
is inaccessible.
Mar 16, 2022 1:56:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-03-16T13:56:40.389Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Mar 16, 2022 1:59:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-03-16T13:59:40.349Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Mar 16, 2022 2:02:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-16T14:02:37.254Z: Staged package
gax-grpc-2.8.1-Oaqma5KQUeKekzhWvuQ9BCsF3Uf1NF_DCF0Um3fxw3s.jar at location
'gs://temp-storage-for-perf-tests/loadtests/staging/gax-grpc-2.8.1-Oaqma5KQUeKekzhWvuQ9BCsF3Uf1NF_DCF0Um3fxw3s.jar'
is inaccessible.
Mar 16, 2022 2:02:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-16T14:02:37.915Z: Staged package
google-cloud-spanner-6.17.4-NvG_91cO2RfpEp9bgh1dl-N3SCcaKXMAoFmtVb0nBzY.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-spanner-6.17.4-NvG_91cO2RfpEp9bgh1dl-N3SCcaKXMAoFmtVb0nBzY.jar'
is inaccessible.
Mar 16, 2022 2:02:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-03-16T14:02:41.257Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Mar 16, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:41.762Z: Cancel request is committed for workflow job:
2022-03-16_05_38_23-15995521566841701660.
Mar 16, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:41.842Z: Cleaning up.
Mar 16, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:41.907Z: Stopping **** pool...
Mar 16, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:41.969Z: Stopping **** pool...
Mar 16, 2022 4:03:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:03:03.977Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 16, 2022 4:03:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:03:04.038Z: Worker pool stopped.
Mar 16, 2022 4:03:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-16_05_38_23-15995521566841701660 finished with status
CANCELLED.
Load test results for test (ID): 6373d5ad-c367-4eef-84ef-5c58d43e9e5c and
timestamp: 2022-03-16T12:38:15.003000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 11998.798
dataflow_v2_java17_total_bytes_count 3.85616657E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316123318
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:755b451e21bfd4401c18285e083a62275b5ce703da24181359eb4c944a253d7a
Deleted: sha256:99d7891d48cc443d6a358f439bcb816e8f63a5a4166eb66018f8aafb545cbe61
Deleted: sha256:742212c51b4fa0330dd442f77987923982fce8ec8a8f4b038269799f6e85fa5f
Deleted: sha256:4116c836156cce9c256a44381d775d3fb81874e482d27d41d4f03e6ab14b7413
Deleted: sha256:1b451daf9296fdd500b861c4bd69c7f0f056ea198a39c688648b29c03f2ae376
Deleted: sha256:653aa0a6eb689e8027d533e6b1ffec694dd347ef2c076fb85da91e4bf717b99f
Deleted: sha256:88803eae37b618e212a51bb786f5cba2e2146bd044bc547df57c1775a3f2be0c
Deleted: sha256:43c2bd393d3acc9a1b7c5265b971810b3b4806904ee29a14fb9ccb623b59574c
Deleted: sha256:161519c15be22dec82353e02d8cd659ea59c9e0968b732efd53b36a50f422a99
Deleted: sha256:df03f1ee02980630a6b5e0866e087b39f8feb8cd12825079e7a3bd06c6dab936
Deleted: sha256:8df9b413828447252c33c404bae3f208731b607bd0123fa6ff1a20e0f0bade79
Deleted: sha256:2eae11648cf0e833a0aa5fa537bdb137a6e803bb503c47a25987c3d6316bf00e
Deleted: sha256:a9127daf293d01d77c8b25679942ab522b83c39a0a09b2cd938a41e45c453c5d
Deleted: sha256:54412efe6e4c0989acd62b77f4c1b9d29e5b64c3a2255175c136d8c2d17ec0c0
Deleted: sha256:6342b180381f682ade34d6a59e41cd52dabdbe95c195a34a840fbb733705eeea
Deleted: sha256:5c6d687965d08f82ef52d826547684a4d9e5a80d9c57a3854dbdab64ba27c0e3
Deleted: sha256:5ad6714552931d9ee90e4453eef7d7465b8bf12d42a428ffb25188a2e6f50090
Deleted: sha256:b0e3593ac21cf088eeb970fc7a77a9c254f5de6108f36877fb2dc311c1e1d81b
Deleted: sha256:9c4f3c24c8a13abdf3c7b6a0ea62a4cf12ed36bb4f3e63bc6fb95b9b737dba53
Deleted: sha256:ad32abdb1ac0340b5efc9eaef5c7fa05853d478c58d7db41259b15b74d473b18
Deleted: sha256:037a659cddcf04b255fefdd01d5d2766058e7e9860fa4b2e1127813361981af2
Deleted: sha256:ed1326f60212ece16cda2a087309a7489ea34b1801b4bbac1830be1349036bd6
Deleted: sha256:7766963ebeec99526aca40459c6141564f8c861b501be2da419e69ff433fa5dd
Deleted: sha256:b3972f01df7b241581aca4ca02d6df52ed4360e2748c8c39dd4ab9da00c8fde4
Deleted: sha256:b2707cc50924e988bea57821522349ce7842076e4c796871986b3fc39bebfad7
Deleted: sha256:a79a39c1c763f77f22fd89300af620927a4cfda3bc8451d95b74df0d5a29a1a9
Deleted: sha256:304cec98013b85aef225aac5ac3a16eee9ed7f09e0b6fda43e26d17126339de4
Deleted: sha256:cb21fddc667612b85b76af32fdb4426c6cc2ba8a58656a9e6e38b442a4f5628e
Deleted: sha256:90e38ca5281d9c7081f5b891ce22171db61d6ef2995d74fcecb098cb534b70ac
Deleted: sha256:af2c7163de2757cbc53dc96b92806e22df6a4cdee2de2b0b263d0f822957e057
Deleted: sha256:79ffe215c22a97517a0eb0c863ba18fd7adf1b029639d9bfaa2cc4f6ea813a53
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316123318]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:755b451e21bfd4401c18285e083a62275b5ce703da24181359eb4c944a253d7a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316123318]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:755b451e21bfd4401c18285e083a62275b5ce703da24181359eb4c944a253d7a])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:755b451e21bfd4401c18285e083a62275b5ce703da24181359eb4c944a253d7a
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:755b451e21bfd4401c18285e083a62275b5ce703da24181359eb4c944a253d7a
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:755b451e21bfd4401c18285e083a62275b5ce703da24181359eb4c944a253d7a].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 31m 29s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/iccchbawqaoje
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
