See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/77/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985)
------------------------------------------
[...truncated 80.40 KB...]
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
Mar 07, 2022 12:37:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-07T12:37:41.364Z: generic::internal: The work item requesting
state read is no longer valid on the backend. The work has already completed or
will be retried. This is expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
Mar 07, 2022 12:37:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-07T12:37:44.730Z: generic::internal: The work item requesting
state read is no longer valid on the backend. The work has already completed or
will be retried. This is expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:697
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:230
Mar 07, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-07T16:00:42.300Z: Cancel request is committed for workflow job:
2022-03-07_04_32_35-1741415835065682294.
Mar 07, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-07T16:00:42.392Z: Cleaning up.
Mar 07, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-07T16:00:42.474Z: Stopping **** pool...
Mar 07, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-07T16:00:42.528Z: Stopping **** pool...
Mar 07, 2022 4:03:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-07T16:03:13.767Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 07, 2022 4:03:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-07T16:03:13.815Z: Worker pool stopped.
Mar 07, 2022 4:03:20 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-07_04_32_35-1741415835065682294 finished with status
CANCELLED.
Load test results for test (ID): 7edca3b4-634f-46d6-9e45-bf2e0241ce8e and
timestamp: 2022-03-07T12:32:30.154000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 12346.571
dataflow_v2_java17_total_bytes_count 3.00751037E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220307123036
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ea2121aa9be3ea55b9a124d683324c5cd577729dc50c7e67278536f571c46df
Deleted: sha256:3191ac007ae400def8a9bff7b0125fac17f369248a00d641626adfa51fcb570f
Deleted: sha256:4e2515d07d5a8e2b161f591d41d2fb873fb70b68814374638e147dd67d4401c8
Deleted: sha256:42f5c57242c4043f6c23ddb6fff9c1dbfdd79de736770aab61b55e13026fa854
Deleted: sha256:c82648a956b91775fabddbd4866b14c23b382b332020e4d6d8d9afc24100c97c
Deleted: sha256:6f9eed64dfa0dbce61f7c04532c59eeb894d34cb2ac288c90094f4679c8d9180
Deleted: sha256:94634b76d2cff6a2c6a63fa2ae1d572d5a6b33058946893582ba642612d65223
Deleted: sha256:051630fa3b8b7bdbaf80acc1dd62bf2ef172a47bf05ab8f5abcf51e9e0d261c1
Deleted: sha256:7b734bf6062f7d61f14dafc31710cbc819a44a1f53042a963edf997501512020
Deleted: sha256:46bea90fe529c441373f26594885a85650254414bf74a0ff2ee3557d04dfed7e
Deleted: sha256:6ddfbe1fdecab56db3c7dcdbfc4847007a75fea8c5df2b8c84db0352675142e5
Deleted: sha256:a6fac0aabe61754a6cd765ecf1cb401d37d83f6ff92a9e5c73342d923106dd59
Deleted: sha256:1e1290b777f532eef67eb0df1f86f9d1b9c7fffb3d6e8300cba92cb2c37de728
Deleted: sha256:eb52e793a2c98612e077424bcf02a832704b9a7881addd132ac530062eb2a86d
Deleted: sha256:1639921366c1a81d870536ef47950b102ec5ce4821604ec5fb2147394d9069c3
Deleted: sha256:4eca5426906287df5511e165b1a45c06193175eed32332b0a08f7088d229fadc
Deleted: sha256:090c90c7e61f60ed14150728e4badc42c87c7701da62e97f9eb210b197ca2745
Deleted: sha256:9c056d15e9789d0dffd7fe0e48da59257cda989834af7297cf135a8d9249fae1
Deleted: sha256:6fdf072c464124f2b9158cea3d0685a10cb7f6ccfa45d10b7763677e1fc08b40
Deleted: sha256:1f2baf1aa39ec7a006d4fc19b6a29b216fd91eed14cae94139e855de8a5944bc
Deleted: sha256:91d42a5f8b47a61090af171e4888aa9a75fbc210b79b74909b432c444c1fad3c
Deleted: sha256:8a4cbdc719bd82b0d1424842a997aa15c7e77f80ce06836da9681d8a944cec4c
Deleted: sha256:adf3a2ccbc278048fd33976962b7b7f19c6870bcc78f6bce3647212690ddd7db
Deleted: sha256:5389e927ec62379c3ccf18d532e43299bc17bc7d29e9bd2d96ba9569facef722
Deleted: sha256:0cc2615084baa78f34300ae6cfbc3bf8466fe7c3de816fa879ab2891f8a58070
Deleted: sha256:612f7e1d68b7baec8ed4fae6caab310c96c1a9e711966029e3ddc9981e8ecbb5
Deleted: sha256:42a3088ed62623b68a6b62672a7312f2a29eb646f2aefa5f1cd36c124bb26bfc
Deleted: sha256:546e0a6b1c2f4e49c564214efdd73d9363f78bf330c5cdb118e6842ec62ba632
Deleted: sha256:c4619e4b0e39ad66c79090a4f8dc77fd22772ae8a890c7c80b097e8c80606fea
Deleted: sha256:9911dba543e72380cd57a49fd5a13c2de89f70e741a12f0ace124bdd34370e1f
Deleted: sha256:45a93140ab8e9796a5f3859e7dd3aaabe2ff169d0f22d6c961d0ab77f5d88109
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220307123036]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ea2121aa9be3ea55b9a124d683324c5cd577729dc50c7e67278536f571c46df]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220307123036]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ea2121aa9be3ea55b9a124d683324c5cd577729dc50c7e67278536f571c46df])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ea2121aa9be3ea55b9a124d683324c5cd577729dc50c7e67278536f571c46df
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ea2121aa9be3ea55b9a124d683324c5cd577729dc50c7e67278536f571c46df
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2ea2121aa9be3ea55b9a124d683324c5cd577729dc50c7e67278536f571c46df].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 33m 4s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/lpytalftxnyey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
