See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/324/display/redirect?page=changes>
Changes:
[elias.segundo] Changing elegibility to AllNodeElegibility
[chamikaramj] Adds code reviewers for GCP I/O connectors and KafkaIO to Beam
OWNERS
------------------------------------------
[...truncated 65.08 KB...]
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 1:04:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:04:15.181Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 1:05:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:05:19.176Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 1:06:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:06:18.522Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/monitoring_info_view_creator.cc:68
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
May 09, 2022 1:06:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:06:24.634Z: generic::aborted: SDK harness sdk-0-0
disconnected.
May 09, 2022 1:07:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:07:30.731Z: generic::aborted: SDK harness sdk-0-0
disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
May 09, 2022 1:07:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:07:36.809Z: generic::aborted: SDK harness sdk-0-0
disconnected.
May 09, 2022 1:09:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:09:09.055Z: generic::cancelled: Data channel closed,
unable to receive additional data from SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
May 09, 2022 1:09:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:09:21.732Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:11:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:11:28.928Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 1:11:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:11:35.007Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 1:13:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:13:20.311Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:13:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:13:58.264Z: generic::cancelled: Data channel closed,
unable to receive additional data from SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
May 09, 2022 1:15:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:15:22.874Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:16:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:16:35.578Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:21:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:21:28.749Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:23:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:23:26.983Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:25:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:25:29.495Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:26:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:26:32.124Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:30:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:30:36.221Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:31:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:31:34.530Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:32:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:32:36.950Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:36:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:36:39.491Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:39:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:39:42.218Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:42:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:42:00.309Z: generic::cancelled: Data channel closed,
unable to send additional data to SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/monitoring_info_view_creator.cc:68
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
May 09, 2022 1:42:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T13:42:12.541Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 1:46:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:46:41.532Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:48:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:48:44.152Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:52:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:52:46.643Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 1:54:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T13:54:48.721Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:01:50 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:01:50.107Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:06:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:06:53.281Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:12:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:12:52.156Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:19:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:19:55.441Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:20:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:20:57.454Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:22:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:22:00.002Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:23:02 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T14:23:01.210Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 2:23:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T14:23:51.756Z: generic::cancelled: Data channel closed,
unable to send additional data to SDK sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
May 09, 2022 2:45:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:45:02.298Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 2:58:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T14:58:01.503Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 3:08:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T15:08:05.263Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 3:20:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T15:20:04.616Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 3:27:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T15:27:08.155Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 3:34:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T15:34:08.035Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 3:48:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T15:48:12.417Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 3:55:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T15:55:11.934Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
May 09, 2022 3:57:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T15:57:30.115Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 3:58:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T15:58:05.253Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/monitoring_info_view_creator.cc:68
May 09, 2022 4:00:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T16:00:22.359Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 4:01:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T16:01:00.436Z: Cancel request is committed for workflow job:
2022-05-09_05_06_39-11084831410983826923.
May 09, 2022 4:01:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T16:01:06.237Z: Cleaning up.
May 09, 2022 4:01:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T16:01:06.424Z: Stopping **** pool...
May 09, 2022 4:01:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T16:01:06.524Z: Stopping **** pool...
May 09, 2022 4:01:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-05-09T16:01:34.413Z: generic::aborted: SDK harness sdk-0-0
disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/monitoring_info_view_creator.cc:68
generic::aborted: SDK harness sdk-0-0 disconnected.
May 09, 2022 4:02:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T16:02:13.438Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
May 09, 2022 4:02:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-05-09T16:02:13.487Z: Worker pool stopped.
May 09, 2022 4:02:23 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-05-09_05_06_39-11084831410983826923 finished with status
CANCELLED.
Load test results for test (ID): 328232a4-9bf6-4d5b-a0c5-68c440f7950d and
timestamp: 2022-05-09T12:06:34.542000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 13652.913
dataflow_v2_java11_total_bytes_count 6.66241646E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220509120442
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f6bee9088060992872cb678965577d5e87ff9d443061afb9d251aba7320d56b4
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220509120442]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f6bee9088060992872cb678965577d5e87ff9d443061afb9d251aba7320d56b4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220509120442]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f6bee9088060992872cb678965577d5e87ff9d443061afb9d251aba7320d56b4])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f6bee9088060992872cb678965577d5e87ff9d443061afb9d251aba7320d56b4
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f6bee9088060992872cb678965577d5e87ff9d443061afb9d251aba7320d56b4
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f6bee9088060992872cb678965577d5e87ff9d443061afb9d251aba7320d56b4].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 58m 3s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/aftm5nqprtz56
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
