See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/284/display/redirect?page=changes>
Changes:
[vachan] Update display data to include BQ information.
[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to
[chamikaramj] Convert URLs to local jars when constructing filesToStage
[Valentyn Tymofieiev] Ensure the removed option
prebuild_sdk_container_base_image not used on
[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline
[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for
[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test
[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test
[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)
[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll
imports
[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)
[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go
x-lang
------------------------------------------
[...truncated 322.97 KB...]
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
Mar 30, 2022 3:51:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-03-30T15:51:52.953Z: generic::cancelled: Data channel closed,
unable to send additional data to SDK sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
Mar 30, 2022 3:57:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T15:57:53.402Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 30, 2022 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:34.892Z: Cancel request is committed for workflow job:
2022-03-30_05_22_34-2869368923355700906.
Mar 30, 2022 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:34.937Z: Cleaning up.
Mar 30, 2022 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:35.014Z: Stopping **** pool...
Mar 30, 2022 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:00:35.090Z: Stopping **** pool...
Mar 30, 2022 4:03:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:03:05.378Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 30, 2022 4:03:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-30T16:03:05.441Z: Worker pool stopped.
Mar 30, 2022 4:03:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-30_05_22_34-2869368923355700906 finished with status
CANCELLED.
Load test results for test (ID): cb97dce6-99f1-4cd1-8701-8a24218bc1ba and
timestamp: 2022-03-30T12:22:25.650000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 9287.567
dataflow_v2_java11_total_bytes_count 3.48499309E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220330122011
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a8bbfd91890edfcf3892085d75bb0ccfb28f5254983209013ae8b16aa5a988f
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220330122011]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a8bbfd91890edfcf3892085d75bb0ccfb28f5254983209013ae8b16aa5a988f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220330122011]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a8bbfd91890edfcf3892085d75bb0ccfb28f5254983209013ae8b16aa5a988f])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a8bbfd91890edfcf3892085d75bb0ccfb28f5254983209013ae8b16aa5a988f
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a8bbfd91890edfcf3892085d75bb0ccfb28f5254983209013ae8b16aa5a988f
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3a8bbfd91890edfcf3892085d75bb0ccfb28f5254983209013ae8b16aa5a988f].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 43m 23s
109 actionable tasks: 73 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/bhdv42rmgnudu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]