See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/270/display/redirect?page=changes>
Changes:
[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged
jars
[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored
java
[dhuntsperger] adding a list of example pipelines
[dhuntsperger] removing unnecessary `ls` command from maven project generation
[dhuntsperger] fixing filename formatting in response to feedback
[dhuntsperger] adding extra step emphasizing runner setupt
[dhuntsperger] reorganized instructions to emphasize setup steps for runners
[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…
[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support
[noreply] Adding pydoc for StateHandler (#17091)
[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)
------------------------------------------
[...truncated 306.06 KB...]
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
generic::cancelled: Data channel closed, unable to receive additional data from
SDK sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
Mar 16, 2022 3:46:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T15:46:49.832Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 16, 2022 3:49:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T15:48:53.293Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 16, 2022 3:51:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T15:51:57.091Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 16, 2022 3:55:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
getJobWithRetries
WARNING: There were problems getting current job status: Premature EOF.
Mar 16, 2022 3:55:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
WARNING: Failed to get job state: Premature EOF
Mar 16, 2022 3:55:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T15:55:58.169Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 16, 2022 3:57:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T15:57:00.968Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 16, 2022 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:32.700Z: Cancel request is committed for workflow job:
2022-03-16_05_16_11-7353234500814861904.
Mar 16, 2022 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:32.743Z: Cleaning up.
Mar 16, 2022 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:32.853Z: Stopping **** pool...
Mar 16, 2022 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:00:32.905Z: Stopping **** pool...
Mar 16, 2022 4:03:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:03:26.566Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 16, 2022 4:03:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-16T16:03:26.635Z: Worker pool stopped.
Mar 16, 2022 4:03:34 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-16_05_16_11-7353234500814861904 finished with status
CANCELLED.
Load test results for test (ID): 8aa03bbc-b705-4938-ad43-8366a9bb7693 and
timestamp: 2022-03-16T12:16:05.611000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 5123.757
dataflow_v2_java11_total_bytes_count 4.61565525E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316121352
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9720f5c329fd5cae5e5b9199256dc6a52ba9149a9341e370e9de3d30c712e7c1
Deleted: sha256:fa999a4719d08334f50e47e0b2e71149c3aa11560064c29a0b73afc2eb2492aa
Deleted: sha256:0cc7d9fb398a334016b72cb8a88bf3afc04d45350a546769d106655856b9e257
Deleted: sha256:8f29045eb2c09704a333a04c1b41a3e1f42500b3f49e5de6bd477115fd48d451
Deleted: sha256:4a3e0aecb75bf2203679f5876467e9447f1caed9c4e9cde54bd8f5b53b9680da
Deleted: sha256:198ba9ba0326b0548306cf21b93427da0ae480c77d456b3e4410cbfbb39df394
Deleted: sha256:2cec4c2783c792ffceb41943f7ee0a96884e3884e013579d1b1948b88382b79d
Deleted: sha256:1836a6dce42989bc63c3c2444f2cf6be08401e4993df5a75e8217b184046a871
Deleted: sha256:9ec1298da7f0be010c4a3a06cab9a798ad78ec1cce58a254e92ba4114b4a8e06
Deleted: sha256:959aa19229e5763339a659c5d0c85a5ea48a1ff8a93bf96c1136418d2a44f1f8
Deleted: sha256:b0fa5baf409e5f3b7314b5cf09d5f9003094718da69679faf7e28e86ff66b5c2
Deleted: sha256:3bed65cd05964b7e5d3a15ea98cc55da85e018e981ea03119110e5010b2ef557
Deleted: sha256:e57dce19489d0777a716dc641d488685b34c1e264f913675e457faffe8e6d7fb
Deleted: sha256:6718b0104f6f3e410a84bdcc2a853c446181c3d9dec57051920bb42c8041b38c
Deleted: sha256:d3154a6c400b66086145af412c997b3fcd9145099c4f10e0fc4c769953fb86f8
Deleted: sha256:8cd03a02450db0bfb4f620a7f5dfce9fecc5b556b446c6c0beb950c6277567e2
Deleted: sha256:69cdb8dc2e18de2a90f3ef4d5915abc3601b42cc5b03832a7f9f5d5573512643
Deleted: sha256:22cd8b15bd71b388056c6660862afa39b2a66ec3bf70ad4c0ecd52ae8753f459
Deleted: sha256:b409d30aeaa813b4af59a767f9131e93ca8233c6ebbb3506d3b69f65ac416703
Deleted: sha256:18f86cafab623a0c4ad8e590a077acc4d1af61a2876c3305d9bf33a9949702fb
Deleted: sha256:ec00a230a4aa4772b9ed42b85ed13a8cc53c32206d2cacdd51903cfcaa416ff8
Deleted: sha256:157a651f51a35d3cf9510c8a52f48461ad7c11049aa5cdf6032b5175c5edf54f
Deleted: sha256:2f91a19fe8868f75e627a83f0589275936c13d030959f2e391266f4f282a62b6
Deleted: sha256:09ac8e1fc6850a478efa94df38062f7f8dff00a63ec0ddfe3081c482a155e9e5
Deleted: sha256:51f8b0439d310f25653bbfe42371d024f894f0f84936e95921bbe80a3f915759
Deleted: sha256:97f2c481487f09321c36ac254c2d385fbb596bbde54948d6d26acf20e630e4f9
Deleted: sha256:8459c21b5493af453a884cef807c5a7f1c4d9dbb674f0e60ac3db32a09d43fb1
Deleted: sha256:be202c43736ac98408c3f1c41bbbf0fd51d2c24d5ae6fad4c8e586f28cd3ade8
Deleted: sha256:2c6bcca64d3850d95ecca9c8fe80615e871f1c82af7c44b9ca4280586cbeb69d
Deleted: sha256:5fd4b779a3c6b86b335d95a678bebb1038bf1c19088cad63d034ae9ab9c6c11a
Deleted: sha256:cf827dd876348785222a71f09f2e2312579fba0dbbbab75829029350d64df071
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316121352]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9720f5c329fd5cae5e5b9199256dc6a52ba9149a9341e370e9de3d30c712e7c1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220316121352]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9720f5c329fd5cae5e5b9199256dc6a52ba9149a9341e370e9de3d30c712e7c1])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9720f5c329fd5cae5e5b9199256dc6a52ba9149a9341e370e9de3d30c712e7c1
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9720f5c329fd5cae5e5b9199256dc6a52ba9149a9341e370e9de3d30c712e7c1
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9720f5c329fd5cae5e5b9199256dc6a52ba9149a9341e370e9de3d30c712e7c1].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 50m 8s
109 actionable tasks: 74 executed, 31 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/qtoxlcizdzdhc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
