See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/237/display/redirect?page=changes>
Changes:
[david.prieto.rivera] Missing contribution
[noreply] [BEAM-13803] Add support for native iterable side inputs to the Go SDK
[noreply] [BEAM-11095] Better error handling for illegal emit functions (#16776)
[noreply] Merge pull request #16613 from Supporting JdbcIO driver in classpath
for
[noreply] Merge pull request #15848 from [BEAM-13835] An any-type implementation
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define
simple generators.
[Valentyn Tymofieiev] Add a container for Python 3.9.
[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner
[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites
unchanged for now.
[Valentyn Tymofieiev] Add py3.9 Github actions suites.
[Valentyn Tymofieiev] Py39 Doc updates.
[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid
branching.
[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.
[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable
default
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define
simple generators.
[Valentyn Tymofieiev] Mark Python 3.9 as supported version.
[noreply] [release-2.36.0][website] Fix github release notes script, header for
[noreply] Use shell to run python for setupVirtualenv (#16796)
[Daniel Oliveira] [BEAM-13830] Properly shut down Debezium expansion service in
IT script.
[noreply] Merge pull request #16659 from [BEAM-13774][Playground] Add user to
[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.
[noreply] [BEAM-13776][Playground] (#16731)
[noreply] [BEAM-13867] Drop NaNs returned by nlargest in flight_delays example
[noreply] Announce Python 3.9 in CHANGES.md (#16802)
[Brian Hulette] Moving to 2.38.0-SNAPSHOT on master branch.
[noreply] [BEAM-11095] Better error handling for iter/reiter/multimap (#16794)
------------------------------------------
[...truncated 149.37 KB...]
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
Feb 10, 2022 3:59:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-10T15:59:23.901Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Feb 10, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-10T16:00:36.178Z: Cancel request is committed for workflow job:
2022-02-10_04_25_00-9781934940325347197.
Feb 10, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-10T16:00:36.212Z: Cleaning up.
Feb 10, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-10T16:00:36.303Z: Stopping **** pool...
Feb 10, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-10T16:00:36.401Z: Stopping **** pool...
Feb 10, 2022 4:03:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-10T16:03:24.767Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Feb 10, 2022 4:03:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-10T16:03:24.828Z: Worker pool stopped.
Feb 10, 2022 4:03:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-02-10_04_25_00-9781934940325347197 finished with status
CANCELLED.
Load test results for test (ID): b41c15c4-c8e4-4a37-b320-39752ce7a3d1 and
timestamp: 2022-02-10T12:24:53.872000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 12354.719
dataflow_v2_java11_total_bytes_count 5.79918689E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220210122235
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a212e1966ec915d54e80c0a401938708c2a5af0c5597524fa5353db7fb6de96
Deleted: sha256:670e37e7a6f778014b8eca0dfa79e2d196adb496ab77eead5b8532fc403439f5
Deleted: sha256:f9bad78cf46bea690de81ef0eada3a2f399eaa5b7dd98a1afdf4bae69e75aa1e
Deleted: sha256:8f1cad8a20f8d4eb9d65348a4ba5915055e2eeb715021e58ba23a460e29951dc
Deleted: sha256:22fba32aac4beba15e140b4ac1c7d398bc8d3fcf6b47e891e505154a7cc5db6c
Deleted: sha256:62cb17abba71e8a2890507a87b06af46bea0a6a137fa51a39fad70c7b7228c15
Deleted: sha256:f148e345fade689059fd79a5a31c1636758b5a7ccdfd2a8cb098e39b57e6db7c
Deleted: sha256:3707cc610d8c4d6719bf60a3a9d4e1703acba8e64e19419a7d7ba74d581bb076
Deleted: sha256:5571e080389e049db0a0a8da789ea7c9ee49ebc05e63a69a3c6500276d11842d
Deleted: sha256:82b6414fa3c7a431237e295dc33ede7ad1b45e50743e6d298d189e26c49522f4
Deleted: sha256:013b45149528cfdf1909aed477151f06489ce2bd8fd548e375c5209bf33f60ba
Deleted: sha256:e4f4e7024d355dc9e9cbdb2dca9f2b7e0c9cd67ad6d6a250c63011fb39ea2eb6
Deleted: sha256:524947a52526db5f3331ae3b24b1399f60280988848872fc348945a9f1e23452
Deleted: sha256:6d29af3cb50a02cb02f2b26c7fccc0873aae2d1fa0530fe16110c135df95d1ef
Deleted: sha256:147a386e6793f03231b9a537482cf578e68b1f127bc02c51432369d41d71d50e
Deleted: sha256:2ad0951329b35b3407398f059085974af051e02e3a8b0c1b83ef2a1358d1f75e
Deleted: sha256:719287b4cdbe778beb577fecc614246502b7f705f7682d169cdf78644ef94a64
Deleted: sha256:8f98bb4f5702e6211075710e8e1204f6c59914784f6aef1be0ab0b94fd828e11
Deleted: sha256:2d304d0d7f3ad82663868026168aad87da8505a9e8b7d0df56a7ffb62caf8455
Deleted: sha256:740de1687f1877334e379211fe6d52c5b7b6082378d0b63923e1e5bee14d6279
Deleted: sha256:7f9529811f737e030de509dc4fa43bc6fdbc119c83569446915d8f463eaed54b
Deleted: sha256:214fa155e7fda1c85deff4672b2dd6b8442c4bd0210155007f715be5faf649cb
Deleted: sha256:27d82f6e190a8dd3b1baf7de51d533983b9a255ab79594728931a9bc91285036
Deleted: sha256:35159c832b40f95ffc3daa3cdf9e07cddb0e879430377bb510ba6040d0129c7a
Deleted: sha256:4867b38bdab8dc0edcc9e74bf2af8f24cfd21f844fd6ee8b409c0995f07ad13f
Deleted: sha256:856ad03e3f51f048921f120d425ace1ab4771b0132d92be37563e18d4adaf129
Deleted: sha256:66e71b23e12de44c3481034868df9f94c53cc3b660719ef9120257d35ff61409
Deleted: sha256:6ed7ce6725ad81c619cad3b1abb17838de688e62ff9ae35755ad3b761d45f432
Deleted: sha256:98b4c2034dc89418b4255c63432f8f1f53221a8016649a1ebf51f50fb511282e
Deleted: sha256:1049818625670fe755cf23e1dc19a80f1c0cbecafefaf1f3f2cc141293f7690e
Deleted: sha256:9e487c019af51e2a52d37e5175df81afecde31ef6b532fada3ad18a25f7e3446
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220210122235]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a212e1966ec915d54e80c0a401938708c2a5af0c5597524fa5353db7fb6de96]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220210122235]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a212e1966ec915d54e80c0a401938708c2a5af0c5597524fa5353db7fb6de96])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2642030ba0f5eed8d59183e20b0b8eceddb1daa09e7aadfdaa7f3b85b9420151
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2642030ba0f5eed8d59183e20b0b8eceddb1daa09e7aadfdaa7f3b85b9420151
ERROR: (gcloud.container.images.delete) Not found: response:
{'docker-distribution-api-version': 'registry/2.0', 'content-type':
'application/json', 'date': 'Thu, 10 Feb 2022 16:03:38 GMT', 'server': 'Docker
Registry', 'cache-control': 'private', 'x-xss-protection': '0',
'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status':
'404', 'content-length': '168', '-content-encoding': 'gzip'}
Failed to compute blob liveness for manifest:
'sha256:2642030ba0f5eed8d59183e20b0b8eceddb1daa09e7aadfdaa7f3b85b9420151': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 297
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 41m 19s
109 actionable tasks: 75 executed, 30 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/phw5r6c4575he
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
