See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/235/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12976] Log projection pushdown optimizations.
[benjamin.gonzalez] [BEAM-12572] Change jobs to run as cron jobs
[Ismaël Mejía] [BEAM-13839] Upgrade zstd-jni to version 1.5.2-1
[mmack] [BEAM-13840] Fix usage of legacy rawtypes in AWS modules
[alexander.zhuravlev] [BEAM-13820] Changed color of delete icon in pipeline
options dropdown,
[noreply] [BEAM-11971] Revert "Fix timer consistency in direct runner" (#16748)
[noreply] [BEAM-13193] Aggregates fn api outbound data/timers of different
[noreply] [BEAM-13767] Migrate a bundle of grade tasks to use configuration
[noreply] Merge pull request #16653 from [BEAM-12164]: Add integration tests for
[noreply] Merge pull request #16728 from [BEAM-13823] Update docs for
SnowflakeIO
[noreply] Merge pull request #16660 from [BEAM-13771][Playground] Send multifile
[noreply] Merge pull request #16646 from [BEAM-13643][Playground] Setup running
[noreply] [BEAM-13015] Add state caching benchmark and move benchmarks to their
[noreply] [BEAM-13419] Check for initialization in dataflow runner (#16765)
[noreply] Merge pull request #16701 from [BEAM-13786] [Playground] [Bugfix]
Update
[noreply] Merge pull request #16754 from [BEAM-13838][Playground] Add logs in
case
[noreply] [BEAM-13293] consistent naming for expansion service address and flag
[noreply] Merge pull request #16700 from [BEAM-13790][Playground] Change logic
of
[noreply] [BEAM-13830] update dependency for debeziumio expansion service
(#16743)
[noreply] [BEAM-13761] consistent namings for expansion address in Debezium IO
[noreply] [BEAM-13806] Shutting down SchemaIO expansion services from Go VR
[noreply] [release-2.36.0] Update website/changelog for release 2.36.0 (#16627)
[noreply] [BEAM-13848] Update numpy intersphinx link (#16767)
[noreply] [release-23.6.0] Fix JIRA link for 2.36 blog (#16771)
[noreply] [BEAM-13647] Use role for Go worker binary. (#16729)
------------------------------------------
[...truncated 143.18 KB...]
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Feb 08, 2022 4:00:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-08T16:00:09.360Z: generic::cancelled: Data channel closed,
unable to send additional data to SDK sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Feb 08, 2022 4:00:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-08T16:00:43.643Z: Cancel request is committed for workflow job:
2022-02-08_04_39_32-9078526692141524023.
Feb 08, 2022 4:00:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-08T16:00:43.679Z: Cleaning up.
Feb 08, 2022 4:00:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-08T16:00:43.736Z: Stopping **** pool...
Feb 08, 2022 4:00:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-08T16:00:43.789Z: Stopping **** pool...
Feb 08, 2022 4:03:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-08T16:03:37.987Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Feb 08, 2022 4:03:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-08T16:03:38.043Z: Worker pool stopped.
Feb 08, 2022 4:03:44 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-02-08_04_39_32-9078526692141524023 finished with status
CANCELLED.
Load test results for test (ID): 983a3756-613e-4c82-9aa2-c7386d363513 and
timestamp: 2022-02-08T12:39:26.830000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 11494.488
dataflow_v2_java11_total_bytes_count 1.082248188E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220208123725
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bca0e4a6b80ad4dcc12b1a53059b1c2b1e0232b0e63284b10d519b68e08757a
Deleted: sha256:614d5fe1746224bc1cf577051254991d8ce4938ada80e4439f5bc98e49b269f8
Deleted: sha256:c934930f67493810ecd6fcae1c0d6b39646997177c555d270ea3b6aee5da401d
Deleted: sha256:23c62e6d2a4496338c3d312fedc709989f4b53ac1aee1c0d10e17cfd40414d32
Deleted: sha256:d7e50da53037c0b044c38f385054ebcd300559fab076291c964b4c99ce6ab9f0
Deleted: sha256:7ca9f7c26e17caebe306206390f765ead21ef1e0a0e5bf71c9f264c218d0be1c
Deleted: sha256:7aa71d4f5c34f192e1e62fc1fe63de01fa8487247429688829aed8acc8c26ca2
Deleted: sha256:6100f41480727cfb20d1a8354bdc2ab4ebc13bdb38145bf23461a6465cbdcdb0
Deleted: sha256:0411c638ec022dd4abc716f9a0a838fd1df4b45bb8a43b65b173b99d98f7277b
Deleted: sha256:a19dfb956ca1cbbb004c72d55eb1d8172d915aef795fd17399335a186777d3c2
Deleted: sha256:0e9fec3da3b005e634ebee0f9f3bf8d085cde0480a28b66bf8c56a3fb87897bc
Deleted: sha256:cd4ab277f3a18541db4cecfce7902013c5b304593d459a4bd86315011f7dc16c
Deleted: sha256:4ea32d75e2293d5629ceae71715dbcc2c94934c1d8a6774119daa55f01cff138
Deleted: sha256:0c819a185c75a12ec054389826277e33fb286b859cb003f36475eb4df3dc934a
Deleted: sha256:0461f0835038910426810a1825f7a4a605aac8c8614857791deb7691f29eb647
Deleted: sha256:9ddccf228f1889757bc395595280ce87db4748b00aabb9ca6722dc68d2f90689
Deleted: sha256:efdaf31d683c902439c1cefa14f7f57c3d426bebb948f0fb1742ce1d2dafe869
Deleted: sha256:0ea05ad6986ea54b2b39206df499168124cd332c1fa25b6dec6656585692f49b
Deleted: sha256:bf819f9858725ff4b903c75cde990404523df7d33cbaa43203ab37f332eefb79
Deleted: sha256:97b371a6b2b87684c0de1f07f5749e24c0f85f73293ace4cd2177b41dc8f4a83
Deleted: sha256:6a50ed9d3ee12496b7718f13b3533a9aed76a0034b3d1d1cff356e764a756f24
Deleted: sha256:0af9ea1acf30c7296409964e6aa612cea450164967686823c107b048b9d02fee
Deleted: sha256:8b3cd2212e2528e365d27030659cb0d461e2c91e09914717a2e371f6c14dc037
Deleted: sha256:3d66a001c0c16e07844655e4be827b0828462de29e8b5566e95af688b1840c7b
Deleted: sha256:10558cb5eca5a2e10ad546a3d38803e699e184c55281df1ce2afa4b787356a68
Deleted: sha256:370ce2d34a6f5fc4c8b058b3fece59748b09630e3325df6353dd55f4e3c061f0
Deleted: sha256:81898c48a36e3cd59e174415031cc5a9b8d2132e6af7d3f4823aff65521a662c
Deleted: sha256:fc7537f3c5086c93554deaa7838fb2d8a1fb88c5d4a02776a8bca158cc31c79a
Deleted: sha256:c385896911e529081b0c0a5e9eb0dda19efcfc6894c7c66d81ad45d0927468f2
Deleted: sha256:c0d6c972603fc82d1214a7c9bf765bb59d690139adbcc6e22cc3c595d56bfdcd
Deleted: sha256:7dcf0504e2500c39d6171e9d043499477a65a4d25360ac6fddfd4d2b3a0b85db
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220208123725]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bca0e4a6b80ad4dcc12b1a53059b1c2b1e0232b0e63284b10d519b68e08757a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220208123725]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bca0e4a6b80ad4dcc12b1a53059b1c2b1e0232b0e63284b10d519b68e08757a])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bca0e4a6b80ad4dcc12b1a53059b1c2b1e0232b0e63284b10d519b68e08757a
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bca0e4a6b80ad4dcc12b1a53059b1c2b1e0232b0e63284b10d519b68e08757a
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bca0e4a6b80ad4dcc12b1a53059b1c2b1e0232b0e63284b10d519b68e08757a].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 26m 40s
109 actionable tasks: 73 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/rerzlvylzpweo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]