See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/272/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.
[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner
[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)
[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,
[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.
[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource
(#17100)
[noreply] Populate environment capabilities in v1beta3 protos. (#17042)
[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in
BQ IO.
[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on
Dataflow,
[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)
[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.
[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)
[noreply] Merge pull request #16977 from [BEAM-12164] Added integration test
for
------------------------------------------
[...truncated 163.06 KB...]
dist_proc/dax/workflow/****/monitoring_info_view_creator.cc:66
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
Mar 18, 2022 3:21:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:21:39.290Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 3:22:50 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:22:47.637Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 3:23:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:23:51.678Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 3:30:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:30:51.708Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 3:31:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:31:55.226Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 3:39:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:39:57.267Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 3:47:05 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:47:03.220Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 3:55:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T15:55:03.763Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 18, 2022 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:31.175Z: Cancel request is committed for workflow job:
2022-03-18_05_25_40-920689439564387116.
Mar 18, 2022 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:31.266Z: Cleaning up.
Mar 18, 2022 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:31.355Z: Stopping **** pool...
Mar 18, 2022 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:00:31.419Z: Stopping **** pool...
Mar 18, 2022 4:03:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:03:08.836Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 18, 2022 4:03:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-18T16:03:08.887Z: Worker pool stopped.
Mar 18, 2022 4:03:16 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-18_05_25_40-920689439564387116 finished with status CANCELLED.
Load test results for test (ID): 53d20655-abea-4b86-82bf-752f4294075d and
timestamp: 2022-03-18T12:25:28.672000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 11167.246
dataflow_v2_java11_total_bytes_count 7.52310519E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318122159
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eed0f9e3c7a6d9224c2c2203be391fed443e1d1578828bd0a85cb8c91a5e605
Deleted: sha256:e1e7ecfbed83eb30be4b6954f819d5f53a7cb901bdda3118b15796112ec40f8c
Deleted: sha256:5ca338e6dd927ad5347141908b706541895effc26d2011e223b9a42d33d4366e
Deleted: sha256:a53e2cad22a94155af59f8effab5d42a5bbf57adda94a6ea0d9888fc8c602a2c
Deleted: sha256:f20882df31b4fba9cc817f3a1ace5f50ff9f40ebf9b88649a82fec70ea598d10
Deleted: sha256:1f220f95d25743f98881dad1cbdde8c3118a33dbcd01f33ff80a8edd50d295b5
Deleted: sha256:f075eba4d8be1cc89cd6ce0c54b527c067b35c9d9fc88495de9ade22577ae8b2
Deleted: sha256:b4e91f01a2c1cf725f7bd57dbe8e517d3c1cc286629b72e480aefef9c0466abb
Deleted: sha256:598277458dcd376f47fe675cf29bbaa8e1b53a2e3a2fb945592383da8eab98b1
Deleted: sha256:fc7d7d79e88db72831a63bb3b5a8499304df2d9bab2d6179645dca26201110e1
Deleted: sha256:e55a583f18f1d5779761f90929f28e8d38544376c5f6f0559ecb3e55b626d4b2
Deleted: sha256:275434e9a73e4cfd87e74bdaf930f86f8b0611d11a51a2ce62fd9f7679bb2d68
Deleted: sha256:683272a17b37b688a2faff717954ee01d9dd4d370e81906c3cc6590e272d12ea
Deleted: sha256:73797f405d01f4c07b160c42e747bc94033adc0cef783bb0b5c55d7c214c7372
Deleted: sha256:37054427b745f56494607f518cbffdcaea1b4ffcdb256588e700ecdbe1d3b46f
Deleted: sha256:dc7b963084ddee108febdc74ee4cbe01b59a2398386ed70c26757531c3f4320a
Deleted: sha256:ca0e93f02e21f31f144c46f1e41bc99d9a1baa097d166dd76bf1ad090f0f02a2
Deleted: sha256:218aee35196281261a43988061737afde0527c319ecf7c315e51c36dc5afba28
Deleted: sha256:b2be3c5345828a861fdeb356df0c243abf3d255762bcd9d4054e8b702c967ed0
Deleted: sha256:d2dc7d1622f05abaac066de9171e99d2f219ec46fb27a7e6b6d0b1c13a42be61
Deleted: sha256:d25237ebc8b02f970c89ab14a18576aa3b8e4f89949161f43ec8fd1686596d1a
Deleted: sha256:2ebafa383d0813ac454b683db41da5261357bcfe70d9469dde6ea5470b52f8b4
Deleted: sha256:0e7d9e6a33bd0dd8d70a997e4b40a40a4292fa88d81b4a615878a3796ca08839
Deleted: sha256:325ecfbe7db25af0829ec5b406b2cfcb7efd8549860db6b32283d10c0cfce56a
Deleted: sha256:6f81479ce569fadee32d46afe3434871f849a266a8fe778fabc5ca5edd7c0a83
Deleted: sha256:577f4dcb96c2765359470801593c6b0ba8628d3964e985a99981ba0d8f4d7a4e
Deleted: sha256:dc1baa7971e5facace1634177fe1d362fc054aa1d27a281c49c6c852c8c8677b
Deleted: sha256:e210b71b7c33f20a77dbb0dfd13ced82b8f34237f7af2f90a5b9028bc3f39731
Deleted: sha256:76cff1e7da97f9571dfa1cb98dea9b39e1d30b9c274e185d59c50abdbebda460
Deleted: sha256:022410455f9d2b73f2eb84ca3e24062737899a9bd13f227cc233c498d87830a1
Deleted: sha256:c363ddc92dfc8d04b06284d72c843b1ceda8274a6012c1e10dad8806e9168fed
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318122159]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eed0f9e3c7a6d9224c2c2203be391fed443e1d1578828bd0a85cb8c91a5e605]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220318122159]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eed0f9e3c7a6d9224c2c2203be391fed443e1d1578828bd0a85cb8c91a5e605])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eed0f9e3c7a6d9224c2c2203be391fed443e1d1578828bd0a85cb8c91a5e605
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eed0f9e3c7a6d9224c2c2203be391fed443e1d1578828bd0a85cb8c91a5e605
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6eed0f9e3c7a6d9224c2c2203be391fed443e1d1578828bd0a85cb8c91a5e605].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 41m 48s
109 actionable tasks: 74 executed, 31 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/5h2ig52pls6ha
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
