See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/148/display/redirect?page=changes>
Changes:
[Kyle Weaver] Update Beam website to release 2.34.0.
[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.77
[noreply] [BEAM-12550] Parallelizable kurtosis Implementation (#15909)
[noreply] [BEAM-13016] Remove avro-python3 dependency from Beam (#15900)
[Kyle Weaver] Prepare docs for 2.34.0 release.
[noreply] [BEAM-13133] Loosen partitioning requirement for sample (#15818)
[noreply] [BEAM-13228] fix data race in metrics.store (#15946)
[noreply] [BEAM-3293] Add binding cases for MultiMap side inputs (#15943)
[noreply] [BEAM-13222] Re-enable Spanner integration tests (#15948)
[noreply] Merge pull request #15926 from [BEAM-13110][Playground] Playground
[noreply] [BEAM-13025] Disable deduplicating messages, as Dedupe is broken on
[noreply] [BEAM-13001] collect DoFn metrics for Combine (#15911)
------------------------------------------
[...truncated 133.00 KB...]
INFO: 2021-11-12T15:32:32.991Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:34:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:34:33.858Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:37:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:37:33.870Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:39:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:39:37.430Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:41:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:41:41.831Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:44:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:44:41.948Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:46:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:46:44.742Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:49:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:49:46.024Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:53:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:52:59.923Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:53:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:53:58.804Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 3:56:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-11-12T15:56:02.841Z: generic::aborted: SDK harness sdk-0-0
disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Nov 12, 2021 3:59:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T15:59:50.983Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Nov 12, 2021 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T16:00:28.734Z: Cancel request is committed for workflow job:
2021-11-12_04_33_42-11789067374152280950.
Nov 12, 2021 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T16:00:28.810Z: Cleaning up.
Nov 12, 2021 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T16:00:29.038Z: Stopping **** pool...
Nov 12, 2021 4:00:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T16:00:29.151Z: Stopping **** pool...
Nov 12, 2021 4:02:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T16:02:44.910Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Nov 12, 2021 4:02:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-11-12T16:02:44.952Z: Worker pool stopped.
Nov 12, 2021 4:02:51 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-11-12_04_33_42-11789067374152280950 finished with status
CANCELLED.
Load test results for test (ID): 98ac57f4-7167-4e37-ad5d-3487157f507d and
timestamp: 2021-11-12T12:33:36.274000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 12226.536
dataflow_v2_java11_total_bytes_count 4.76568765E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211112123112
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ace0f7a61ac9cd90a2b02ddd94c9a65d328f629889731dfc4db758427d167f1
Deleted: sha256:572471fe049e5df9f4121360de768c96b8fb01bd5a417051155ce52eb0fd91e3
Deleted: sha256:039ac20daac6d4771d9cb300a0cc27a9f417c897918848080043e2e8bb5ec8fe
Deleted: sha256:02090ba33534a9b746f0b80cf284145dbb07c52bccba24c7279626d806528889
Deleted: sha256:6fa5c385248c44123c9e02c042cbb12855456b1484077dda808fe59c0a37fd9d
Deleted: sha256:12c69b5e63411ab6f5b645a2c98980e5659579bdece0dc6ea6df8c251ee05390
Deleted: sha256:387d1d01c4b2e5edd4fba9f537e8e36a37b0dca24f5ff69d70aa0e7b0d171aa8
Deleted: sha256:0e58022bcb1e97e59b9f427bcf06546543cc9872830b255fac120be03ecba0a7
Deleted: sha256:1765ee9ffcfe52962b51ccbc64a008fbbc44892bbfd72f5e52daa3549bf60db8
Deleted: sha256:ab6fa325489d47736f9918aca15def394a545cee89bba17434f536243322b65c
Deleted: sha256:329f236e1f35d090872ccb4ad933d86a0eecd4fa394f8a1338171055b00ea9bf
Deleted: sha256:c4c5247c7b804f82f69389ffd52aa80b1b7205660259ef17ec7ee26d33924770
Deleted: sha256:deb1d45ad344b6b58a5002a6613df82fd7c19149c4d44ff0460e2ea8c030fa80
Deleted: sha256:8c30edcb76a05bca2105050e3ba29eac83fbadc9e9c5f2a5be4cae890ecf924f
Deleted: sha256:dac2dc901df30c63649f7a319e3a557013b5b96591a72b9a9f962c0697456f23
Deleted: sha256:1cf32838c2c121c0b3e30ac6e1d1b840fee61a528589f50abed9afdf214e530a
Deleted: sha256:43cc826f37b884394b4204742f2e120e1aa0ab50a84351934ad0a46cc013f7d3
Deleted: sha256:dece442f5cf2050f05bfe5b6910cf0bb02c02e1e117b4b0d7a844a40963cdb71
Deleted: sha256:02d191edffd2717945ca1dc2818a1c3c6ad4d88ccda6a2a2cab377fa0c7ae960
Deleted: sha256:8da1e73708af670eef22bb992334e4de2495763e84774b9c9a43c6ff3a72fb8a
Deleted: sha256:bb1211db8c92d21003cdfb926ca22b14a4abe6e3d7997267891b553f1ce6f1bf
Deleted: sha256:0b4d816c56f396e47d24fdf1e5b0aeb0432471e2e137ce8b7f417fe44ce6342f
Deleted: sha256:0a1a7727d3baa5c2bd61745d3f2ea8c68077e9cffdf656229814bcf37e6d2396
Deleted: sha256:a0e32b19e744abb8d6b1dc776d5c8b5edcfde10ea31c0b42eb468624f5a2a3d6
Deleted: sha256:199af7b01d131439be2f2aa40fc48520cb31338f166e39d576c90755d6e3d6f8
Deleted: sha256:08b95c522429d3dd20adc8351729c93d65a16a678c9fe227981b3a8b0a52ff32
Deleted: sha256:3c974ab10466db0de779778765da64b85ef9b7f7545999e620dfa793538c3c7c
Deleted: sha256:0d86042c4080a8172da46c6bebf28dd119d33c627ea33cafb0c9ac52a11e687d
Deleted: sha256:fdc54751d6451a2a400c5d96ea415777c8f1b86f933180c13dc95cd0ce7a7203
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211112123112]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ace0f7a61ac9cd90a2b02ddd94c9a65d328f629889731dfc4db758427d167f1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211112123112]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ace0f7a61ac9cd90a2b02ddd94c9a65d328f629889731dfc4db758427d167f1])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ace0f7a61ac9cd90a2b02ddd94c9a65d328f629889731dfc4db758427d167f1
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ace0f7a61ac9cd90a2b02ddd94c9a65d328f629889731dfc4db758427d167f1
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9ace0f7a61ac9cd90a2b02ddd94c9a65d328f629889731dfc4db758427d167f1].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 31m 59s
101 actionable tasks: 71 executed, 28 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/onsl4wi4wl3im
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
