See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/180/display/redirect?page=changes>
Changes:
[Daniel Oliveira] [BEAM-13321] Pass TempLocation as pipeline option to Dataflow
Go for
[Robert Bradshaw] Better type hints for Count combiners.
[Kyle Weaver] Include name of missing tag in error message.
[stranniknm] [BEAM-13423]: fix frontend failure if no examples
[daria.malkova] change return type of 2 methods
[mmack] [BEAM-13441] Use quiet delete for S3 batch deletes. In quiet mode only
[noreply] Updating Grafana from v8.1.2 to v8.1.6
[daria.malkova] Docs for validators tests
[daria.malkova] change context type
[noreply] Merge pull request #16140 from [BEAM-13377][Playground] Update CI/CD
[noreply] Merge pull request #16120 from [BEAM-13333][Playground] Save Python
logs
[noreply] Merge pull request #16185 from [BEAM-13425][Playground][Bugfix]
Support
[mmack] [BEAM-13445] Correctly set data limit when flushing S3 upload buffer and
[noreply] Merge pull request #16121 from [BEAM-13334][Playground] Save Go logs
to
[noreply] Merge pull request #16179 from [BEAM-13344][Playground] support python
[noreply] Merge pull request #16208 from [BEAM-13442][Playground] Filepath to
log
[noreply] [BEAM-13276] bump jackson-core to 2.13.0 for .test-infra (#16062)
[noreply] Change Pub/Sub Lite PollResult to set explicit watermark (#16216)
[noreply] [BEAM-13454] Fix and test dataframe read_fwf. (#16064)
[noreply] [BEAM-12976] Pipeline visitor to discover pushdown opportunities.
[noreply] [BEAM-13015] Allow decoding a set of elements until we hit the block
------------------------------------------
[...truncated 291.19 KB...]
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Dec 14, 2021 3:26:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:26:07.361Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:30:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:30:07.960Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:32:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:32:08.653Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:34:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:34:13.661Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:35:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:35:19.177Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:36:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:36:20.066Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:42:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:42:23.246Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:44:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:44:25.457Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:45:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:45:28.823Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:46:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:46:33.481Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:49:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-12-14T15:49:26.522Z: generic::cancelled: Data channel closed,
unable to send additional data to SDK sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
generic::cancelled: Data channel closed, unable to send additional data to SDK
sdk-0-0
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:771
Dec 14, 2021 3:50:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:50:35.899Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:55:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:55:35.444Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 3:58:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T15:58:40.615Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Dec 14, 2021 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T16:00:32.888Z: Cancel request is committed for workflow job:
2021-12-14_04_24_43-15334816985745685270.
Dec 14, 2021 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T16:00:32.955Z: Cleaning up.
Dec 14, 2021 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T16:00:33.084Z: Stopping **** pool...
Dec 14, 2021 4:00:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T16:00:33.159Z: Stopping **** pool...
Dec 14, 2021 4:03:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T16:03:20.245Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Dec 14, 2021 4:03:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-12-14T16:03:20.287Z: Worker pool stopped.
Dec 14, 2021 4:03:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-12-14_04_24_43-15334816985745685270 finished with status
CANCELLED.
Load test results for test (ID): 6acfb2a2-95c7-4f97-bc87-a89e9a286392 and
timestamp: 2021-12-14T12:24:38.090000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 12334.594
dataflow_v2_java11_total_bytes_count 8.66848515E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214122210
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6b75498ff4eb10b3027da5465ac751664da30199e52f6c86e8663fc23dc16cf9
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214122210]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6b75498ff4eb10b3027da5465ac751664da30199e52f6c86e8663fc23dc16cf9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211214122210]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6b75498ff4eb10b3027da5465ac751664da30199e52f6c86e8663fc23dc16cf9])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6b75498ff4eb10b3027da5465ac751664da30199e52f6c86e8663fc23dc16cf9
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6b75498ff4eb10b3027da5465ac751664da30199e52f6c86e8663fc23dc16cf9
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6b75498ff4eb10b3027da5465ac751664da30199e52f6c86e8663fc23dc16cf9].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 41m 33s
101 actionable tasks: 70 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xxs3752dclckw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
