See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/114/display/redirect?page=changes>
Changes:
[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.
[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for
Java
[noreply] Fix test ordering issue (#17350)
[buqian] Do not pass null to MoreObjects.firstNonNull as default value
[ningkang0957] [BEAM-14288] Fixed flaky test
[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)
[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container
[Heejong Lee] [BEAM-14300] Fix Java precommit failure
[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"
[noreply] [BEAM-13982] A base class for run inference (#16970)
[ningkang0957] Enumerates all possible expected strings when asserting
[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on
categorical
------------------------------------------
[...truncated 86.64 KB...]
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
Apr 13, 2022 1:53:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-13T13:53:09.585Z: generic::aborted: SDK harness sdk-0-0
disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
Apr 13, 2022 1:54:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T13:54:16.596Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 1:58:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T13:58:21.118Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:00:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:00:31.200Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:01:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:01:27.132Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:08:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:08:30.467Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:09:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:09:29.253Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:22:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:22:29.559Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:23:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:23:33.311Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:31:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:31:37.186Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:32:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:32:39.027Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:39:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:39:39.666Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:43:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:43:40.840Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:45:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:45:46.409Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:50:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:50:46.917Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:52:50 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:52:48.083Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 2:57:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T14:57:52.901Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:03:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:03:55.419Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:05:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:05:56.039Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:13:02 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:13:01.342Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:20:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:20:02.597Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:21:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:21:57.429Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:27:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:27:06.880Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:29:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:29:10.704Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:36:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:36:12.543Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:43:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:43:12.152Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:45:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:45:15.851Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 3:59:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T15:59:18.985Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 4:00:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T16:00:24.392Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 13, 2022 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T16:00:32.038Z: Cancel request is committed for workflow job:
2022-04-13_05_59_52-789103847040762562.
Apr 13, 2022 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T16:00:32.065Z: Cleaning up.
Apr 13, 2022 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T16:00:32.153Z: Stopping **** pool...
Apr 13, 2022 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T16:00:32.209Z: Stopping **** pool...
Apr 13, 2022 4:02:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T16:02:36.550Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Apr 13, 2022 4:02:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-13T16:02:36.598Z: Worker pool stopped.
Apr 13, 2022 4:02:42 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-04-13_05_59_52-789103847040762562 finished with status CANCELLED.
Load test results for test (ID): 947c31a8-aaa0-442d-98a5-2f3d4f7a6e97 and
timestamp: 2022-04-13T12:59:45.628000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 3659.421
dataflow_v2_java17_total_bytes_count 4.58536314E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220413125744
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9b1034dd00c36f775e3b6fa831051119a01c657642db3a7c89735c227a5b893
Deleted: sha256:5f70f92719df6e1686e21e8c6272d1671e780d7e7058ab3df8b533dcdb9dd6af
Deleted: sha256:96d1ea15e3d2b86aa0a0efe5acb0eb25dc6ba95018281284a1d9a02080dad645
Deleted: sha256:1ff090f0d2413f1e5fadda7019e5b594f538ca4b11ee81f1b7b081d4e94da636
Deleted: sha256:d4907ecc799f06eb17578dc9dbc9473bd0f463bf47d4be8ea43bc7f4cf074551
Deleted: sha256:69025229efa0547ca69f9252c5387afbf11038e9fdbf4ce0cfd1a78028fed118
Deleted: sha256:d65619cf6fe89dfe3b3e22ccf71e327887650447e56dc32763d6ae08d7bd5b91
Deleted: sha256:e854a2c6d23c61fbd226bd6bc27e856709735c712e6e640e64a7ba61cc00a14a
Deleted: sha256:f47d3e53ef652c3ce14aa27db0a6676ac9fc562275d225bbefc1e895f6e8ab56
Deleted: sha256:41851f72ff708aa9cb24c9fd2d1b6465f06f8521ae9687186b95542225a0bad7
Deleted: sha256:9940bac71631c35ebd329498cb18a326d20f205082c69b1e38589be149e09f51
Deleted: sha256:f1277055f7658382e1858400c924f3b7b8e5d08539837b4da1a05d679aad498e
Deleted: sha256:1affb48e3fcce44e5b075d44c3de5932717148e9e144154d2d99517e58250d3a
Deleted: sha256:c87fdf7aa5d9fb6b4a125d42acd60ee7b37e76fe44d4550e065986c692cc6bea
Deleted: sha256:104d70da57d7faf277189a97262c29aabb80fb4f9467618ff3285e0b6197a9bb
Deleted: sha256:2abe7f1943981568ea617fbf1d21b5b691d2a22dcab4e2d3ec2165cf4d19cca2
Deleted: sha256:2ec8e9a26a926bf859bfc6bf120afa0da8e2a22d6012331b35c1e820fd54e048
Deleted: sha256:5505f6b6df62730fe566a672cbe007626da4b3197f264c18399cdc0e23134dc5
Deleted: sha256:df49a99ac7cb6ae448d16d5d0e506bd76a03886bf49abbf796ccf4551f96572c
Deleted: sha256:9ff79a96641ca48bc72c7e4457d9e1340c67ec222d3a12ea92e2948bce9ac751
Deleted: sha256:68d08fa15ecc7e816370c3cf61d19a329708d24b6f0b3791ce21ca37e34ba20f
Deleted: sha256:c197c82552bc5e131bf54f7011aab4bffda8bddfd2bbc2a96e8fb3e584948266
Deleted: sha256:02424dfdec7776bca5e57337cef1b93227f9bf22a26b5aebd66aa7d499153c39
Deleted: sha256:85b1dee0ad086e9f6382b47c742aadaad04358acfccfa618b4a44e298eb952e4
Deleted: sha256:e3dbadf7d9a645dd0b163f5abd3b2a4c7338668a15de81b0e0a69e6104ea5cf7
Deleted: sha256:f0157d86237699dad604719d741185bda15c041b74d8609451a1a0eb60c17d74
Deleted: sha256:8cf6019c4f6a9a62ca0589f6797ba1a59a1b4072343b99b5ae8fd8d10b586775
Deleted: sha256:256a620036553345e86706ac07ec2ec728ac7aae534c9b3d19deef65a7ad7876
Deleted: sha256:ffd2b3d04a7dd836b5f812fbb9ce13662a9e436443c0bf37602dd240f89b5394
Deleted: sha256:3d1b6921cdf4bede4b7d852d4250e64596be682ac3a4d1aa8b6855e92daf2248
Deleted: sha256:43a98a06e8b4edfaa632a523e1e5eb2fcea03b38b4c5c92b6110b49d086bf1e1
Deleted: sha256:542d5823c8e00c4b0be13c228630150aa28f2d79a7e61bb58a69b9974d43ebcc
Deleted: sha256:5c51073a44b4261b71ee56781f3d9940a5dc4793bdde854ebbf5cb146193772c
Deleted: sha256:54e010ef6ef6634128ef192bc7ffd757bf12d9280de78cbaa82c4b1971cae209
Deleted: sha256:61fe25e24d755212839bb29ea3d20548b02fd87bae838618148895802956902d
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220413125744]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9b1034dd00c36f775e3b6fa831051119a01c657642db3a7c89735c227a5b893]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220413125744]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9b1034dd00c36f775e3b6fa831051119a01c657642db3a7c89735c227a5b893])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9b1034dd00c36f775e3b6fa831051119a01c657642db3a7c89735c227a5b893
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9b1034dd00c36f775e3b6fa831051119a01c657642db3a7c89735c227a5b893
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b9b1034dd00c36f775e3b6fa831051119a01c657642db3a7c89735c227a5b893].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 5m 22s
110 actionable tasks: 73 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/ho6rqpcp5c6ne
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]