See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/287/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14133] Fix potential NPE in
BigQueryServicesImpl.getErrorInfo
[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python
expansion service.
[Robert Bradshaw] Skip failing test for now.
[Kyle Weaver] [BEAM-14225] load balance jenkins jobs
[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause
[noreply] delint go sdk (#17247)
[Heejong Lee] add test
[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by
[noreply] [BEAM-14192] Update legacy container version (#17210)
[noreply] Fix mishandling of API with BQIO (#17211)
[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features
[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"
------------------------------------------
[...truncated 125.22 KB...]
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:922
Apr 02, 2022 3:59:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T15:59:30.033Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 02, 2022 4:00:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T16:00:27.636Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Apr 02, 2022 4:00:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T16:00:36.429Z: Cancel request is committed for workflow job:
2022-04-02_05_06_47-17354291679673962341.
Apr 02, 2022 4:00:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T16:00:36.480Z: Cleaning up.
Apr 02, 2022 4:00:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T16:00:36.541Z: Stopping **** pool...
Apr 02, 2022 4:00:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T16:00:36.584Z: Stopping **** pool...
Apr 02, 2022 4:03:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T16:03:27.245Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Apr 02, 2022 4:03:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-02T16:03:27.281Z: Worker pool stopped.
Apr 02, 2022 4:03:34 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-04-02_05_06_47-17354291679673962341 finished with status
CANCELLED.
Load test results for test (ID): 6122ad0a-7e90-4008-8396-013d60d088a4 and
timestamp: 2022-04-02T12:06:41.072000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 13575.976
dataflow_v2_java11_total_bytes_count 5.11028284E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220402120426
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd7fe1113e13927740a52d1258dc6f094cfe5c699e6dd4c7183b22d3db0f0537
Deleted: sha256:2fd6f1037f1cff7d8266073c9f7726e828cc94d5e4a92e5f0d89001df8e9370a
Deleted: sha256:20eb8fccf8f34d8c30873620e348494c6534dae293a244fe27a7bfa54a3c4103
Deleted: sha256:b193ff0abacea93e2f31d4838b9a03d4849447589dd79e4a5562b5dcc6e5e40f
Deleted: sha256:03662c15457636a281a345e0b16c0434f10ca7152df1e33eade42632cca6a297
Deleted: sha256:79b8a21d6cc0be9b82347b2bfdd3952f6c6667a5962220c0f770552a4dc28496
Deleted: sha256:529359fcba26b406859b7e93a624ca167963cc6caefc6faa4465f5a7010a2147
Deleted: sha256:1548ac7a894178cad9855fb026598841edddb5f68070dd061b340135aba85cd1
Deleted: sha256:e03030516e148802f17644619a6ba0932eb91fc578d0d301de417cd89af9bd09
Deleted: sha256:bdfdbfb62dfcb24f68e181dcb60481b7c933de9179680e2d0f991aac38f7b0f4
Deleted: sha256:9ef26867f2712448424b6a0a4b2407cb9449426075dc395008a883c51cd1d896
Deleted: sha256:7b35bd7a40abd2b8065c4cdf114d4ccd8234fa53dcf287cf214acd82bb4eb303
Deleted: sha256:a5c242ee2ddebe60449e7717748061cd426c3852a3384c7771f622d714bbe4a6
Deleted: sha256:b958210825d1c0365333c6583a1173f1adf68a04164c42c85e0a430054f64579
Deleted: sha256:8e30b324cadf9525c22e7a26c43f2bfd685b293abc77b7991bfc0f07341debd7
Deleted: sha256:14cc0c0af4b5bdbc6e5114b198a939b5c2dd8f0bc982dbc24cc2c02c3884d4be
Deleted: sha256:cde0f996887733c294562544d9d7e145135772307982dd8d1b6f95d090ecef97
Deleted: sha256:943fe37bfad3c4fe1f47d87220202c4baa038cb5d57b57649a318dc659996c72
Deleted: sha256:86747f273988cbcd96a93cf5dfc435dba4eb63c751ebaabe46feed44177b8587
Deleted: sha256:4f239574a9c7122d0eef33346e128c65d03fae941fc6fd026cab39a160eba13a
Deleted: sha256:26c47c89481853f37175dd60c9ce3f1ce28be3ba884e35b8f158afc17b115ccf
Deleted: sha256:0601638924cab2f636024a38b86e875607158ba1806f1d7f4fa8208b333e1f7a
Deleted: sha256:47436afd0a4a10da2ccd52e0acf54bab17537da906d126b695cfa51b7730e3e9
Deleted: sha256:5f84faecf9bac2ef15a98456136f0b4596063aaef63b89847310dea356d20631
Deleted: sha256:528815214ccbbad1dd02d5c0e02a8b3dc50e1011f1ad8ee230660cb0e19a4398
Deleted: sha256:dbb917fb148c58107ac5a448c6849f71b76a1df88d15e1ca08442e6b896610db
Deleted: sha256:4125405f6cfb897323c427be8f5893bef10f8ce147fd55e417f6ca866d3ccb44
Deleted: sha256:d6e2d8ba36b20d9a590deb25480b6714d6620834b78dddef5741380140cfde40
Deleted: sha256:923ed20c787526784ddaf77be4b99466ec27e95c728c4ef6613f0e3e794d6b2d
Deleted: sha256:b01df2725ab9a45e597b41df582c8d4e13bc5d73fd653e07732c40177e77b14b
Deleted: sha256:5cbea70e4ec96d4d5d20241f9aaa25a8bc8c8260bab5e207fbc9f32b2b0a149b
Deleted: sha256:ff855aa763260b41361b966bc4aad262fad6d2e81f58386c94f6c3be0b3e71f4
Deleted: sha256:ebeea41fdbe2f64ed5ffdee4b8e402c000809ff8fd20f9f9b2b95c42ea75bc63
Deleted: sha256:371932c95b015e276a3907410d7eceff8526b494b6cc719061a756ddd89f0f11
Deleted: sha256:e7f404a8352e7d979e7ae4afe3a8f59fce2f107703fb89624f3a3914014f19c0
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220402120426]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd7fe1113e13927740a52d1258dc6f094cfe5c699e6dd4c7183b22d3db0f0537]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220402120426]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cd7fe1113e13927740a52d1258dc6f094cfe5c699e6dd4c7183b22d3db0f0537])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a6752f6848708ce25e8f8fded3a5f3300fcbfeb6509dac9b638252cffba48ee
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a6752f6848708ce25e8f8fded3a5f3300fcbfeb6509dac9b638252cffba48ee
ERROR: (gcloud.container.images.delete) Not found: response:
{'docker-distribution-api-version': 'registry/2.0', 'content-type':
'application/json', 'date': 'Sat, 02 Apr 2022 16:03:41 GMT', 'server': 'Docker
Registry', 'cache-control': 'private', 'x-xss-protection': '0',
'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status':
'404', 'content-length': '168', '-content-encoding': 'gzip'}
Failed to compute blob liveness for manifest:
'sha256:0a6752f6848708ce25e8f8fded3a5f3300fcbfeb6509dac9b638252cffba48ee': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 297
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 59m 17s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/h7v3t574dwcek
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
