See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/265/display/redirect?page=changes>
Changes:
[ihr] [BEAM-13923] Fix the answers placeholders locations in the Java katas
[jakub.kukul] [BEAM-14039] Propagate ignore_unknown_columns parameter.
[stranniknm] [BEAM-14079] playground - improve accessibility
[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week
[noreply] Fix import path
[noreply] [BEAM-13925] Fix one more import path
[noreply] Add a StatefulDoFn test that sets event time timer within allowed
[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support
------------------------------------------
[...truncated 278.25 KB...]
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service_impl.cc:921
Mar 11, 2022 3:20:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:20:31.270Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:21:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:21:32.605Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:22:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:22:36.188Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:24:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:24:35.412Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:28:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:28:41.155Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:31:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:31:42.285Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:34:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:34:47.712Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:35:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:35:48.281Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:38:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:38:49.029Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:45:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:45:53.455Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:46:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:46:53.335Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:47:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:47:58.228Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:49:50 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:49:49.167Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:53:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:53:51.247Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:55:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:55:05.938Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:57:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:57:05.928Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 3:58:12 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T15:58:11.090Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Mar 11, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T16:00:36.136Z: Cancel request is committed for workflow job:
2022-03-11_04_25_13-2697398580205998321.
Mar 11, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T16:00:36.170Z: Cleaning up.
Mar 11, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T16:00:36.247Z: Stopping **** pool...
Mar 11, 2022 4:00:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T16:00:36.295Z: Stopping **** pool...
Mar 11, 2022 4:03:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T16:03:28.291Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Mar 11, 2022 4:03:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-03-11T16:03:28.337Z: Worker pool stopped.
Mar 11, 2022 4:03:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-03-11_04_25_13-2697398580205998321 finished with status
CANCELLED.
Load test results for test (ID): ed5ffc48-ad25-441b-b03d-fceff55b1058 and
timestamp: 2022-03-11T12:25:04.330000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 12229.036
dataflow_v2_java11_total_bytes_count 8.11597714E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220311122302
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f4b21658507218ae65c1485d9b53d51b4b8fe8f2393699daeab86436ca739044
Deleted: sha256:96122d37d6e6adc51177932c87462faef06d551d636cc9ca2fdd7bcfcdd687a1
Deleted: sha256:55c39dc1b5794c2b1fdc8112596ca37fcd338fb7c7cd1d9ade3237beb1c2d713
Deleted: sha256:a229771769211344a82b20ce9ecd7303062b423e5f7e99b105e8f19ea38db718
Deleted: sha256:34c62519456ad3d4656bfcb5ae08ba35cad8065bedbc1c9aaafea625faa042ce
Deleted: sha256:4b10d07fb2704e492bcdf49107042e8a560094349a7202a12820a849a782cd67
Deleted: sha256:78a69a0ed18680da9f47d438964e9b16fbb1243b4631f82e9899e0d9ad87aaef
Deleted: sha256:985aad93946525a675d1c87e082c717af146264eefcd6e86dea42bd02899cdb6
Deleted: sha256:62cc4adc95253e03ddf5d7b84fe5975bdd3b8f7ee63f190c5852d4a083814276
Deleted: sha256:6dd547d3d67f649200c27bd5dd272816b951168ef2781a4c44dc63cc86268ee9
Deleted: sha256:3e920d2fdf02e35edf7be0b0c59256d432cfa6bff2888717044ea9c8af1aace0
Deleted: sha256:89e4671aa2ede7ae30e631dd47d8839cb5334cec21e00e6f44bc08b0d61f50f8
Deleted: sha256:c77354290fa7046777eb3eca25f2412d51619fe3104f4ec0befaddc0afa74eb9
Deleted: sha256:bee8220c5f86d6b3beb6636baf59bb4a279238b5d7a26445d78bb6dc1e3d0bdf
Deleted: sha256:96befb5c442bf5fb908df49877e771209a18b33c92d5a81338f448be10d9c904
Deleted: sha256:9ab99c132f6bdefb443b2a9817a55416289ac1c430c070426385b2031eb8dbc3
Deleted: sha256:0478adf40c821ee46334ddfba93561257e19e733c27fb7ce0ce6f87b0614baf6
Deleted: sha256:68bacc3c265989eb50871ac25d31df20388086678e43b4945efd4caf3af218f6
Deleted: sha256:75578467c0adf00690331232275f403d3980b8ef2c52ea18df64ce165bb13bee
Deleted: sha256:8ed46be2b5cfbe8cbbc3dfa3ed29a9c9a916fd8bf68ad7ab9a0fb701d69bec21
Deleted: sha256:601177cea7da2d96ca98b6cc19c75c87e628be67ec55c011b38bebedd7af5b12
Deleted: sha256:d16bd48c4bcf038a6d38aea7da1a7efa15f5a74a6ee315c9a9b8d47887285b33
Deleted: sha256:4511bde80dd8b2d8a60ccabba4a9de76d735d8659d1c40281a53ed85f9f8a6e3
Deleted: sha256:2a7bdf1233802ca6be5e13ccba06b2d0b60c6291b2f77ca88aa28ecf159393d9
Deleted: sha256:beedbe4522ac9d11839f40dc1c9bda7b041f8db321698f6c6f10d21ae084e260
Deleted: sha256:34accea16ede836b5a554bd6f1d0d73fe4fafed19626468e21e318f08cab2e0e
Deleted: sha256:4d409c58438372ef571cdd620d59eb76b75a455ee197aa554606b615f92b19e5
Deleted: sha256:220de064fe836364576831e8167b200e294a6a10c56eda5c2908bcc97e8d509e
Deleted: sha256:6c9d8145c0310172f66ecd42ea05eb0cbcb2f7dd64d430116aa0416a23d7f1a1
Deleted: sha256:c41053bf38f44276d6bc137a808cc5eb836f4f43207d5f01d51299089693f15e
Deleted: sha256:9c5aef292e63989811660f2f3b6cc95dd9a681a6e85f2419e8153acf77b1ee04
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220311122302]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f4b21658507218ae65c1485d9b53d51b4b8fe8f2393699daeab86436ca739044]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220311122302]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f4b21658507218ae65c1485d9b53d51b4b8fe8f2393699daeab86436ca739044])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:995d2d5d0ffc286e68644eeecff455c25dbc22f89f3164e7cb113ed06f4ab0f2
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:995d2d5d0ffc286e68644eeecff455c25dbc22f89f3164e7cb113ed06f4ab0f2
ERROR: (gcloud.container.images.delete) Not found: response:
{'docker-distribution-api-version': 'registry/2.0', 'content-type':
'application/json', 'date': 'Fri, 11 Mar 2022 16:03:45 GMT', 'server': 'Docker
Registry', 'cache-control': 'private', 'x-xss-protection': '0',
'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status':
'404', 'content-length': '168', '-content-encoding': 'gzip'}
Failed to compute blob liveness for manifest:
'sha256:995d2d5d0ffc286e68644eeecff455c25dbc22f89f3164e7cb113ed06f4ab0f2': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 297
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 40m 59s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/mch5xwkmb3txe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
