See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/20/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Fix typo in dataframes docs.
[aromanenko.dev] [BEAM-12583] Ignore testReturnsProcessWideMonitoringInfos()
until it
------------------------------------------
[...truncated 75.71 KB...]
INFO: 2021-07-07T12:12:38.528Z: Workers have started successfully.
Jul 07, 2021 12:50:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-07-07T12:50:24.955Z: generic::aborted: SDK harness sdk-0-0
disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
Jul 07, 2021 3:38:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-07-07T15:38:12.621Z: Staged package
beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar'
is inaccessible.
Jul 07, 2021 3:38:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:38:15.144Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 3:41:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:41:15.375Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 3:44:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-07-07T15:44:12.796Z: Staged package
beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar'
is inaccessible.
Jul 07, 2021 3:44:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:44:15.405Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 3:47:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:47:15.253Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 3:50:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-07-07T15:50:12.717Z: Staged package
beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar'
is inaccessible.
Jul 07, 2021 3:50:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:50:15.459Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 3:53:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:53:15.575Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 3:56:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-07-07T15:56:12.629Z: Staged package
beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.32.0-SNAPSHOT-o6SOFHYXQ-jGvY2B1i53ShUTQWh-3eejpXywmFFOCC4.jar'
is inaccessible.
Jul 07, 2021 3:56:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:56:15.406Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 3:59:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-07-07T15:59:15.185Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jul 07, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-07-07T16:00:34.190Z: Cancel request is committed for workflow job:
2021-07-07_05_11_02-2118297767247056467.
Jul 07, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-07-07T16:00:34.222Z: Cleaning up.
Jul 07, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-07-07T16:00:34.319Z: Stopping **** pool...
Jul 07, 2021 4:00:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-07-07T16:00:34.376Z: Stopping **** pool...
Jul 07, 2021 4:01:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-07-07T16:01:35.219Z: Worker pool stopped.
Jul 07, 2021 4:01:41 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-07-07_05_11_02-2118297767247056467 finished with status
CANCELLED.
Load test results for test (ID): f1f8feab-2b1a-40b6-a6dd-8661c3cbfad7 and
timestamp: 2021-07-07T12:10:52.046000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 2553.491
dataflow_v2_java11_total_bytes_count 5.63320306E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210707120541
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:69c92863669d7f9283c8ade79826b7f31d1de1415520d0e7f9414b71185291a7
Deleted: sha256:be07f2ab2fdc96beff791eae1b71e52d7e1f7f026dd3d7c2003d66e22e48230e
Deleted: sha256:de18b970626b6079c6d4667f7bbe78f2a089c9c93db86c3e12351c7c4f7d3308
Deleted: sha256:a0a768dd2629056541bbaf59ffa6ddee103e27be2e397b026b1372c8877f8030
Deleted: sha256:3d1293af42b7be539ba43b181d0ed53ba214684e551991f426007972d9da1fc1
Deleted: sha256:c9c2be0937045f4a2fb5ba68dc196513500a595873833e7bf2d2dcfc5d3ffd0c
Deleted: sha256:842074b5d7f6ec662f836219615858baea013aaf36b1df4872622938bb0acfa4
Deleted: sha256:2bf9b4e8f7b4a4e0dd9b90cc4443bde7ee10c1bb8f707fc55c6afb9950909325
Deleted: sha256:40c52305ed56aa25aedb8b525215bb8f2d2df41a7934f3a6346f4b6a7ce6a866
Deleted: sha256:33d55b877c4cc3f0826a3078763919ba42bbab68c0b904311e3fd2a2f6a57178
Deleted: sha256:00899e9ad6b89786a28ffae8267cb6772e6d48a77ca443391ac368947fa4acdd
Deleted: sha256:da773fd0a3a4f1ad40a307c373f22f38502b05bc7d48537540703bd480ef8153
Deleted: sha256:4bad3ca4babbfd5f059be3bbb457c26674a97c92af5d7c9345da4bf52450bdc5
Deleted: sha256:742e878c361bfb90a17d4f7fda71d355af401d997d0e419b2ad604234e5057eb
Deleted: sha256:4b09a5e9683cb266fa5f3f3913419d0ee0917952fe5b5325ed57ee91835b2c89
Deleted: sha256:4f31f3b0687d47f62cd065f289acea66ae26dc69bbc95a4d13edc80e0835610c
Deleted: sha256:2878006247ab0161fa7ca73b0b7922c57c9314ba222801fcfa31d1066e8cb62c
Deleted: sha256:c42c8f418c2e1f121194259bef593884d0e0928f2bc4e70eb0c11b71d890a7fc
Deleted: sha256:4d743edb2a28c8a3d1a77f8e4a90522218ccf6d0ecd4ebd7d36317cafed8c707
Deleted: sha256:03c93d8c6748a41884ba9a61887c3cd3a3c1314e26f7cc9e59d5279fae902f8e
Deleted: sha256:3c2fa26105f0bff6f5adc7081beed0f7defc8444d135081878e195f23a498d68
Deleted: sha256:2c94ccd01fcdb73817a2ba6324c08c73ed55c5df9d2a53df6ee6bea542e763d7
Deleted: sha256:404587a9d51908f5c79af51a4813ffdf3b6be11a81330a535e4264504d3d81eb
Deleted: sha256:f9898b4844aefd27980e1841a3dff28cb6585984eff7793cb207ac4dbc18a79a
Deleted: sha256:1e4e1c385f699530b8f01acf501486f0f9b1e5c986151fdcf87ad7efa7da68e6
Deleted: sha256:c774403ffffe70f8936a97f39382b6eab9137968a6d19cc602ef9db1e0b486f5
Deleted: sha256:7764902675ddfe57cd6bf09cf5a659731865b1d0fb6ed5011c64ef446e7dd96b
Deleted: sha256:4497db6ffd99b8808b4b44815020d5596f9bb6567ac9c75e1273208ddc4ea236
Deleted: sha256:b2b9b715eaf14aa88248a1c934f4ea97e0779739441371cbefb0f394d5b2e792
ERROR: (gcloud.container.images.delete)
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210707120541] is not a
valid name. Expected tag in the form "base:tag" or "tag" or digest in the form
"sha256:<digest>"
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 279
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 56m 21s
104 actionable tasks: 74 executed, 28 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iqezttbobcgmm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
