See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/9/display/redirect?page=changes>
Changes:
[noreply] [BEAM-9547] Add implementation for from_dict, from_records (#15034)
[noreply] [BEAM-11951] added "Differences from Pandas" page for DataFrame
(#15074)
[noreply] [BEAM-9547] reindex is order-sensitive (#15032)
[noreply] Minor: Fix incorrect s.apache.org links (#15084)
[noreply] Minor: Announce DataFrame API leaving experimental in 2.32.0 (#15053)
[noreply] [BEAM-9547] Add support for xs on DataFrame and Series (#15078)
------------------------------------------
[...truncated 105.58 KB...]
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
Jun 26, 2021 2:08:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T14:08:45.367Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jun 26, 2021 2:46:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T14:46:38.384Z: generic::aborted: SDK harness sdk-0-0
disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
generic::aborted: SDK harness sdk-0-0 disconnected.
generic::aborted: SDK harness sdk-0-0 disconnected.
passed through:
==>
dist_proc/dax/workflow/****/fnapi_service.cc:631
Jun 26, 2021 2:50:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T14:50:48.933Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jun 26, 2021 3:14:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:14:37.575Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:14:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:14:40.347Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:17:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:17:41.235Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:20:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:20:37.593Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:20:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:20:40.980Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:23:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:23:40.298Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:26:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:26:37.615Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:26:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:26:40.341Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:29:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:29:40.507Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:32:37 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:32:37.586Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:32:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:32:40.354Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:35:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:35:39.839Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:38:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:38:37.577Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:38:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:38:40.133Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:41:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:41:40.808Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:44:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:44:37.578Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:44:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:44:40.394Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:47:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:47:40.105Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:47:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T15:47:53.555Z: Autoscaling: Raised the number of ****s to 5 so
that the pipeline can catch up with its backlog and keep up with its input rate.
Jun 26, 2021 3:50:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:50:37.593Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:50:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:50:40.850Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:53:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:53:41.083Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:56:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-06-26T15:56:37.570Z: Staged package
amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar
at location
'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar'
is inaccessible.
Jun 26, 2021 3:56:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:56:40.083Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 3:59:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-06-26T15:59:40.438Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Jun 26, 2021 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T16:00:32.780Z: Cancel request is committed for workflow job:
2021-06-26_05_11_28-8730722346176071096.
Jun 26, 2021 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T16:00:32.810Z: Cleaning up.
Jun 26, 2021 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T16:00:32.873Z: Stopping **** pool...
Jun 26, 2021 4:00:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T16:00:32.914Z: Stopping **** pool...
Jun 26, 2021 4:01:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T16:01:22.371Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Jun 26, 2021 4:01:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-06-26T16:01:22.401Z: Worker pool stopped.
Jun 26, 2021 4:01:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-06-26_05_11_28-8730722346176071096 finished with status
CANCELLED.
Load test results for test (ID): a0ff6afb-7936-4eb5-897a-0243b6d50bb4 and
timestamp: 2021-06-26T12:11:22.136000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 12705.329
dataflow_v2_java11_total_bytes_count 3.743438802E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210626120535
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6e1638f5346c60ccb96290b596439402f1bb81f755d2fd79ae6a9678763b44c9
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6e1638f5346c60ccb96290b596439402f1bb81f755d2fd79ae6a9678763b44c9
Associated tags:
- 20210626120535
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210626120535
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210626120535].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6e1638f5346c60ccb96290b596439402f1bb81f755d2fd79ae6a9678763b44c9].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 56m 8s
104 actionable tasks: 74 executed, 28 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iymksvfwvwmri
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
