See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/51/display/redirect?page=changes>
Changes: [noreply] [BEAM-10212] Integrate caching client (#15214) [noreply] Merge pull request #15249: [BEAM-12690] Fix GroupIntoBatches watermark [noreply] Merge pull request #15246 from [BEAM-12685] Allow managed thread count ------------------------------------------ [...truncated 75.83 KB...] Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.769Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.799Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.834Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.871Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.903Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.927Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.951Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:33.975Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:34.003Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:34.026Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:34.061Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:34.085Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:34.116Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:34.151Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation) Aug 07, 2021 12:42:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:34.581Z: Starting 5 ****s in us-central1-a... Aug 07, 2021 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:42:54.220Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Aug 07, 2021 12:43:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:43:26.120Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Aug 07, 2021 12:44:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:44:21.803Z: Workers have started successfully. Aug 07, 2021 12:44:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T12:44:21.842Z: Workers have started successfully. Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:35.484Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible. Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:35.580Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible. Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:35.673Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible. Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:35.883Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible. Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:35.955Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible. Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:37.893Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible. Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:37.956Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible. Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:38.699Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible. Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:38.744Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible. Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:33:38.829Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible. Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:33:38.869Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:36:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:36:38.362Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:35.476Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible. Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:35.566Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible. Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:35.654Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible. Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:35.815Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible. Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:35.855Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible. Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:38.649Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible. Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:38.734Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible. Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:39.869Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible. Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:39.916Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible. Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:39:40.003Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible. Aug 07, 2021 3:39:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:39:40.039Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:42:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:42:38.200Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:35.290Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible. Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:35.365Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible. Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:35.436Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible. Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:35.600Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible. Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:35.642Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible. Aug 07, 2021 3:45:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:37.919Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible. Aug 07, 2021 3:45:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:37.981Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible. Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:38.887Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible. Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:38.953Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible. Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:45:39.075Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible. Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:45:39.123Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:48:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:48:38.954Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:35.325Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible. Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:35.397Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible. Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:35.506Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible. Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:35.680Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible. Aug 07, 2021 3:51:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:35.726Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible. Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:37.651Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible. Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:37.717Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible. Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:38.481Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible. Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:38.525Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible. Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:51:38.629Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible. Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:51:38.662Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:54:38.361Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:35.286Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible. Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:35.348Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible. Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:35.449Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible. Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:35.632Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible. Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:35.673Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible. Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:37.532Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible. Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:37.594Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible. Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:38.360Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible. Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:38.402Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible. Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-08-07T15:57:38.501Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible. Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T15:57:38.563Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 4:00:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-08-07T16:00:38.965Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T16:00:51.204Z: Cancel request is committed for workflow job: 2021-08-07_05_42_22-4749340171415216659. Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T16:00:51.236Z: Cleaning up. Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T16:00:51.327Z: Stopping **** pool... Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T16:00:51.369Z: Stopping **** pool... Aug 07, 2021 4:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T16:03:06.106Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Aug 07, 2021 4:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-08-07T16:03:06.138Z: Worker pool stopped. Aug 07, 2021 4:03:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-08-07_05_42_22-4749340171415216659 finished with status CANCELLED. Aug 07, 2021 4:03:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric totalBytes.count, from namespace pardo Load test results for test (ID): 7125aa17-2c1e-4703-ae48-ea84853cb7a3 and timestamp: 2021-08-07T12:42:17.347000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 0.0 dataflow_v2_java11_total_bytes_count -1.0 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141) at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53) at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210807123735 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9 Deleted: sha256:6a77f918a6f5254f633b157e7001897361367f7a8720206e7909ddd178969946 Deleted: sha256:1e1d53bc428c7c86d04a2075dc060265814a4216bd8e62dbb59f0b509e1a50f9 Deleted: sha256:e3cd5bc07c57592b01f27765c0ba6f2f7e15d835d9266579e7c17b71f38a706c Deleted: sha256:4472e11506710185fa5e5ec979484d2886d4fd3a673550267a118e92c1b36fc0 Deleted: sha256:1e539af4ffb74aff13a69e14760255eedbea214625f38a2b1439de9fa4f8ed14 Deleted: sha256:43b79d22a9dc6ce0fa11745b5764db999cc60bc70b33ad34ae92dc1cc1a75579 Deleted: sha256:25924679e88ea687e952024f96cd8cfe6bb842f09ff1c2b45ac9cfa209680eae Deleted: sha256:2bb451e68fd68e11694d066c0f5aaeb7490acda0fd61558d2ededf3f75ca583c Deleted: sha256:575e5ac9d11bf9dc23165b7fb623d0b8eccf8e95cc6afc2d20a20540acec1a59 Deleted: sha256:5451211fb69f347fe5537e3e1027dd9997adcacdbacac21f5dba13a5b5dd361b Deleted: sha256:75cfd4c5d447515bc465a96910100d06a9af499c8f719c9f98201886ee3ec5c5 Deleted: sha256:a77310a0c1f37432843d5ae38446fa1d2fda2c1c97ecec0471abf77e7cf964e8 Deleted: sha256:5aaf5d877bfe2d2018b804f9119f00829606376817b2e3801584e3bbdcf049ed Deleted: sha256:27b1ba9154b7962b9962c161c5f7820ce796b5cc593672036afa22e5b4405596 Deleted: sha256:34b53eeaeaf41e677b2a7ae457ac470199d257eb75610f49c3a7745316920b2a Deleted: sha256:f2ecf53a25eff314f9acfd9a95056a27051d59fcd28e1e47d44464dd5d7561dd Deleted: sha256:c85816b3f846d835aa936d7804b0e29d522cd55db136471a05e68feebffd07cd Deleted: sha256:fca7c06084f124b1d17c23f460d111d9edd11025c5b31714cb7de6d415837f7a Deleted: sha256:4e8e784c9b74c0fa057cc657802f444640af528d6f1c6be4486cb89f8224de8c Deleted: sha256:c8fad7149ce7ccf9fcb60fceede8b6a029ed0a35faaaed25517132fd1cff23d7 Deleted: sha256:49723a65319130508c9bc595d910debdc8efc030c89acf1dbcf084e992247b0c Deleted: sha256:9607ea7e1c8f39285f800b45564c649628a8826b60342b63eb7a6a6911817133 Deleted: sha256:a7350e4ec88ccbd34d19dc351e56361487f6101366bcdd12f977f4204d4ba179 Deleted: sha256:154727b52ddc0ebf87f67d97b21f6c1ef191567ee494a54343e8f0aca0ba587e Deleted: sha256:40e4228e5075b67c9deeaaa48074f5db9a0d5eaf4edee36906f9ef323adc4a9b Deleted: sha256:4c52575b67cee416664dc3586da0d5ae1727031a57b3230d7ca28e66822c8dfa Deleted: sha256:0b7a56cb92ffaa35e0a1533b810873fe9f12a5fd044216dc2c57f9d5652310fc Deleted: sha256:ee0a33a1d14c04760dfca115bcedbb97593ac7ef22164544d375bbcd757025b4 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210807123735] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210807123735] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 25m 54s 107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/iwkl425yososa Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
