See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/86/display/redirect?page=changes>
Changes: [noreply] Added type annotations to some combiners missing it. (#15414) [noreply] [BEAM-12634] JmsIO auto scaling feature (#15464) [noreply] [BEAM-12662] Get Flink version from cluster. (#15223) [noreply] Port changes from Pub/Sub Lite to beam (#15418) [heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the [BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for [noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494) [noreply] [BEAM-12802] Add support for prefetch through data layers down through [noreply] [BEAM-11097] Add implementation of side input cache (#15483) ------------------------------------------ [...truncated 516.02 KB...] Sep 11, 2021 3:53:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:01.191Z: Workflow failed. Sep 11, 2021 3:53:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:14.185Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:53:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:14.208Z: Workflow failed. Sep 11, 2021 3:53:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:27.615Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:53:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:27.632Z: Workflow failed. Sep 11, 2021 3:53:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:40.379Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:53:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:40.402Z: Workflow failed. Sep 11, 2021 3:53:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:50.292Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible. Sep 11, 2021 3:53:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:50.398Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible. Sep 11, 2021 3:53:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-11T15:53:51.195Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Sep 11, 2021 3:53:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-11T15:53:52.146Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24374 instances, 2/0 CPUs, 30/188441 disk GB, 0/2397 SSD disk GB, 1/274 instance groups, 1/277 managed instance groups, 1/503 instance templates, 1/603 in-use IP addresses. Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota. Sep 11, 2021 3:53:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:53.912Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:53:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:53:53.939Z: Workflow failed. Sep 11, 2021 3:54:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:06.246Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:54:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:06.284Z: Workflow failed. Sep 11, 2021 3:54:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:19.704Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:54:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:19.730Z: Workflow failed. Sep 11, 2021 3:54:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:33.026Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:54:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:33.042Z: Workflow failed. Sep 11, 2021 3:54:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:45.907Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:54:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:45.926Z: Workflow failed. Sep 11, 2021 3:54:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:58.886Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:54:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:54:58.904Z: Workflow failed. Sep 11, 2021 3:55:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:11.706Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:55:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:11.726Z: Workflow failed. Sep 11, 2021 3:55:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:24.092Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:55:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:24.113Z: Workflow failed. Sep 11, 2021 3:55:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:40.093Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:55:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:40.119Z: Workflow failed. Sep 11, 2021 3:55:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:53.091Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:55:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:55:53.116Z: Workflow failed. Sep 11, 2021 3:56:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:05.705Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:56:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:05.732Z: Workflow failed. Sep 11, 2021 3:56:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:18.110Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:56:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:18.130Z: Workflow failed. Sep 11, 2021 3:56:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:31.082Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:56:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:31.117Z: Workflow failed. Sep 11, 2021 3:56:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:43.707Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:56:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:43.723Z: Workflow failed. Sep 11, 2021 3:56:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-11T15:56:50.868Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Sep 11, 2021 3:56:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:56.840Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:56:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:56:56.879Z: Workflow failed. Sep 11, 2021 3:57:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:09.688Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:57:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:09.710Z: Workflow failed. Sep 11, 2021 3:57:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:21.855Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:57:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:21.880Z: Workflow failed. Sep 11, 2021 3:57:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:34.200Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:57:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:34.226Z: Workflow failed. Sep 11, 2021 3:57:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:47.144Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:57:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:57:47.189Z: Workflow failed. Sep 11, 2021 3:58:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:00.398Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:58:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:00.441Z: Workflow failed. Sep 11, 2021 3:58:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:13.228Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:58:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:13.251Z: Workflow failed. Sep 11, 2021 3:58:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:26.219Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:58:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:26.246Z: Workflow failed. Sep 11, 2021 3:58:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:39.307Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:58:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:39.329Z: Workflow failed. Sep 11, 2021 3:58:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:52.675Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:58:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:58:52.697Z: Workflow failed. Sep 11, 2021 3:59:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:05.506Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:59:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:05.530Z: Workflow failed. Sep 11, 2021 3:59:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:18.815Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:59:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:18.843Z: Workflow failed. Sep 11, 2021 3:59:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:30.952Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:59:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:30.969Z: Workflow failed. Sep 11, 2021 3:59:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:43.945Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:59:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:43.963Z: Workflow failed. Sep 11, 2021 3:59:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:52.306Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible. Sep 11, 2021 3:59:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:52.396Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible. Sep 11, 2021 3:59:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-11T15:59:53.210Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions. Sep 11, 2021 3:59:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:56.711Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 3:59:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T15:59:56.742Z: Workflow failed. Sep 11, 2021 4:00:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T16:00:09.614Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 4:00:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T16:00:09.633Z: Workflow failed. Sep 11, 2021 4:00:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T16:00:22.528Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 4:00:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T16:00:22.542Z: Workflow failed. Sep 11, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-11T16:00:33.644Z: Cancel request is committed for workflow job: 2021-09-11_05_17_34-13592588603459476124. Sep 11, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-11T16:00:33.670Z: Cleaning up. Sep 11, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-11T16:00:33.737Z: Stopping **** pool... Sep 11, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T16:00:34.920Z: Startup of the **** pool in zone us-central1-a failed to bring up any of the desired 5 ****s. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1. Sep 11, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2021-09-11T16:00:34.944Z: Workflow failed. Sep 11, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-11T16:00:34.991Z: Stopping **** pool... Sep 11, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-11T16:00:51.169Z: Worker pool stopped. Sep 11, 2021 4:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-09-11_05_17_34-13592588603459476124 finished with status CANCELLED. Sep 11, 2021 4:00:58 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric totalBytes.count, from namespace gbk Load test results for test (ID): 0a5aa553-fb56-4e9d-8984-bc4bccb27ed7 and timestamp: 2021-09-11T12:17:28.942000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 0.0 dataflow_v2_java11_total_bytes_count -1.0 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911121513 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ddfd51b3b869ae4e1d9f077c2f6e366e82f9b77f6a931e860266562ab074d846 Deleted: sha256:339e6e56bd4babc3a87e65c68b976a1fae20d2e3f6a7b70fc790dd4b20de8ba6 Deleted: sha256:8393033fc2ed3be6799dc306f0f28d187183a09179eba88f04d66c2855acb669 Deleted: sha256:3818a6d4a0bf3a5b419add708d26bc6be4662cd06081fcde2077065e134d123f Deleted: sha256:1889e04ee6e145b57fa5a3298d981aa9090da359820b3c5a3359f28dc13d6058 Deleted: sha256:37267a5ce10b640827b3510e8d1ebded528cd00f70aed84b1f7c194d30e59fcc Deleted: sha256:82a2716e7a663ea304f6345c49a1280198a621b70899d95e9779613f56e8ffba Deleted: sha256:3aae7aeaee71b1157ecd1afae89b01996baea37639ed046cbc0d6321b99fa597 Deleted: sha256:48324c9ce5f735f49cf19cfe28c357e892b75080e28c15240d0f1c8cbc4410c9 Deleted: sha256:de4bd0ca483c77cc2c54f3cb417194664f73b64e156e02bd7f6759f1c800be81 Deleted: sha256:7ccf0f6d26e95cb0d1b0d7f44d647e4d7823accb760f99b5a097672d06f3e225 Deleted: sha256:d4f45c047980392ff043bd4fe1b4066781c06c6fd5486fb109efd12906737410 Deleted: sha256:6f9309194f8ffc9ad5eeb25927be97cf78b3113eb47fe7f072be671a770fc158 Deleted: sha256:3ec2978218dc55cd93f66b122f665ea2f409347337d87bd9e8f74cc90cb40eda Deleted: sha256:1ecd9a5d97f2fd122bc80ce52ebd3c61cb5a0b4eed3e416202780097128a6638 Deleted: sha256:9f1fc933f1ee5b1be79b688479f93ddb51152bf14856d92c20a47a4867c2469c Deleted: sha256:b2c3d4b616a8c12b89b8b561cd376011d5a3891ecb41d4f2e5d01b4015ae75c8 Deleted: sha256:091949dfd3a1efb5f99152299065fd7bb40e01c2cd2eeba6e87f74123fceec9b Deleted: sha256:f2902004a00f701251be851d3845db38d95b90b6af63fa6275186d14eeba8858 Deleted: sha256:2a421d0958523fecb29883c3725691ba87dc260c7fb007dbfad908e248d1ef5d Deleted: sha256:9fe04704426e856a788f798362b862b95ea592c521776292261a9431ebb44b94 Deleted: sha256:e7e34fb056cb3f01a9775e07effee999480b99ef5a443e6aa7d6523449bca17c Deleted: sha256:f097419b5b441b314ca3f761150e574dc341746f51f248d7393adba57f18626a Deleted: sha256:637ebcb2709baa90087856a522de244ee0d18da9720281a35236320429967e7a Deleted: sha256:1eb94482a0ba848caf7932a80e85db87f50c349c88d43872e17fdb6f8e91b15b Deleted: sha256:7d43c52dbd1c6d256bae566df249e8f4c074939aecdb0704451d6e9fb55a1355 Deleted: sha256:1b565d5f5d0c9dab7d37d345cc232e84831183ceae009751e4f7b70e423511f9 Deleted: sha256:b77a99eb138a3cbe3a99038eb40091a86e98958efad7408a6a2e8b2bdc3711ab Deleted: sha256:604c7ff017e5e8c7d624a42cb5566554107a8bb8f40ad915bb391b765a1e430c Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911121513] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ddfd51b3b869ae4e1d9f077c2f6e366e82f9b77f6a931e860266562ab074d846] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911121513] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ddfd51b3b869ae4e1d9f077c2f6e366e82f9b77f6a931e860266562ab074d846])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ddfd51b3b869ae4e1d9f077c2f6e366e82f9b77f6a931e860266562ab074d846 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ddfd51b3b869ae4e1d9f077c2f6e366e82f9b77f6a931e860266562ab074d846 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ddfd51b3b869ae4e1d9f077c2f6e366e82f9b77f6a931e860266562ab074d846]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 46m 6s 101 actionable tasks: 72 executed, 27 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/tkbfasvravbcm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
