See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/30/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-12596] Ensure that SDFs always report a size >= 0. [noreply] [BEAM-2914] Add TimestampPrefixingWindowCoder as [noreply] [BEAM-11934] Remove Dataflow override of streaming WriteFiles with ------------------------------------------ [...truncated 66.32 KB...] fe6a4fdbedc0: Waiting e4d0e810d54a: Waiting 79c550eb7bd2: Waiting bc6c81dcc6ca: Waiting a92926ced994: Waiting dda53d9c1a11: Pushed a073c68bb67d: Pushed c8440f3187d9: Pushed aa442e406acb: Pushed a92926ced994: Pushed b7a3db87e2c9: Pushed bce8bcb5d0c4: Pushed ad280a8d6c30: Pushed 6ea995e9b7d3: Layer already exists c0848348e2f7: Layer already exists 79c550eb7bd2: Layer already exists 7095af798ace: Layer already exists bc6c81dcc6ca: Pushed fe6a4fdbedc0: Layer already exists e4d0e810d54a: Layer already exists 6dffe5eabcc0: Pushed 4e006334a6fd: Layer already exists 5bef82b88264: Pushed 146a0de8a36f: Pushed 20210717124332: digest: sha256:5484b61b93b8e0706b0cea3cdffe3855eb244da5593d741a6089bb44ed7cbe42 size: 4310 > Task :sdks:java:testing:load-tests:run Jul 17, 2021 12:48:24 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Jul 17, 2021 12:48:25 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged. Jul 17, 2021 12:48:26 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Jul 17, 2021 12:48:26 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Jul 17, 2021 12:48:28 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Jul 17, 2021 12:48:28 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <112699 bytes, hash 3498cdc7336301c0e6edb693710bf9cbc0a5fb32d72e02c9b6e33542a24de106> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-NJjNxzNjAcDm7baTcQv5y8Cl-zLXLgLJtuM1QqJN4QY.pb Jul 17, 2021 12:48:29 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution. Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Jul 17, 2021 12:48:30 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3c3c4a71, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1352434e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4f9a6c2d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2b6fcb9f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@75de6341, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74170687, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68f0f72c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3d96fa9e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3b545206, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@77bb48d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@181d8899, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12d5c30e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@b887730, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@26586b74, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@52f57666, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6e041285, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@267dc982, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@439b15f2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3aa41da1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74fab04a] Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s3 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Jul 17, 2021 12:48:30 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@44ed0a8f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@32177fa5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@a96d56c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6ab4a5b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2abe9173, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@235d29d6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1fdca564, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@43f9dd56, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1d12e953, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@57cb70be, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2d4608a6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@20d87335, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2a8a4e0c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@26c89563, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3bd6ba24, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58f437b0, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@20f6f88c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4277127c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c7e978c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@354e7004] Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Jul 17, 2021 12:48:30 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.32.0-SNAPSHOT Jul 17, 2021 12:48:31 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-07-17_05_48_30-1666522210892877877?project=apache-beam-testing Jul 17, 2021 12:48:31 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-07-17_05_48_30-1666522210892877877 Jul 17, 2021 12:48:31 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-07-17_05_48_30-1666522210892877877 Jul 17, 2021 12:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-07-17T12:48:36.614Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0cogbk01-jenkins-07-52wi. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jul 17, 2021 12:48:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:41.187Z: Worker configuration: e2-standard-2 in us-central1-a. Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:41.826Z: Expanding SplittableParDo operations into optimizable parts. Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:41.849Z: Expanding CollectionToSingleton operations into optimizable parts. Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:41.913Z: Expanding CoGroupByKey operations into optimizable parts. Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:41.978Z: Expanding SplittableProcessKeyed operations into optimizable parts. Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.011Z: Expanding GroupByKey operations into streaming Read/Write steps Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.068Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.176Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.199Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.233Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.277Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.326Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.351Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.376Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.412Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.445Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.469Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.498Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.534Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.558Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.589Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.636Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.672Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.699Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.731Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.765Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.796Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.831Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.877Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:42.912Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Jul 17, 2021 12:48:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:48:43.327Z: Starting 5 ****s in us-central1-a... Jul 17, 2021 12:49:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:49:00.468Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jul 17, 2021 12:49:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:49:27.771Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Jul 17, 2021 12:50:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:50:17.169Z: Workers have started successfully. Jul 17, 2021 12:50:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T12:50:17.196Z: Workers have started successfully. Jul 17, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T16:00:34.933Z: Cancel request is committed for workflow job: 2021-07-17_05_48_30-1666522210892877877. Jul 17, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T16:00:34.986Z: Cleaning up. Jul 17, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T16:00:35.061Z: Stopping **** pool... Jul 17, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T16:00:35.123Z: Stopping **** pool... Jul 17, 2021 4:02:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T16:02:53.154Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Jul 17, 2021 4:02:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-17T16:02:53.190Z: Worker pool stopped. Jul 17, 2021 4:02:58 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-07-17_05_48_30-1666522210892877877 finished with status CANCELLED. Load test results for test (ID): 3f046189-2045-4be5-861b-40e5e81ed5a4 and timestamp: 2021-07-17T12:48:25.635000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 11389.307 dataflow_v2_java11_total_bytes_count 8.1641618E9 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210717124332 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5484b61b93b8e0706b0cea3cdffe3855eb244da5593d741a6089bb44ed7cbe42 Deleted: sha256:95efd1e876d9074ed650ba0da86ff0e6ea80312bc92288ba729b05ea094aacdc Deleted: sha256:b8b0e76e3954958f89cdc4215a8e386370e4825569265bd787f4612649b4fe37 Deleted: sha256:ad125c9db6685625db5b663cff330ee4e7bf5193a5efadef5e9d13199cd2d0d2 Deleted: sha256:8a2c6041fafad8302e701966cc3ad30423c933997a3ec1cc9454b38f287164be Deleted: sha256:2e172a836a5ed046097567a4022f39fa33ff4eacc5a3584ee13ba0ace77b5a1b Deleted: sha256:b3bdea5b36051c0f9ff0e062ead1cb1163592d6ded7c52826ab2037abc2e91c3 Deleted: sha256:13e19e8bfa32fdf34d086806d323cf8addcf2a7dd41504555a5a420d6d81b0d3 Deleted: sha256:6e0bf9fe0e692474d4a2df1af6a6f1bda1530bf93e2ed3ae04e218992bf56d17 Deleted: sha256:75b0cfebf48fa011616abcc86d294d5bbc31e39501424a7333e7730eb6a6d491 Deleted: sha256:e14257f92c27cc718a492009f493c5f8fcedcead741bc4f11a345a501e1286a9 Deleted: sha256:a38390176b20278c769e1e4dbc164ab2ee42d7616c0b97a641199f30fd6dc088 Deleted: sha256:1b81df8e109727710dd89e372f70eabb07d2c96ecc1d49e708e5e257e01e3e2d Deleted: sha256:09373127cb7bf9a916288ad343e70a3954601d5b9cbf4812d3af34cf2abc29e0 Deleted: sha256:a550a646b8e5e659588004716b3f20afa1e5f6cd4406ab0f2bd25d395d1d28ed Deleted: sha256:f27ac035b43d830648b4eca0027a38ca2028372f7a3035e687f426a238e3147f Deleted: sha256:87cd4a9f34dfb78b59c774816b77fc2b3ef1d1facde990823181de1525f7b495 Deleted: sha256:f2f390434ed4f425691136ace14d14035484cbf950d6bd8c3bf31839f732f76b Deleted: sha256:f4d93ac65f1fa50f897d567682989cdf4ffa42db04d903459dba54ea4ed0fbe1 Deleted: sha256:9945a3ec210cff6aac995ec85777191aa79939bb7e55d6a2dacfa84f08299086 Deleted: sha256:61d4ba18a67c06efb7964949ddf6aed6b9ac9721c8cc2762f121b5895384c6c1 Deleted: sha256:59f4c872e2ea9dd6ec8508c73cf5ddc0760187426630d3834f96123683d6c150 Deleted: sha256:63c6d73222b646086677ccb77c926b10b3f53dc0eefe209354a0bba5b6b91cfe Deleted: sha256:366a34d48858ee4c973c1b0939e49e34b759f30d776e54af90c9843197a7aefc Deleted: sha256:72c37679eec0c0af0bbda8adb601fbc723aa65699ac9ef3cf18f6dce587a675a Deleted: sha256:966844de7ed7f5d3f21311c790be38757f2573018e592bfb1f1ca1dac97393a7 Deleted: sha256:11a29667e908ae9d3d8d018d5cec7a8c2e8dba8dc494810268736b4d255e9740 Deleted: sha256:b22f5c5eec1c06ce2b5a2a4df5b43b6320a36f12ee8044ac809c16dd28c94a96 Deleted: sha256:988de39561020a3f5827aaa7044f4ff4f7fb1d2ab78ea19dae2a666c0575114d Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5484b61b93b8e0706b0cea3cdffe3855eb244da5593d741a6089bb44ed7cbe42 Associated tags: - 20210717124332 Tags: - us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210717124332 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210717124332]. Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5484b61b93b8e0706b0cea3cdffe3855eb244da5593d741a6089bb44ed7cbe42]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 19m 42s 107 actionable tasks: 78 executed, 27 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/hlb2n4iywxuje Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
