See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/77/display/redirect?page=changes>
Changes: [baeminbo] Fix apiclient_test unittest not to fail with no credentials [noreply] [BEAM-10913] - Adding new Grafana dashboard to monitor GAs post-commit [aromanenko.dev] Remove a template line [Steve Niemitz] [BEAM-12767] Fix handling display data in pipeline serialization [kawaigin] Updated Linux golden screenshots for notebook integration tests. ------------------------------------------ [...truncated 49.75 KB...] 05103deb4558: Waiting 062f9311b72d: Waiting a881cfa23a78: Waiting 9889ce9dc2b0: Waiting 1de5678f791d: Waiting c953594230a2: Pushed 8f7a95a2fe9b: Pushed dfb1d85d1b56: Pushed 1de5678f791d: Pushed 575b7bedee3e: Pushed f1177be33f24: Pushed 2f863c88b2af: Pushed 4f6c106ebd53: Pushed db15c90c0fb2: Layer already exists 80013b6a5075: Pushed f0a78adddb27: Pushed a62f4b6a21e8: Layer already exists 062f9311b72d: Layer already exists 9889ce9dc2b0: Layer already exists 21b17a30443e: Layer already exists 05103deb4558: Layer already exists a881cfa23a78: Layer already exists 839df4029537: Pushed e5637c6a3547: Pushed 20210902124342: digest: sha256:e4d0fb396672406793530cd45982f3abe648de9bf7206620c67ca72de29fcf16 size: 4311 > Task :sdks:java:testing:load-tests:run Sep 02, 2021 12:46:37 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Sep 02, 2021 12:46:37 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged. Sep 02, 2021 12:46:38 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Sep 02, 2021 12:46:38 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Sep 02, 2021 12:46:40 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Sep 02, 2021 12:46:40 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <112622 bytes, hash 50600cd8eae0c780183c9855075e877a6c0e0ed62c0d9a38aaf04d86aeb9cd82> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-UGAM2Orgx4AYPJhVB16HemwODtYsDZo4qvBNhq65zYI.pb Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution. Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Sep 02, 2021 12:46:42 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1f346ad2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@46a145ba, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7ab34619, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ae2db25, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@363c4251, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7afc4db9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1a1f5f71, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@63884e4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@524270b8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4acb7ecc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2a4f5433, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6812fa3a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@29149030, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@38b8b6c0, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68868328, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@173a6728, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1a22e0ef, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@67514bdd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3b920bdc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7f5538a1] Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s3 Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Sep 02, 2021 12:46:42 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7d78f3d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@a4b5ce3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@f5b6e78, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4b4eced1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@71926a36, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@216e9ca3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@75120e58, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@48976e6d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2a367e93, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7f6874f2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1a6dc589, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@697a34af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@70211df5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c5228e7, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@38e7ed69, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@806996, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@78b612c6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@257e0827, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@22752544, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@21ba2445] Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Sep 02, 2021 12:46:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.34.0-SNAPSHOT Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-02_05_46_43-16590442448644662931?project=apache-beam-testing Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-09-02_05_46_43-16590442448644662931 Sep 02, 2021 12:46:43 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-09-02_05_46_43-16590442448644662931 Sep 02, 2021 12:46:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-09-02T12:46:52.367Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0cogbk01-jenkins-09-zg4v. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:57.280Z: Worker configuration: e2-standard-2 in us-central1-a. Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:57.991Z: Expanding SplittableParDo operations into optimizable parts. Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.022Z: Expanding CollectionToSingleton operations into optimizable parts. Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.088Z: Expanding CoGroupByKey operations into optimizable parts. Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.169Z: Expanding SplittableProcessKeyed operations into optimizable parts. Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.205Z: Expanding GroupByKey operations into streaming Read/Write steps Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.263Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.353Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.404Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.451Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.484Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.519Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.554Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.584Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.620Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.646Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.677Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Sep 02, 2021 12:46:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.698Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.728Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.762Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.794Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.827Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.854Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.885Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.917Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.951Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:58.973Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:59.006Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:59.036Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:59.070Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Sep 02, 2021 12:47:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:46:59.472Z: Starting 5 ****s in us-central1-a... Sep 02, 2021 12:47:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:47:08.424Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Sep 02, 2021 12:47:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:47:39.287Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Sep 02, 2021 12:48:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:48:10.090Z: Workers have started successfully. Sep 02, 2021 12:48:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T12:48:10.122Z: Workers have started successfully. Sep 02, 2021 4:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T16:00:28.514Z: Cancel request is committed for workflow job: 2021-09-02_05_46_43-16590442448644662931. Sep 02, 2021 4:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T16:00:28.586Z: Cleaning up. Sep 02, 2021 4:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T16:00:28.658Z: Stopping **** pool... Sep 02, 2021 4:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T16:00:28.704Z: Stopping **** pool... Sep 02, 2021 4:02:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T16:02:49.680Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Sep 02, 2021 4:02:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-02T16:02:49.718Z: Worker pool stopped. Sep 02, 2021 4:02:54 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-09-02_05_46_43-16590442448644662931 finished with status CANCELLED. Load test results for test (ID): 9986c180-3701-4274-975d-5d3acea884a7 and timestamp: 2021-09-02T12:46:37.964000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 11474.881 dataflow_v2_java11_total_bytes_count 2.32144866E10 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62) at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210902124342 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e4d0fb396672406793530cd45982f3abe648de9bf7206620c67ca72de29fcf16 Deleted: sha256:1460b1bab3b162b0980f003e56d3fb27cc180d96347c946104514cb61bb73a5f Deleted: sha256:d1911753b0480ef323e537e1536d0b61c9a2934a37a0f3609cbe80b9d1f4740f Deleted: sha256:8c15d3e4ed96103f0703066102bbe33555de1339ea033734e330787ccd38a665 Deleted: sha256:9abe72867d080759bcef666feefada10b3faf5bf5270d0231cf9f7f3bafcbb9c Deleted: sha256:53071cf80e387b96ca0ebe5c62ec896cd64f66e316ca2e75e0e42498cd3fa15d Deleted: sha256:86212cc17ac3659642f766d7d9708c481061ca051523d678b916d40a2ee972d7 Deleted: sha256:f8fae6697db9e0ab71c8c1b7e59c659534486f500fc69d22ce9e1711f7c27b90 Deleted: sha256:857d89924e5826447ff60c6cce56cf08b9609c5feeb604e804f087e0a5760aa9 Deleted: sha256:e80a45d27d8b5fd69f9a54956458855bd578051ea0d44007fc13e8f2254771a5 Deleted: sha256:d1b70dbf0a81a8c491ec403f4188fe98c18645af9a7f8204f914029322013699 Deleted: sha256:384159bd607faebbb47ec9dd78ab7f1947634e15a214edbaacb8c5e3e32eb46e Deleted: sha256:1d2d60dac388276b221def437b3ff456360ad8ac2c4659a0418ef2bc435daabd Deleted: sha256:74db1f967095cc5b80b5905dba33b5266108f7e545db12342e6c0a965d2fa0bf Deleted: sha256:1c889e4ba5110fe6f6b31ffe22e9fdc924394c30ababce8e48c74a9f8c9d5bf1 Deleted: sha256:dfba54daad83cd1f6400e648197ece127abbcc7f5b3db5b64f62d315e464c92c Deleted: sha256:e7f6a15bbc16302714d8978fbdd761d4f1622e3be4339e3abb44b98134704451 Deleted: sha256:0b502efa37a83cedd36e9bf2744c46a049522553a20394e8ddf00966a9346364 Deleted: sha256:471c3eb42768ea5b4cbca993f82e900b46ecd8f42ccc2f1212ebd34dc91ebe8b Deleted: sha256:0b4ee0b4aebd249fe248fa10664042100389cf87dc03ee11e086d8d2bf889543 Deleted: sha256:32a1447bab4c207bb5e0b21349d858d8d776387589b6a2c1be3db730aaace9fe Deleted: sha256:52155632746b0eb070a31f74587b7d36d6fd4d0654672d12a1477fd9eedcf11d Deleted: sha256:8ddc3345de28322ee7e10e2bbffe58e79ad292f086be0f9804f06ad6c5f64cca Deleted: sha256:0a64dface855551480a10a7faf5693cb988eccc48623333ab4f58ed3bd1a2cf1 Deleted: sha256:c369f665b6c3a492f3fc9a7667b2b303e0ae253980b0b47f0d42b301f7502b9b Deleted: sha256:f31c22d591ebf4ae4a563e93fe8c3d855e2c7c20814ab63bd45d173617782bc2 Deleted: sha256:de8c70b64e82d57c2ed0519579e56d040d18db1987fad2c1610d6a310f138441 Deleted: sha256:31d915ce66f8553f87f03175c2b10e45a7ad3de78a9f33f254beca528026c138 Deleted: sha256:60a08c2d3b3b15d1283627112fb48c47e3a03c9b37e74a4a5e26c8b3c377eec4 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210902124342] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e4d0fb396672406793530cd45982f3abe648de9bf7206620c67ca72de29fcf16] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210902124342] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e4d0fb396672406793530cd45982f3abe648de9bf7206620c67ca72de29fcf16])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e4d0fb396672406793530cd45982f3abe648de9bf7206620c67ca72de29fcf16 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e4d0fb396672406793530cd45982f3abe648de9bf7206620c67ca72de29fcf16 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e4d0fb396672406793530cd45982f3abe648de9bf7206620c67ca72de29fcf16]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 19m 35s 101 actionable tasks: 70 executed, 29 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/tn67b7x4g7wzu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
