See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/654/display/redirect>
Changes: ------------------------------------------ [...truncated 302.27 KB...] #23 exporting to image #23 exporting layers #23 exporting layers 0.3s done #23 writing image sha256:0a6ba12dd7b227552775bb139bb303b27fda635e09f959a244b2f9d43443b40d done #23 naming to docker.io/apache/beam_java11_sdk:2.47.0.dev #23 naming to docker.io/apache/beam_java11_sdk:2.47.0.dev done #23 DONE 0.3s > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 8f665a211d29: Preparing 5f70bf18a086: Preparing f96fdbc49530: Preparing 41b0427adef6: Preparing 291d9d3bd37a: Preparing 6bf1c43a6ad8: Preparing e1ec5ef5a79b: Preparing 73c86aadeec9: Preparing 6bfe45d400c1: Preparing 44a0fa24c007: Preparing 6e4e60b2efa3: Preparing db308453e3fd: Preparing 01de27e58924: Preparing e2ce33cb79f5: Preparing da3cdb8202ee: Preparing de77b864666c: Preparing 2d0e2e41e379: Preparing 749d6cfaa5eb: Preparing 8ac55e7a3c46: Preparing 04d1dcab20cb: Preparing b93c1bd012ab: Preparing 44a0fa24c007: Waiting 73c86aadeec9: Waiting 6e4e60b2efa3: Waiting db308453e3fd: Waiting 6bfe45d400c1: Waiting 2d0e2e41e379: Waiting 749d6cfaa5eb: Waiting 01de27e58924: Waiting 8ac55e7a3c46: Waiting e2ce33cb79f5: Waiting 04d1dcab20cb: Waiting b93c1bd012ab: Waiting da3cdb8202ee: Waiting 6bf1c43a6ad8: Waiting de77b864666c: Waiting 5f70bf18a086: Layer already exists 291d9d3bd37a: Pushed f96fdbc49530: Pushed 6bf1c43a6ad8: Pushed 41b0427adef6: Pushed 8f665a211d29: Pushed 6bfe45d400c1: Pushed 73c86aadeec9: Pushed 6e4e60b2efa3: Pushed e1ec5ef5a79b: Pushed 44a0fa24c007: Pushed 01de27e58924: Pushed db308453e3fd: Pushed 749d6cfaa5eb: Layer already exists 8ac55e7a3c46: Layer already exists 04d1dcab20cb: Layer already exists b93c1bd012ab: Layer already exists e2ce33cb79f5: Pushed da3cdb8202ee: Pushed de77b864666c: Pushed 2d0e2e41e379: Pushed 20230405132240: digest: sha256:2c9af7e262dc3d5c80f975d160d72e770d3fd9f516c45300454fdf10ad8007a5 size: 4712 > Task :sdks:java:testing:load-tests:run Apr 05, 2023 1:23:01 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Apr 05, 2023 1:23:02 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 230 files. Enable logging at DEBUG level to see which files will be staged. Apr 05, 2023 1:23:03 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Apr 05, 2023 1:23:05 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 230 files from PipelineOptions.filesToStage to staging location to prepare for execution. Apr 05, 2023 1:23:05 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 230 files cached, 0 files newly uploaded in 0 seconds Apr 05, 2023 1:23:05 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Apr 05, 2023 1:23:05 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <114933 bytes, hash 1b0a34e6c6e95686bc6a8c4b04b9ad0e0904520057103002831093cc14e7f4f5> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-Gwo05sbpVoa8aoxLBLmtDgkEUgBXEDACgxCTzBTn9PU.pb Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Apr 05, 2023 1:23:07 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 64 bundles: [SyntheticUnboundedSource{startOffset=0, endOffset=78125}, SyntheticUnboundedSource{startOffset=78125, endOffset=156250}, SyntheticUnboundedSource{startOffset=156250, endOffset=234375}, SyntheticUnboundedSource{startOffset=234375, endOffset=312500}, SyntheticUnboundedSource{startOffset=312500, endOffset=390625}, SyntheticUnboundedSource{startOffset=390625, endOffset=468750}, SyntheticUnboundedSource{startOffset=468750, endOffset=546875}, SyntheticUnboundedSource{startOffset=546875, endOffset=625000}, SyntheticUnboundedSource{startOffset=625000, endOffset=703125}, SyntheticUnboundedSource{startOffset=703125, endOffset=781250}, SyntheticUnboundedSource{startOffset=781250, endOffset=859375}, SyntheticUnboundedSource{startOffset=859375, endOffset=937500}, SyntheticUnboundedSource{startOffset=937500, endOffset=1015625}, SyntheticUnboundedSource{startOffset=1015625, endOffset=1093750}, SyntheticUnboundedSource{startOffset=1093750, endOffset=1171875}, SyntheticUnboundedSource{startOffset=1171875, endOffset=1250000}, SyntheticUnboundedSource{startOffset=1250000, endOffset=1328125}, SyntheticUnboundedSource{startOffset=1328125, endOffset=1406250}, SyntheticUnboundedSource{startOffset=1406250, endOffset=1484375}, SyntheticUnboundedSource{startOffset=1484375, endOffset=1562500}, SyntheticUnboundedSource{startOffset=1562500, endOffset=1640625}, SyntheticUnboundedSource{startOffset=1640625, endOffset=1718750}, SyntheticUnboundedSource{startOffset=1718750, endOffset=1796875}, SyntheticUnboundedSource{startOffset=1796875, endOffset=1875000}, SyntheticUnboundedSource{startOffset=1875000, endOffset=1953125}, SyntheticUnboundedSource{startOffset=1953125, endOffset=2031250}, SyntheticUnboundedSource{startOffset=2031250, endOffset=2109375}, SyntheticUnboundedSource{startOffset=2109375, endOffset=2187500}, SyntheticUnboundedSource{startOffset=2187500, endOffset=2265625}, SyntheticUnboundedSource{startOffset=2265625, endOffset=2343750}, SyntheticUnboundedSource{startOffset=2343750, endOffset=2421875}, SyntheticUnboundedSource{startOffset=2421875, endOffset=2500000}, SyntheticUnboundedSource{startOffset=2500000, endOffset=2578125}, SyntheticUnboundedSource{startOffset=2578125, endOffset=2656250}, SyntheticUnboundedSource{startOffset=2656250, endOffset=2734375}, SyntheticUnboundedSource{startOffset=2734375, endOffset=2812500}, SyntheticUnboundedSource{startOffset=2812500, endOffset=2890625}, SyntheticUnboundedSource{startOffset=2890625, endOffset=2968750}, SyntheticUnboundedSource{startOffset=2968750, endOffset=3046875}, SyntheticUnboundedSource{startOffset=3046875, endOffset=3125000}, SyntheticUnboundedSource{startOffset=3125000, endOffset=3203125}, SyntheticUnboundedSource{startOffset=3203125, endOffset=3281250}, SyntheticUnboundedSource{startOffset=3281250, endOffset=3359375}, SyntheticUnboundedSource{startOffset=3359375, endOffset=3437500}, SyntheticUnboundedSource{startOffset=3437500, endOffset=3515625}, SyntheticUnboundedSource{startOffset=3515625, endOffset=3593750}, SyntheticUnboundedSource{startOffset=3593750, endOffset=3671875}, SyntheticUnboundedSource{startOffset=3671875, endOffset=3750000}, SyntheticUnboundedSource{startOffset=3750000, endOffset=3828125}, SyntheticUnboundedSource{startOffset=3828125, endOffset=3906250}, SyntheticUnboundedSource{startOffset=3906250, endOffset=3984375}, SyntheticUnboundedSource{startOffset=3984375, endOffset=4062500}, SyntheticUnboundedSource{startOffset=4062500, endOffset=4140625}, SyntheticUnboundedSource{startOffset=4140625, endOffset=4218750}, SyntheticUnboundedSource{startOffset=4218750, endOffset=4296875}, SyntheticUnboundedSource{startOffset=4296875, endOffset=4375000}, SyntheticUnboundedSource{startOffset=4375000, endOffset=4453125}, SyntheticUnboundedSource{startOffset=4453125, endOffset=4531250}, SyntheticUnboundedSource{startOffset=4531250, endOffset=4609375}, SyntheticUnboundedSource{startOffset=4609375, endOffset=4687500}, SyntheticUnboundedSource{startOffset=4687500, endOffset=4765625}, SyntheticUnboundedSource{startOffset=4765625, endOffset=4843750}, SyntheticUnboundedSource{startOffset=4843750, endOffset=4921875}, SyntheticUnboundedSource{startOffset=4921875, endOffset=5000000}] Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics as step s3 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Total bytes monitor as step s4 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s5 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Group by key (0) as step s6 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate (0) as step s7 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics (0) as step s8 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Group by key (1) as step s9 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate (1) as step s10 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics (1) as step s11 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Group by key (2) as step s12 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate (2) as step s13 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics (2) as step s14 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Group by key (3) as step s15 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate (3) as step s16 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics (3) as step s17 Apr 05, 2023 1:23:07 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.47.0-SNAPSHOT Apr 05, 2023 1:23:08 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-05_06_23_07-8237492233195238263?project=apache-beam-testing Apr 05, 2023 1:23:08 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2023-04-05_06_23_07-8237492233195238263 Apr 05, 2023 1:23:08 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2023-04-05_06_23_07-8237492233195238263 Apr 05, 2023 1:23:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2023-04-05T13:23:14.767Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0gbk04-jenkins-0405-w9c2. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Apr 05, 2023 1:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:25.463Z: Worker configuration: e2-standard-2 in us-central1-f. Apr 05, 2023 1:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:26.830Z: Expanding SplittableParDo operations into optimizable parts. Apr 05, 2023 1:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:26.862Z: Expanding CollectionToSingleton operations into optimizable parts. Apr 05, 2023 1:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:26.920Z: Expanding CoGroupByKey operations into optimizable parts. Apr 05, 2023 1:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.052Z: Expanding SplittableProcessKeyed operations into optimizable parts. Apr 05, 2023 1:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.082Z: Expanding GroupByKey operations into streaming Read/Write steps Apr 05, 2023 1:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.234Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.412Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.449Z: Fusing consumer Group by key (0)/WriteStream into Window.Into()/Window.Assign Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.481Z: Fusing consumer Group by key (1)/WriteStream into Window.Into()/Window.Assign Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.504Z: Fusing consumer Group by key (2)/WriteStream into Window.Into()/Window.Assign Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.541Z: Fusing consumer Group by key (3)/WriteStream into Window.Into()/Window.Assign Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.576Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.609Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.643Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.678Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.703Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.725Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.762Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.798Z: Fusing consumer Group by key (0)/MergeBuckets into Group by key (0)/ReadStream Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.822Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/MergeBuckets Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.846Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.872Z: Fusing consumer Group by key (1)/MergeBuckets into Group by key (1)/ReadStream Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.899Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/MergeBuckets Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.922Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.945Z: Fusing consumer Group by key (2)/MergeBuckets into Group by key (2)/ReadStream Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:27.984Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/MergeBuckets Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:28.017Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:28.052Z: Fusing consumer Group by key (3)/MergeBuckets into Group by key (3)/ReadStream Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:28.085Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/MergeBuckets Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:28.119Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) Apr 05, 2023 1:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:28.216Z: Running job using Streaming Engine Apr 05, 2023 1:23:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:29.406Z: Starting 16 ****s in us-central1-f... Apr 05, 2023 1:23:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:23:40.441Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Apr 05, 2023 1:24:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:24:21.347Z: Autoscaling: Raised the number of ****s to 16 so that the pipeline can catch up with its backlog and keep up with its input rate. Apr 05, 2023 1:25:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:25:10.969Z: Workers have started successfully. Apr 05, 2023 1:25:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-04-05T13:25:11.185Z: All ****s have finished the startup processes and began to receive work requests. FATAL: command execution failed java.io.IOException: Backing channel 'apache-beam-jenkins-6' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285) at com.sun.proxy.$Proxy142.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207) at hudson.Launcher$ProcStarter.join(Launcher.java:524) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814) at hudson.model.Build$BuildExecution.build(Build.java:199) at hudson.model.Build$BuildExecution.doRun(Build.java:164) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522) at hudson.model.Run.execute(Run.java:1896) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1313) at hudson.remoting.Channel$1.handle(Channel.java:606) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81) Caused by: Command Close created at at hudson.remoting.Command.<init>(Command.java:70) at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1306) at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1304) at hudson.remoting.Channel.close(Channel.java:1480) at hudson.remoting.Channel.close(Channel.java:1447) at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1312) ... 2 more Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-6 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
