See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/430/display/redirect>
Changes: ------------------------------------------ [...truncated 192.63 KB...] > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:container:java17:copyDockerfileDependencies UP-TO-DATE > Task :sdks:java:expansion-service:jar UP-TO-DATE > Task :sdks:java:io:kafka:compileJava UP-TO-DATE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE > Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE > Task :sdks:java:container:java17:dockerPrepare > Task :sdks:java:testing:load-tests:compileJava UP-TO-DATE > Task :sdks:java:testing:load-tests:classes UP-TO-DATE > Task :sdks:java:testing:load-tests:jar UP-TO-DATE > Task :sdks:java:container:java17:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 05cc87726400: Preparing 54935697f27e: Preparing 01f6e2f2817d: Preparing 9ca94526286f: Preparing cc92c6f3335a: Preparing b5825c846950: Preparing dc448f7d7516: Preparing 041fcc620e23: Preparing 0a89ae12e104: Preparing 82c715e250b4: Preparing dee6df3bb881: Preparing 51ab4c32c1ca: Preparing da5fdbed542a: Preparing ded17e6d506a: Preparing a72bcdfa5af3: Preparing 111e41bcfa51: Preparing 4cf6b33083da: Preparing 2428b038926e: Preparing 2b1193862943: Preparing dee6df3bb881: Waiting c5ff2d88f679: Preparing 0a89ae12e104: Waiting b5825c846950: Waiting 82c715e250b4: Waiting 041fcc620e23: Waiting 111e41bcfa51: Waiting ded17e6d506a: Waiting 2428b038926e: Waiting a72bcdfa5af3: Waiting dc448f7d7516: Waiting 4cf6b33083da: Waiting 54935697f27e: Pushed 01f6e2f2817d: Pushed cc92c6f3335a: Pushed 9ca94526286f: Pushed 05cc87726400: Pushed dc448f7d7516: Pushed 041fcc620e23: Pushed b5825c846950: Pushed 82c715e250b4: Pushed 0a89ae12e104: Pushed 51ab4c32c1ca: Pushed dee6df3bb881: Pushed 4cf6b33083da: Layer already exists 2428b038926e: Layer already exists 2b1193862943: Layer already exists ded17e6d506a: Pushed da5fdbed542a: Pushed c5ff2d88f679: Layer already exists a72bcdfa5af3: Pushed 111e41bcfa51: Pushed 20230224143729: digest: sha256:b2785741cbb0e434325c923b585ee1ab2464f9af0c6d0d0c1c6e9e3fe34c89d0 size: 4506 > Task :sdks:java:testing:load-tests:run Feb 24, 2023 2:37:54 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Feb 24, 2023 2:37:54 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 233 files. Enable logging at DEBUG level to see which files will be staged. Feb 24, 2023 2:37:55 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Feb 24, 2023 2:37:55 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Feb 24, 2023 2:37:57 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 233 files from PipelineOptions.filesToStage to staging location to prepare for execution. Feb 24, 2023 2:37:58 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 233 files cached, 0 files newly uploaded in 0 seconds Feb 24, 2023 2:37:58 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Feb 24, 2023 2:37:58 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <124119 bytes, hash 136b41daf05f4fe1b2fc7df125612bfd8e5cdf81c37c5926b68e930dfdd68def> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-E2tB2vBfT-Gy_H3xJWEr_Y5c34HDfFkmto6TDf3Wje8.pb Feb 24, 2023 2:37:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Feb 24, 2023 2:38:00 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles: [SyntheticUnboundedSource{startOffset=0, endOffset=100000}, SyntheticUnboundedSource{startOffset=100000, endOffset=200000}, SyntheticUnboundedSource{startOffset=200000, endOffset=300000}, SyntheticUnboundedSource{startOffset=300000, endOffset=400000}, SyntheticUnboundedSource{startOffset=400000, endOffset=500000}, SyntheticUnboundedSource{startOffset=500000, endOffset=600000}, SyntheticUnboundedSource{startOffset=600000, endOffset=700000}, SyntheticUnboundedSource{startOffset=700000, endOffset=800000}, SyntheticUnboundedSource{startOffset=800000, endOffset=900000}, SyntheticUnboundedSource{startOffset=900000, endOffset=1000000}, SyntheticUnboundedSource{startOffset=1000000, endOffset=1100000}, SyntheticUnboundedSource{startOffset=1100000, endOffset=1200000}, SyntheticUnboundedSource{startOffset=1200000, endOffset=1300000}, SyntheticUnboundedSource{startOffset=1300000, endOffset=1400000}, SyntheticUnboundedSource{startOffset=1400000, endOffset=1500000}, SyntheticUnboundedSource{startOffset=1500000, endOffset=1600000}, SyntheticUnboundedSource{startOffset=1600000, endOffset=1700000}, SyntheticUnboundedSource{startOffset=1700000, endOffset=1800000}, SyntheticUnboundedSource{startOffset=1800000, endOffset=1900000}, SyntheticUnboundedSource{startOffset=1900000, endOffset=2000000}] Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s3 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Feb 24, 2023 2:38:00 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles: [SyntheticUnboundedSource{startOffset=0, endOffset=100000}, SyntheticUnboundedSource{startOffset=100000, endOffset=200000}, SyntheticUnboundedSource{startOffset=200000, endOffset=300000}, SyntheticUnboundedSource{startOffset=300000, endOffset=400000}, SyntheticUnboundedSource{startOffset=400000, endOffset=500000}, SyntheticUnboundedSource{startOffset=500000, endOffset=600000}, SyntheticUnboundedSource{startOffset=600000, endOffset=700000}, SyntheticUnboundedSource{startOffset=700000, endOffset=800000}, SyntheticUnboundedSource{startOffset=800000, endOffset=900000}, SyntheticUnboundedSource{startOffset=900000, endOffset=1000000}, SyntheticUnboundedSource{startOffset=1000000, endOffset=1100000}, SyntheticUnboundedSource{startOffset=1100000, endOffset=1200000}, SyntheticUnboundedSource{startOffset=1200000, endOffset=1300000}, SyntheticUnboundedSource{startOffset=1300000, endOffset=1400000}, SyntheticUnboundedSource{startOffset=1400000, endOffset=1500000}, SyntheticUnboundedSource{startOffset=1500000, endOffset=1600000}, SyntheticUnboundedSource{startOffset=1600000, endOffset=1700000}, SyntheticUnboundedSource{startOffset=1700000, endOffset=1800000}, SyntheticUnboundedSource{startOffset=1800000, endOffset=1900000}, SyntheticUnboundedSource{startOffset=1900000, endOffset=2000000}] Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.47.0-SNAPSHOT Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-02-24_06_38_00-4570522544427253010?project=apache-beam-testing Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2023-02-24_06_38_00-4570522544427253010 Feb 24, 2023 2:38:00 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2023-02-24_06_38_00-4570522544427253010 Feb 24, 2023 2:38:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2023-02-24T14:38:07.563Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20streaming0cogbk03-jenkins-02-kzmf. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:16.790Z: Worker configuration: e2-standard-2 in us-central1-f. Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.213Z: Expanding SplittableParDo operations into optimizable parts. Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.249Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.313Z: Expanding CoGroupByKey operations into optimizable parts. Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.383Z: Expanding SplittableProcessKeyed operations into optimizable parts. Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.403Z: Expanding GroupByKey operations into streaming Read/Write steps Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.456Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.548Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.576Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.599Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.627Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.650Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.673Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.700Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.729Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.753Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Feb 24, 2023 2:38:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.781Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.810Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.833Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.859Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.891Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.918Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.939Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:18.967Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:19.001Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:19.031Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:19.057Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:19.089Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:19.113Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:19.135Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Feb 24, 2023 2:38:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:19.298Z: Running job using Streaming Engine Feb 24, 2023 2:38:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:20.486Z: Starting 5 ****s in us-central1-f... Feb 24, 2023 2:38:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:38:48.948Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 24, 2023 2:39:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:39:01.023Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Feb 24, 2023 2:40:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:40:04.119Z: All ****s have finished the startup processes and began to receive work requests. Feb 24, 2023 2:40:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2023-02-24T14:40:06.387Z: Workers have started successfully. FATAL: command execution failed java.io.IOException: Backing channel 'apache-beam-jenkins-2' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285) at com.sun.proxy.$Proxy141.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207) at hudson.Launcher$ProcStarter.join(Launcher.java:524) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814) at hudson.model.Build$BuildExecution.build(Build.java:199) at hudson.model.Build$BuildExecution.doRun(Build.java:164) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522) at hudson.model.Run.execute(Run.java:1896) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) Caused by: java.io.IOException: Pipe closed after 0 cycles at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126) at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105) at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94) at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75) at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-2 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
