See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/6/display/redirect?page=changes>
Changes: [egalpin] [BEAM-12421] Migrates ElasticsearchIOTest to use testContainers [egalpin] Adds factory method for creating consistent ES containers [egalpin] Renames elasticsearchIOTestContainerFactory to createTestContainer [egalpin] Reduces number of docs for UTests from 400 to 100 [Robert Bradshaw] [BEAM-12475] Reject splits for previous bundles. [noreply] Add 2.30 release date [noreply] Remove placeholder entries from 2.30 [Robert Bradshaw] mypy [Boyuan Zhang] [BEAM-12475] Ensure the BundleProcessor.getId() is null before calling [benjamin.gonzalez] [BEAM-37137] Fix xlang dependency error [heejong] Update Dataflow Python container version to 20210622 [Robert Burke] [BEAM-12528] Discard failed plans. [noreply] [BEAM-9547] Add support for `Series.dt` methods (#14940) ------------------------------------------ [...truncated 60.81 KB...] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@/home/jenkins/jenkins-slave/workspace/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/src/sdks/go > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java11:copySdkHarnessLauncher > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java11:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 6181f1c01a4d: Preparing 0b3edb8b86bc: Preparing 2af05e0e7a2f: Preparing 6cafd47bf8c8: Preparing a1094303e5be: Preparing 1d7819584159: Preparing 6642dc835280: Preparing bb1ae6d05e71: Preparing 5ab462059aa5: Preparing 21bed984b435: Preparing f0f679e0fe89: Preparing 632f6283daff: Preparing 82f8ebb33b27: Preparing c0848348e2f7: Preparing 79c550eb7bd2: Preparing 7095af798ace: Preparing fe6a4fdbedc0: Preparing e4d0e810d54a: Preparing 4e006334a6fd: Preparing 5ab462059aa5: Waiting 1d7819584159: Waiting 7095af798ace: Waiting 21bed984b435: Waiting f0f679e0fe89: Waiting 82f8ebb33b27: Waiting 6642dc835280: Waiting c0848348e2f7: Waiting 79c550eb7bd2: Waiting bb1ae6d05e71: Waiting fe6a4fdbedc0: Waiting 632f6283daff: Waiting e4d0e810d54a: Waiting a1094303e5be: Pushed 2af05e0e7a2f: Pushed 0b3edb8b86bc: Pushed 6181f1c01a4d: Pushed 1d7819584159: Pushed 6cafd47bf8c8: Pushed bb1ae6d05e71: Pushed 5ab462059aa5: Pushed 82f8ebb33b27: Layer already exists c0848348e2f7: Layer already exists 79c550eb7bd2: Layer already exists 7095af798ace: Layer already exists fe6a4fdbedc0: Layer already exists f0f679e0fe89: Pushed 4e006334a6fd: Layer already exists e4d0e810d54a: Layer already exists 632f6283daff: Pushed 6642dc835280: Pushed 21bed984b435: Pushed 20210623124329: digest: sha256:45c49b9f0f09b4dc391a347cfc65bc639f421de7b74a5474a5dcddd30e969dad size: 4310 > Task :sdks:java:testing:load-tests:run Jun 23, 2021 12:47:46 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Jun 23, 2021 12:47:47 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 190 files. Enable logging at DEBUG level to see which files will be staged. Jun 23, 2021 12:47:48 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Window.Into() Jun 23, 2021 12:47:48 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Jun 23, 2021 12:47:49 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Jun 23, 2021 12:47:49 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <112268 bytes, hash 587b02300459150f997c1857396654d0a1edbd323fef455416300ae162415453> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-WHsCMARZFQ-ZfBhXOWZU0KHtvTI_70VUFjAK4WJBVFM.pb Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 190 files from PipelineOptions.filesToStage to staging location to prepare for execution. Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 190 files cached, 0 files newly uploaded in 0 seconds Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Jun 23, 2021 12:47:51 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ccf91df, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@117d32e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@51d387d3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2370ac7a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@534180a2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6cf0a747, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@21505815, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7e53339, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58fef7f7, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@31ddb930, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12eedfee, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3c3c4a71, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1352434e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4f9a6c2d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2b6fcb9f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@75de6341, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74170687, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68f0f72c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3d96fa9e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3b545206] Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (input) as step s3 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s5 Jun 23, 2021 12:47:51 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1886991b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@64aad809, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1f03fba0, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@17dd671f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3bbf6abe, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@9679750, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@9b9a327, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@75a0c890, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@358ab600, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@e26af6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@44065156, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3791f50e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@574b7f4a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@44ed0a8f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@32177fa5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@a96d56c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6ab4a5b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2abe9173, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@235d29d6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1fdca564] Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read co-input/StripIds as step s6 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics (co-input) as step s7 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()2/Window.Assign as step s8 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable0 as step s9 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/MakeUnionTable1 as step s10 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/Flatten as step s11 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/GBK as step s12 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s13 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate as step s14 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect total bytes as step s15 Jun 23, 2021 12:47:51 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics as step s16 Jun 23, 2021 12:47:52 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.32.0-SNAPSHOT Jun 23, 2021 12:47:53 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-06-23_05_47_52-16587949485078404680?project=apache-beam-testing Jun 23, 2021 12:47:53 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-06-23_05_47_52-16587949485078404680 Jun 23, 2021 12:47:53 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-06-23_05_47_52-16587949485078404680 Jun 23, 2021 12:47:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-06-23T12:47:57.529Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0cogbk01-jenkins-06-1ujm. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:01.476Z: Worker configuration: n1-standard-2 in us-central1-f. Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:01.994Z: Expanding SplittableParDo operations into optimizable parts. Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.023Z: Expanding CollectionToSingleton operations into optimizable parts. Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.086Z: Expanding CoGroupByKey operations into optimizable parts. Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.144Z: Expanding SplittableProcessKeyed operations into optimizable parts. Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.173Z: Expanding GroupByKey operations into streaming Read/Write steps Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.222Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.332Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.373Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.404Z: Fusing unzipped copy of CoGroupByKey/GBK/WriteStream, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.430Z: Fusing consumer CoGroupByKey/GBK/WriteStream into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.464Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.491Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jun 23, 2021 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.527Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.559Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.597Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.629Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.663Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.699Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.730Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.775Z: Fusing consumer Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.814Z: Fusing consumer Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-co-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.842Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read co-input/ParDo(StripIds)/ParMultiDo(StripIds) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.869Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.895Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.929Z: Fusing consumer CoGroupByKey/GBK/MergeBuckets into CoGroupByKey/GBK/ReadStream Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.954Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/MergeBuckets Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:02.976Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:03.014Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:03.044Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor) Jun 23, 2021 12:48:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:03.439Z: Starting 5 ****s in us-central1-f... Jun 23, 2021 12:48:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:10.712Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jun 23, 2021 12:48:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:37.891Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate. Jun 23, 2021 12:48:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:37.920Z: Resized **** pool to 1, though goal was 5. This could be a quota issue. Jun 23, 2021 12:48:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:48:48.246Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Jun 23, 2021 12:49:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:49:24.907Z: Workers have started successfully. Jun 23, 2021 12:49:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-06-23T12:49:24.943Z: Workers have started successfully. FATAL: command execution failed java.io.IOException: Backing channel 'apache-beam-jenkins-15' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286) at com.sun.proxy.$Proxy145.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1211) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1203) at hudson.Launcher$ProcStarter.join(Launcher.java:523) at hudson.plugins.gradle.Gradle.perform(Gradle.java:317) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804) at hudson.model.Build$BuildExecution.build(Build.java:197) at hudson.model.Build$BuildExecution.doRun(Build.java:163) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:514) at hudson.model.Run.execute(Run.java:1907) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) Caused by: java.io.IOException: Pipe closed after 0 cycles at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:118) at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:101) at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:92) at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:73) at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:103) at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63) Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure ERROR: apache-beam-jenkins-15 is offline; cannot locate jdk_1.8_latest --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
