See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/22/display/redirect?page=changes>
Changes: [raphael.sanamyan] [BEAM-12511] Add ability to use JdbcIO.Write.withResults without [Luke Cwik] [BEAM-12547] Consume vendored gRPC 1.36.0 0.2 and fix test to ensure [noreply] Merge pull request #15135: [BEAM-10887] Timer clear Reapply timer clear [Andrew Pilloud] Update Beam website to release 2.31.0. [noreply] [BEAM-9547] Add implementations for some lesser-used pandas operations [noreply] Merge pull request #15054: Fix broken build.gradle release tag [noreply] [BEAM-12513] Finish adding Go to BPG 4. Transforms (#15142) [noreply] [BEAM-12548] Add unit tests for passert.go (#15141) [noreply] [BEAM-9547] Identify remaining WontImplement operations (#15095) ------------------------------------------ [...truncated 58.53 KB...] golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java11:copyGolangLicenses > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:java:container:java11:copySdkHarnessLauncher > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java11:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :sdks:java:testing:load-tests:run Jul 09, 2021 12:46:16 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Jul 09, 2021 12:46:17 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 189 files. Enable logging at DEBUG level to see which files will be staged. Jul 09, 2021 12:46:18 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor) Jul 09, 2021 12:46:18 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Jul 09, 2021 12:46:21 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Jul 09, 2021 12:46:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <107114 bytes, hash d4352d4001ee27140235cc3a75ecd04ee071eaa71ad7a76ec7da092ff8c9451a> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-1DUtQAHuJxQCNcw6dezQTuBx6qca16dux9oJL_jJRRo.pb Jul 09, 2021 12:46:23 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 189 files from PipelineOptions.filesToStage to staging location to prepare for execution. Jul 09, 2021 12:46:24 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.m2/repository/org/apache/beam/beam-vendor-grpc-1_36_0/0.2/beam-vendor-grpc-1_36_0-0.2.jar to gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-ARJ9IUTlyXpbZnCRXyAjusfKQ3IZ_alLBvpCeiWl3YQ.jar Jul 09, 2021 12:46:24 PM org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse WARNING: Request failed with code 412, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/upload/storage/v1/b/temp-storage-for-perf-tests/o?ifGenerationMatch=0&name=loadtests/staging/beam-vendor-grpc-1_36_0-0.2-ARJ9IUTlyXpbZnCRXyAjusfKQ3IZ_alLBvpCeiWl3YQ.jar&uploadType=resumable&upload_id=ADPycdvMKScY96VWkjpb6WCUJa-V6y-C54Lq9dzVLaBrqTQADr8TMfugC_bhTZLcUBKnlctIdw_EvULIrxFMd63dC5s. Jul 09, 2021 12:46:24 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackageWithRetry WARNING: Upload attempt failed, sleeping before retrying staging of package: /home/jenkins/.m2/repository/org/apache/beam/beam-vendor-grpc-1_36_0/0.2/beam-vendor-grpc-1_36_0-0.2.jar java.io.IOException: Upload failed for 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-ARJ9IUTlyXpbZnCRXyAjusfKQ3IZ_alLBvpCeiWl3YQ.jar' at com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel.waitForCompletionAndThrowIfUploadFailed(BaseAbstractGoogleAsyncWriteChannel.java:316) at com.google.cloud.hadoop.util.BaseAbstractGoogleAsyncWriteChannel.close(BaseAbstractGoogleAsyncWriteChannel.java:219) at org.apache.beam.runners.dataflow.util.PackageUtil.tryStagePackage(PackageUtil.java:227) at org.apache.beam.runners.dataflow.util.PackageUtil.tryStagePackageWithRetry(PackageUtil.java:174) at org.apache.beam.runners.dataflow.util.PackageUtil.stagePackageSynchronously(PackageUtil.java:158) at org.apache.beam.runners.dataflow.util.PackageUtil.lambda$stagePackage$1(PackageUtil.java:142) at org.apache.beam.sdk.util.MoreFutures.lambda$supplyAsync$0(MoreFutures.java:107) at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 412 Precondition Failed PUT https://storage.googleapis.com/upload/storage/v1/b/temp-storage-for-perf-tests/o?ifGenerationMatch=0&name=loadtests/staging/beam-vendor-grpc-1_36_0-0.2-ARJ9IUTlyXpbZnCRXyAjusfKQ3IZ_alLBvpCeiWl3YQ.jar&uploadType=resumable&upload_id=ADPycdvMKScY96VWkjpb6WCUJa-V6y-C54Lq9dzVLaBrqTQADr8TMfugC_bhTZLcUBKnlctIdw_EvULIrxFMd63dC5s { "code" : 412, "errors" : [ { "domain" : "global", "location" : "If-Match", "locationType" : "header", "message" : "At least one of the pre-conditions you specified did not hold.", "reason" : "conditionNotMet" } ], "message" : "At least one of the pre-conditions you specified did not hold." } at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:532) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565) at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:106) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 more Jul 09, 2021 12:46:30 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading /home/jenkins/.m2/repository/org/apache/beam/beam-vendor-grpc-1_36_0/0.2/beam-vendor-grpc-1_36_0-0.2.jar to gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-ARJ9IUTlyXpbZnCRXyAjusfKQ3IZ_alLBvpCeiWl3YQ.jar Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 188 files cached, 1 files newly uploaded in 7 seconds Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Jul 09, 2021 12:46:31 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4745e9c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2f2bff16, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@75de29c0, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@fc807c1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@296e281a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@59cda16e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5dd903be, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12e0f1cb, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a163575, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7e642b88, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b350309, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7ecec90d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@588f63c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5a6fa56e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1981d861, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@118ffcfd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53f4c1e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74174a23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691] Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding ParDo(TimeMonitor) as step s3 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding ParDo(ByteMonitor) as step s4 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 0 as step s5 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 1 as step s6 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 2 as step s7 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 3 as step s8 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 4 as step s9 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 5 as step s10 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 6 as step s11 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 7 as step s12 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 8 as step s13 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Step: 9 as step s14 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding ParDo(TimeMonitor)2 as step s15 Jul 09, 2021 12:46:31 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.32.0-SNAPSHOT Jul 09, 2021 12:46:32 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-07-09_05_46_31-2322588565381005048?project=apache-beam-testing Jul 09, 2021 12:46:32 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-07-09_05_46_31-2322588565381005048 Jul 09, 2021 12:46:32 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-07-09_05_46_31-2322588565381005048 Jul 09, 2021 12:46:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-07-09T12:46:36.973Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-07-aphz. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:40.587Z: Worker configuration: n1-standard-2 in us-central1-a. Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.357Z: Expanding SplittableParDo operations into optimizable parts. Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.389Z: Expanding CollectionToSingleton operations into optimizable parts. Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.456Z: Expanding CoGroupByKey operations into optimizable parts. Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.511Z: Expanding SplittableProcessKeyed operations into optimizable parts. Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.537Z: Expanding GroupByKey operations into streaming Read/Write steps Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.572Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.631Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Jul 09, 2021 12:46:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.668Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.705Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.739Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.775Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.811Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.844Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.875Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.912Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.944Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:41.979Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.006Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.040Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.089Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.123Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.165Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.267Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.295Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation) Jul 09, 2021 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:42.671Z: Starting 5 ****s in us-central1-a... Jul 09, 2021 12:46:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:46:51.475Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Jul 09, 2021 12:48:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:48:05.365Z: Workers have started successfully. Jul 09, 2021 12:48:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T12:48:05.407Z: Workers have started successfully. Jul 09, 2021 1:37:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T13:37:46.459Z: Cleaning up. Jul 09, 2021 1:37:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T13:37:46.584Z: Stopping **** pool... Jul 09, 2021 1:37:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T13:37:46.684Z: Stopping **** pool... Jul 09, 2021 1:38:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-07-09T13:38:29.873Z: Worker pool stopped. Jul 09, 2021 1:38:35 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-07-09_05_46_31-2322588565381005048 finished with status DONE. > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED ERROR: (gcloud.container.images.delete) [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210709123735] is not a valid name. Expected tag in the form "base:tag" or "tag" or digest in the form "sha256:<digest>" FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 1m 17s 104 actionable tasks: 74 executed, 28 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/3gkjvdzkup536 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
