See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/113/display/redirect?page=changes>
Changes: [Udi Meiri] Release script fixes [noreply] [BEAM-13015] Remove the overhead of SpecMonitoringInfoValidator [noreply] Minor: Replace generic external.py links in multi-language documentation [noreply] Revert "[BEAM-12993] Update to Debezium 1.7.0.Final (#15636)" [kawaigin] Updated screendiff integration test golden screenshots. [noreply] [BEAM-12769] Few fixes related to Java Class Lookup based cross-language ------------------------------------------ [...truncated 46.89 KB...] github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java11:copyGolangLicenses > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java11:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 4ccf846abbb8: Preparing ead60ca72480: Preparing c5d88f1b0112: Preparing 72c0f7427630: Preparing 6164625078c8: Preparing b802d21261f3: Preparing f66994b21750: Preparing a70fc315115c: Preparing 13d07f21af63: Preparing 625ebe378bc5: Preparing b999601461b7: Preparing 28b25e048190: Preparing b802d21261f3: Waiting 874ad65f91ea: Preparing 0fc2498b65e5: Preparing d08e6b97bf21: Preparing 3054497613e6: Preparing f66994b21750: Waiting 28b25e048190: Waiting 625ebe378bc5: Waiting d35dc7f4c79e: Preparing dabfe5b2ea81: Preparing 5e6a409f30b6: Preparing d08e6b97bf21: Waiting 3054497613e6: Waiting dabfe5b2ea81: Waiting d35dc7f4c79e: Waiting b999601461b7: Waiting 874ad65f91ea: Waiting 13d07f21af63: Waiting a70fc315115c: Waiting 0fc2498b65e5: Waiting ead60ca72480: Pushed 6164625078c8: Pushed c5d88f1b0112: Pushed 4ccf846abbb8: Pushed b802d21261f3: Pushed 72c0f7427630: Pushed a70fc315115c: Pushed 28b25e048190: Pushed 13d07f21af63: Pushed b999601461b7: Pushed 874ad65f91ea: Layer already exists 0fc2498b65e5: Layer already exists f66994b21750: Pushed d08e6b97bf21: Layer already exists 3054497613e6: Layer already exists d35dc7f4c79e: Layer already exists dabfe5b2ea81: Layer already exists 5e6a409f30b6: Layer already exists 625ebe378bc5: Pushed 20211008121036: digest: sha256:90b3b88ed7f83637cc315fc900c6eee54fef232335c54b63f771bf952554d5e3 size: 4311 > Task :sdks:java:testing:load-tests:run Oct 08, 2021 12:14:15 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Oct 08, 2021 12:14:16 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 195 files. Enable logging at DEBUG level to see which files will be staged. Oct 08, 2021 12:14:17 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Oct 08, 2021 12:14:20 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 195 files from PipelineOptions.filesToStage to staging location to prepare for execution. Oct 08, 2021 12:14:23 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 195 files cached, 0 files newly uploaded in 2 seconds Oct 08, 2021 12:14:23 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Oct 08, 2021 12:14:23 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <88023 bytes, hash 154ebc88e740640b1196d0520cf51feb82f3440c7d94df3e21a18596ae36a1c6> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-FU68iOdAZAsRltBSDPUf64LzRAx9lN8-IaGFlq42ocY.pb Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Oct 08, 2021 12:14:25 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@378cfecf, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@97d0c06, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5e7c141d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@43af351a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1305c126, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@72f9f27c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c1bdcc2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@762637be, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4b97c4ad, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7640a5b1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@642f9a77, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@23f3da8b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5634d0f4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@252a8aae, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3d4e405e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@54e2fe, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@70972170, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@119aa36, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4e1a46fb, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@69fe0ed4] Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics as step s3 Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Total bytes monitor as step s4 Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s5 Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Group by key (0) as step s6 Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate (0) as step s7 Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics (0) as step s8 Oct 08, 2021 12:14:25 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.35.0-SNAPSHOT Oct 08, 2021 12:14:26 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-10-08_05_14_25-16044111836002696890?project=apache-beam-testing Oct 08, 2021 12:14:26 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-10-08_05_14_25-16044111836002696890 Oct 08, 2021 12:14:26 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-10-08_05_14_25-16044111836002696890 Oct 08, 2021 12:14:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-10-08T12:14:31.493Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0gbk01-jenkins-1008-paji. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:34.915Z: Worker configuration: e2-standard-2 in us-central1-a. Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:35.723Z: Expanding SplittableParDo operations into optimizable parts. Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:35.748Z: Expanding CollectionToSingleton operations into optimizable parts. Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:35.867Z: Expanding CoGroupByKey operations into optimizable parts. Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:35.947Z: Expanding SplittableProcessKeyed operations into optimizable parts. Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:35.990Z: Expanding GroupByKey operations into streaming Read/Write steps Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.038Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.139Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.202Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.253Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.283Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.318Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.344Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds) Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.382Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.412Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Oct 08, 2021 12:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.447Z: Fusing consumer Group by key (0)/WriteStream into Window.Into()/Window.Assign Oct 08, 2021 12:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.485Z: Fusing consumer Group by key (0)/MergeBuckets into Group by key (0)/ReadStream Oct 08, 2021 12:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.522Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/MergeBuckets Oct 08, 2021 12:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.561Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Oct 08, 2021 12:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:14:36.912Z: Starting 5 ****s in us-central1-a... Oct 08, 2021 12:15:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:15:08.403Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Oct 08, 2021 12:15:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:15:22.627Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate. Oct 08, 2021 12:16:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:16:17.597Z: Workers have started successfully. Oct 08, 2021 12:16:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T12:16:17.633Z: Workers have started successfully. Oct 08, 2021 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T16:00:42.348Z: Cancel request is committed for workflow job: 2021-10-08_05_14_25-16044111836002696890. Oct 08, 2021 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T16:00:42.427Z: Cleaning up. Oct 08, 2021 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T16:00:42.509Z: Stopping **** pool... Oct 08, 2021 4:00:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T16:00:42.582Z: Stopping **** pool... Oct 08, 2021 4:03:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T16:03:04.852Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate. Oct 08, 2021 4:03:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-10-08T16:03:04.887Z: Worker pool stopped. Oct 08, 2021 4:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-10-08_05_14_25-16044111836002696890 finished with status CANCELLED. Oct 08, 2021 4:03:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric SEVERE: Failed to get metric totalBytes.count, from namespace gbk Load test results for test (ID): 25d2e551-8f5d-4298-afb8-c62cd81d1355 and timestamp: 2021-10-08T12:14:16.702000000Z: Metric: Value: dataflow_v2_java11_runtime_sec 0.0 dataflow_v2_java11_total_bytes_count -1.0 Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED. at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55) at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57) at org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131) > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008121036 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90b3b88ed7f83637cc315fc900c6eee54fef232335c54b63f771bf952554d5e3 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008121036] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90b3b88ed7f83637cc315fc900c6eee54fef232335c54b63f771bf952554d5e3] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211008121036] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:90b3b88ed7f83637cc315fc900c6eee54fef232335c54b63f771bf952554d5e3])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1447960b06deec03f1c40156ae68f611464231872252e290a78a8ca8b5fbc7c4 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1447960b06deec03f1c40156ae68f611464231872252e290a78a8ca8b5fbc7c4 ERROR: (gcloud.container.images.delete) Not found: response: {'status': '404', 'content-length': '168', 'x-xss-protection': '0', 'transfer-encoding': 'chunked', 'server': 'Docker Registry', '-content-encoding': 'gzip', 'docker-distribution-api-version': 'registry/2.0', 'cache-control': 'private', 'date': 'Fri, 08 Oct 2021 16:03:14 GMT', 'x-frame-options': 'SAMEORIGIN', 'content-type': 'application/json'} Failed to compute blob liveness for manifest: 'sha256:1447960b06deec03f1c40156ae68f611464231872252e290a78a8ca8b5fbc7c4': None > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 282 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 3h 52m 56s 101 actionable tasks: 70 executed, 29 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/rt2hklno6btra Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
