See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/246/display/redirect>
Changes: ------------------------------------------ [...truncated 167.32 KB...] See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 4f9836999b48: Preparing 9f388442a8d1: Preparing 07ecfaae67fe: Preparing 24baf690e432: Preparing f02a6804073b: Preparing 2d90e1b20b11: Preparing be327195c13a: Preparing ae7b830ed727: Preparing e68a83fd21fa: Preparing 6994cc34e57e: Preparing 359efdb3b93b: Preparing 580601d96aca: Preparing 1f6bb6634505: Preparing fe4f44af763d: Preparing 7c072cee6a29: Preparing e68a83fd21fa: Waiting 1e5fdc3d671c: Preparing 359efdb3b93b: Waiting 2d90e1b20b11: Waiting 613ab28cf833: Preparing 580601d96aca: Waiting bed676ceab7a: Preparing be327195c13a: Waiting 6398d5cccd2c: Preparing ae7b830ed727: Waiting 0b0f2f2f5279: Preparing 1f6bb6634505: Waiting 6994cc34e57e: Waiting 7c072cee6a29: Waiting 1e5fdc3d671c: Waiting 613ab28cf833: Waiting fe4f44af763d: Waiting 0b0f2f2f5279: Waiting 6398d5cccd2c: Waiting f02a6804073b: Pushed 07ecfaae67fe: Pushed 4f9836999b48: Pushed 2d90e1b20b11: Pushed 24baf690e432: Pushed ae7b830ed727: Pushed be327195c13a: Pushed 9f388442a8d1: Pushed e68a83fd21fa: Pushed fe4f44af763d: Layer already exists 7c072cee6a29: Layer already exists 1e5fdc3d671c: Layer already exists 613ab28cf833: Layer already exists bed676ceab7a: Layer already exists 6398d5cccd2c: Layer already exists 0b0f2f2f5279: Layer already exists 6994cc34e57e: Pushed 580601d96aca: Pushed 1f6bb6634505: Pushed 359efdb3b93b: Pushed 20220221181630: digest: sha256:6ee6341fec4d0c2c26eacccc672b82241627e367b749bb336a51628f88ea3a65 size: 4520 > Task :sdks:java:testing:load-tests:run Feb 21, 2022 6:17:01 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Feb 21, 2022 6:17:01 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 204 files. Enable logging at DEBUG level to see which files will be staged. Feb 21, 2022 6:17:02 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Feb 21, 2022 6:17:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 204 files from PipelineOptions.filesToStage to staging location to prepare for execution. Feb 21, 2022 6:17:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 204 files cached, 0 files newly uploaded in 0 seconds Feb 21, 2022 6:17:04 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ Feb 21, 2022 6:17:04 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <88836 bytes, hash 54f7a9569cb5ee85cf3f1fd76f617f3a42e70c7e8fd0a0581e0bb64ee3b650fc> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-VPepVpy17oXPPx_Xb2F_OkLnDH6P0KBYHgu2TuO2UPw.pb Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input as step s1 Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metrics as step s2 Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Total bytes monitor as step s3 Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s4 Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Group by key (0) as step s5 Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Ungroup and reiterate (0) as step s6 Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metrics (0) as step s7 Feb 21, 2022 6:17:06 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.38.0-SNAPSHOT Feb 21, 2022 6:17:07 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-21_10_17_06-9147809495261510365?project=apache-beam-testing Feb 21, 2022 6:17:07 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2022-02-21_10_17_06-9147809495261510365 Feb 21, 2022 6:17:07 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2022-02-21_10_17_06-9147809495261510365 Feb 21, 2022 6:17:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2022-02-21T18:17:11.539Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20batch0gbk03-jenkins-02211817-labg. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:16.981Z: Worker configuration: e2-standard-2 in us-central1-f. Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:17.845Z: Expanding SplittableParDo operations into optimizable parts. Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:17.900Z: Expanding CollectionToSingleton operations into optimizable parts. Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:17.996Z: Expanding CoGroupByKey operations into optimizable parts. Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.108Z: Expanding GroupByKey operations into optimizable parts. Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.210Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.259Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.302Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.347Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction Feb 21, 2022 6:17:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.391Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing Feb 21, 2022 6:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.423Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor) Feb 21, 2022 6:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.455Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor) Feb 21, 2022 6:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.494Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign Feb 21, 2022 6:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.532Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read Feb 21, 2022 6:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:18.569Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) Feb 21, 2022 6:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:19.161Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 21, 2022 6:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:19.271Z: Starting 5 ****s in us-central1-f... Feb 21, 2022 6:17:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:39.691Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Feb 21, 2022 6:17:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:17:59.583Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s). Feb 21, 2022 6:19:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:05.740Z: Workers have started successfully. Feb 21, 2022 6:19:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:05.805Z: Workers have started successfully. Feb 21, 2022 6:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:18.438Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing Feb 21, 2022 6:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:18.671Z: Executing operation Group by key (0)/Create Feb 21, 2022 6:19:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:21.899Z: Finished operation Group by key (0)/Create Feb 21, 2022 6:19:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:22.126Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (0)/Write Feb 21, 2022 6:19:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:35.408Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (0)/Write Feb 21, 2022 6:19:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:35.497Z: Executing operation Group by key (0)/Close Feb 21, 2022 6:19:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:35.583Z: Finished operation Group by key (0)/Close Feb 21, 2022 6:19:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:35.663Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Feb 21, 2022 6:19:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:41.236Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor) Feb 21, 2022 6:19:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:41.423Z: Cleaning up. Feb 21, 2022 6:19:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2022-02-21T18:19:41.581Z: Stopping **** pool... > Task :sdks:java:testing:load-tests:run FAILED > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221181630 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ee6341fec4d0c2c26eacccc672b82241627e367b749bb336a51628f88ea3a65 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221181630] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ee6341fec4d0c2c26eacccc672b82241627e367b749bb336a51628f88ea3a65] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221181630] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ee6341fec4d0c2c26eacccc672b82241627e367b749bb336a51628f88ea3a65])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ee6341fec4d0c2c26eacccc672b82241627e367b749bb336a51628f88ea3a65 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ee6341fec4d0c2c26eacccc672b82241627e367b749bb336a51628f88ea3a65 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6ee6341fec4d0c2c26eacccc672b82241627e367b749bb336a51628f88ea3a65]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 143 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 3m 52s 104 actionable tasks: 8 executed, 96 up-to-date Publishing build scan... https://gradle.com/s/irklrtroiqzeu The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=79e7db1f-857e-43eb-af3a-9eb7d25ec571, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 4084629 log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-4084629.out.log ----- Last 20 lines from daemon log file - daemon-4084629.out.log ----- > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 3m 52s 104 actionable tasks: 8 executed, 96 up-to-date Publishing build scan... https://gradle.com/s/irklrtroiqzeu Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
