See <https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Streaming/468/display/redirect>
Changes: ------------------------------------------ [...truncated 86.24 KB...] > Task :sdks:java:testing:test-utils:jar UP-TO-DATE > Task :runners:core-java:compileJava UP-TO-DATE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar UP-TO-DATE > Task :sdks:java:harness:compileJava UP-TO-DATE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar UP-TO-DATE > Task :sdks:java:harness:shadowJar UP-TO-DATE > Task :runners:java-fn-execution:compileJava UP-TO-DATE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar UP-TO-DATE > Task :sdks:java:expansion-service:compileJava UP-TO-DATE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar UP-TO-DATE > Task :runners:direct-java:compileJava UP-TO-DATE > Task :runners:direct-java:classes UP-TO-DATE > Task :runners:direct-java:shadowJar UP-TO-DATE > Task :sdks:java:io:kafka:compileJava UP-TO-DATE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE > Task :sdks:java:testing:load-tests:compileJava UP-TO-DATE > Task :sdks:java:testing:load-tests:classes UP-TO-DATE > Task :sdks:java:testing:load-tests:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE > Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava > UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar UP-TO-DATE > Task :sdks:java:testing:load-tests:run Aug 17, 2020 12:19:01 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation Aug 17, 2020 12:19:02 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 181 files. Enable logging at DEBUG level to see which files will be staged. Aug 17, 2020 12:19:02 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Collect end time metric Aug 17, 2020 12:19:02 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. Aug 17, 2020 12:19:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 182 files from PipelineOptions.filesToStage to staging location to prepare for execution. Aug 17, 2020 12:19:04 PM org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes forFileToStage INFO: Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.25.0-SNAPSHOT-8vrE1OvmgMZzeZD6ORX0UkyV98d1ZVOw1oj68kUiuhs.jar Aug 17, 2020 12:19:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 182 files cached, 0 files newly uploaded in 0 seconds Aug 17, 2020 12:19:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 Aug 17, 2020 12:19:05 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 64 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@67b7c170, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@67440de6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@889d9e8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5246a3b3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ba354ca, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c4f4365, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@acf859d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6df3e44c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7ce7e83c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a05d8ae, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3c904f1e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4eb30d44, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@d56aaa6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6972c30a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@57a48985, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1ab6718, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3910fe11, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@460510aa, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@351e414e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6fd77352, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5109e8cf, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3f672204, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@78b41097, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2c2db130, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@327c7bea, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@348d18a3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6c65860d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2d000e80, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7cf283e1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@20e6c4dc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@60737b23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4d2a1da3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@252f626c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@33f98231, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@48284d0e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@557286ad, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@b10a26d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74075134, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7e4d2287, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3f4b840d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@31464a43, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7f8633ae, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68c87fc3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc0f53b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@8d7b252, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4682eba5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6d9fb2d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@61fafb74, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@540a903b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58496dc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@151db587, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@238acd0b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@23811a09, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2125ad3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7a5b769b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@f4c0e4e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@24361cfc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@34e20e6b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@15ac59c2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7a7d1b47, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6eb82908, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a8df3e2, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3d98d138, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2f2d52ef] Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metric as step s3 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect metrics as step s4 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s5 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 0/Map as step s6 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 0/GroupByKey as step s7 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 0/Combine.GroupedValues as step s8 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric as step s9 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 1/Map as step s10 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 1/GroupByKey as step s11 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 1/Combine.GroupedValues as step s12 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric2 as step s13 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 2/Map as step s14 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 2/GroupByKey as step s15 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 2/Combine.GroupedValues as step s16 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric3 as step s17 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 3/Map as step s18 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 3/GroupByKey as step s19 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 3/Combine.GroupedValues as step s20 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric4 as step s21 Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging pipeline description to gs://temp-storage-for-perf-tests/loadtests/staging/ Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <102806 bytes, hash 78e34d74f173396ce57391e0d9d8f241860a6bb7dce302d9d30b5f73ff1c29b3> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-eONNdPFzOWzlc5Hg2djyQYYKa7fc4wLZ0wtfc_8cKbM.pb Aug 17, 2020 12:19:05 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.25.0-SNAPSHOT Aug 17, 2020 12:19:06 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-17_05_19_05-11294295924183698930?project=apache-beam-testing Aug 17, 2020 12:19:06 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2020-08-17_05_19_05-11294295924183698930 Aug 17, 2020 12:19:06 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2020-08-17_05_19_05-11294295924183698930 Aug 17, 2020 12:19:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2020-08-17T12:19:09.716Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java0dataflow0streaming0combine04-jenkins-08171-y82y. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions Aug 17, 2020 12:19:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.270Z: Worker configuration: n1-standard-4 in us-central1-f. Aug 17, 2020 12:19:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.825Z: Expanding CoGroupByKey operations into optimizable parts. Aug 17, 2020 12:19:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.843Z: Expanding SplittableProcessKeyed operations into optimizable parts. Aug 17, 2020 12:19:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.845Z: Expanding GroupByKey operations into streaming Read/Write steps Aug 17, 2020 12:19:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.855Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Aug 17, 2020 12:19:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.880Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Aug 17, 2020 12:19:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.882Z: Fusing consumer Convert to Long: 1/Map into Window.Into()/Window.Assign Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.884Z: Fusing consumer Convert to Long: 2/Map into Window.Into()/Window.Assign Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.886Z: Fusing consumer Convert to Long: 3/Map into Window.Into()/Window.Assign Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.888Z: Fusing consumer Convert to Long: 0/Map into Window.Into()/Window.Assign Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.890Z: Fusing consumer Read input/StripIds into Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.892Z: Fusing consumer Collect start time metric into Read input/StripIds Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.894Z: Fusing consumer Collect metrics into Collect start time metric Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.896Z: Fusing consumer Window.Into()/Window.Assign into Collect metrics Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.898Z: Fusing consumer Combine: 1/GroupByKey/WriteStream into Convert to Long: 1/Map Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.900Z: Fusing consumer Combine: 1/Combine.GroupedValues into Combine: 1/GroupByKey/ReadStream Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.902Z: Fusing consumer Collect end time metric2 into Combine: 1/Combine.GroupedValues Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.904Z: Fusing consumer Combine: 2/GroupByKey/WriteStream into Convert to Long: 2/Map Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.907Z: Fusing consumer Combine: 2/Combine.GroupedValues into Combine: 2/GroupByKey/ReadStream Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.909Z: Fusing consumer Collect end time metric3 into Combine: 2/Combine.GroupedValues Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.911Z: Fusing consumer Combine: 3/GroupByKey/WriteStream into Convert to Long: 3/Map Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.913Z: Fusing consumer Combine: 3/Combine.GroupedValues into Combine: 3/GroupByKey/ReadStream Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.915Z: Fusing consumer Collect end time metric4 into Combine: 3/Combine.GroupedValues Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.916Z: Fusing consumer Combine: 0/GroupByKey/WriteStream into Convert to Long: 0/Map Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.918Z: Fusing consumer Combine: 0/Combine.GroupedValues into Combine: 0/GroupByKey/ReadStream Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:13.920Z: Fusing consumer Collect end time metric into Combine: 0/Combine.GroupedValues Aug 17, 2020 12:19:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:14.132Z: Starting 16 ****s... Aug 17, 2020 12:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:16.810Z: Executing operation Combine: 3/GroupByKey/ReadStream+Combine: 3/Combine.GroupedValues+Collect end time metric4 Aug 17, 2020 12:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:16.810Z: Executing operation Combine: 1/GroupByKey/ReadStream+Combine: 1/Combine.GroupedValues+Collect end time metric2 Aug 17, 2020 12:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:16.811Z: Executing operation Combine: 0/GroupByKey/ReadStream+Combine: 0/Combine.GroupedValues+Collect end time metric Aug 17, 2020 12:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:16.816Z: Executing operation Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Read input/StripIds+Collect start time metric+Collect metrics+Window.Into()/Window.Assign+Convert to Long: 1/Map+Convert to Long: 2/Map+Convert to Long: 3/Map+Convert to Long: 0/Map+Combine: 1/GroupByKey/WriteStream+Combine: 2/GroupByKey/WriteStream+Combine: 3/GroupByKey/WriteStream+Combine: 0/GroupByKey/WriteStream Aug 17, 2020 12:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:16.856Z: Executing operation Combine: 2/GroupByKey/ReadStream+Combine: 2/Combine.GroupedValues+Collect end time metric3 Aug 17, 2020 12:19:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2020-08-17T12:19:25.165Z: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Aug 17, 2020 12:19:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:31.196Z: Unable to bring up enough ****s. Will retry in 5 seconds. Aug 17, 2020 12:19:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:42.750Z: Unable to bring up enough ****s. Will retry in 5 seconds. Aug 17, 2020 12:19:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:48.602Z: Unable to bring up enough ****s. Will retry in 5 seconds. Aug 17, 2020 12:19:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:19:54.286Z: Unable to bring up enough ****s. Will retry in 5 seconds. Aug 17, 2020 12:20:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:20:04.265Z: Worker configuration: n1-standard-4 in us-central1-f. Aug 17, 2020 12:20:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2020-08-17T12:20:07.979Z: Workers have started successfully. Aug 17, 2020 12:23:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2020-08-17T12:23:05.350Z: The Compute Engine API has not fully initialized. Please try again in a few minutes. Causes: Unable to get GCE information for project apache-beam-testing. > Task :sdks:java:testing:load-tests:run FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 24s 73 actionable tasks: 1 executed, 72 up-to-date Publishing build scan... The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=23c64aee-3c3b-4c3b-869e-3f185b8dc6d3, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Streaming/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 379 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-379.out.log ----- Last 20 lines from daemon log file - daemon-379.out.log ----- FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 24s 73 actionable tasks: 1 executed, 72 up-to-date Publishing build scan... Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
