See <https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Streaming/735/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-12302] [zetasql] Support/test TIMESTAMP as UDF argument/return [Ismaël Mejía] [BEAM-12241] Upgrade vendored bytebuddy to version 1.11.0 [Boyuan Zhang] Revert "[BEAM-8706] Bump antlr4 to 4.9.2" [noreply] Update release notes for 2.29.0 [n] [BEAM-7819] Add missing fields to python [Kyle Weaver] [BEAM-12106] [zetasql] Support ARRAY type in Java UDF. [heejong] [BEAM-12321] Failure in test_run_packable_combine_per_key and [daniel.o.programmer] [BEAM-11418] Small fixes to Go xlang artifact staging. [noreply] Minor: name pipeline_v1 import to match rest of SDK. (#14775) ------------------------------------------ [...truncated 76.92 KB...] > Task :sdks:java:core:compileJava UP-TO-DATE > Task :sdks:java:core:classes UP-TO-DATE > Task :sdks:java:core:shadowJar UP-TO-DATE > Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :sdks:java:io:synthetic:compileJava UP-TO-DATE > Task :sdks:java:io:synthetic:classes UP-TO-DATE > Task :sdks:java:io:synthetic:jar UP-TO-DATE > Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:fn-execution:compileJava UP-TO-DATE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:jar UP-TO-DATE > Task :sdks:java:fn-execution:jar UP-TO-DATE > Task :sdks:java:io:kinesis:compileJava UP-TO-DATE > Task :sdks:java:io:kinesis:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:io:kinesis:jar UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar UP-TO-DATE > Task :runners:core-construction-java:compileJava UP-TO-DATE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :runners:core-construction-java:jar UP-TO-DATE > Task :runners:core-java:compileJava UP-TO-DATE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE > Task :sdks:java:harness:compileJava UP-TO-DATE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar UP-TO-DATE > Task :sdks:java:harness:shadowJar UP-TO-DATE > Task :runners:java-fn-execution:compileJava UP-TO-DATE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar UP-TO-DATE > Task :sdks:java:expansion-service:compileJava UP-TO-DATE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar UP-TO-DATE > Task :sdks:java:io:kafka:compileJava UP-TO-DATE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE > Task :sdks:java:testing:load-tests:compileJava UP-TO-DATE > Task :sdks:java:testing:load-tests:classes UP-TO-DATE > Task :sdks:java:testing:load-tests:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE > Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava > UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar UP-TO-DATE > Task :sdks:java:testing:load-tests:run May 13, 2021 12:19:48 PM org.apache.beam.runners.dataflow.DataflowRunner validateSdkContainerImageOptions WARNING: Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage. May 13, 2021 12:19:48 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create INFO: No stagingLocation provided, falling back to gcpTempLocation May 13, 2021 12:19:49 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 188 files. Enable logging at DEBUG level to see which files will be staged. May 13, 2021 12:19:49 PM org.apache.beam.sdk.Pipeline validate WARNING: The following transforms do not have stable unique names: Collect end time metric May 13, 2021 12:19:49 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services. May 13, 2021 12:19:51 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/ May 13, 2021 12:19:52 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage INFO: Uploading <130359 bytes, hash 9437d81be184a23a2079bbdd3f8100572aee6a8746d7afd50736b2a0a81433be> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-lDfYG-GEojogebvdP4EAVyruaodG16_VBzayoKgUM74.pb May 13, 2021 12:19:53 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Uploading 189 files from PipelineOptions.filesToStage to staging location to prepare for execution. May 13, 2021 12:19:53 PM org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes forFileToStage INFO: Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.31.0-SNAPSHOT-kcdnZjdrL6vP4zyu35nUD2TE0MvljukBlrfoT5jRa_I.jar May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements INFO: Staging files complete: 189 files cached, 0 files newly uploaded in 0 seconds May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1 May 13, 2021 12:19:54 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split INFO: Split into 64 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@617389a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1c8f6a90, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3050ac2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@265bd546, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1937eaff, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7e0bc8a3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4b0f2299, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@33063f5b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@15405bd6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@352ed70d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@70730db, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5793b87, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12704e15, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@512575e9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6f1a16fe, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2373ad99, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@33634f04, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4993febc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7601bc96, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@48a0c8aa, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6192a5d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3722c145, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4cbc2e3b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2975a9e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@765ffb14, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@57562473, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7a360554, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@424de326, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4bc33720, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2dd0f797, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@67064bdc, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a7fd0c9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@18578491, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3291b443, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@671c4166, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53d13cd4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@77865933, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@480ad82c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4d18b73a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@177515d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@52ff99cd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c2af006, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@44032fde, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7b676112, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5578be42, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4e49ce2b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@136965e3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53c6f96d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@435cc7f9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4364712f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1b7a52dd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7f93dd4e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5ad5be4a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3ad85136, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@737d100a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12e5da86, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6535117e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1d1cbd0f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6fa13e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3af7d855, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@77049094, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@f88bfbe, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@59bbe88a, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5d8ab698] May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Read input/StripIds as step s2 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect start time metric as step s3 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect metrics as step s4 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Window.Into()/Window.Assign as step s5 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 0/Map as step s6 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 0/GroupByKey as step s7 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 0/Combine.GroupedValues as step s8 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric as step s9 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 1/Map as step s10 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 1/GroupByKey as step s11 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 1/Combine.GroupedValues as step s12 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric2 as step s13 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 2/Map as step s14 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 2/GroupByKey as step s15 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 2/Combine.GroupedValues as step s16 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric3 as step s17 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Convert to Long: 3/Map as step s18 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 3/GroupByKey as step s19 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Combine: 3/Combine.GroupedValues as step s20 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding Collect end time metric4 as step s21 May 13, 2021 12:19:54 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.31.0-SNAPSHOT May 13, 2021 12:19:55 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-05-13_05_19_54-12691646133921040399?project=apache-beam-testing May 13, 2021 12:19:55 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-05-13_05_19_54-12691646133921040399 May 13, 2021 12:19:55 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-05-13_05_19_54-12691646133921040399 May 13, 2021 12:20:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2021-05-13T12:19:59.732Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java0dataflow0streaming0combine04-jenkins-05131-2m2n. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions May 13, 2021 12:20:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:04.470Z: Worker configuration: n1-standard-4 in us-central1-f. May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.248Z: Expanding CoGroupByKey operations into optimizable parts. May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.445Z: Expanding SplittableProcessKeyed operations into optimizable parts. May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.478Z: Expanding GroupByKey operations into streaming Read/Write steps May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.633Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.832Z: Fusing adjacent ParDo, Read, Write, and Flatten operations May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.870Z: Fusing consumer Convert to Long: 1/Map into Window.Into()/Window.Assign May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.903Z: Fusing consumer Convert to Long: 2/Map into Window.Into()/Window.Assign May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.940Z: Fusing consumer Convert to Long: 3/Map into Window.Into()/Window.Assign May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.966Z: Fusing consumer Convert to Long: 0/Map into Window.Into()/Window.Assign May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:05.992Z: Fusing consumer Read input/StripIds into Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.025Z: Fusing consumer Collect start time metric into Read input/StripIds May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.088Z: Fusing consumer Collect metrics into Collect start time metric May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.122Z: Fusing consumer Window.Into()/Window.Assign into Collect metrics May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.151Z: Fusing consumer Combine: 1/GroupByKey/WriteStream into Convert to Long: 1/Map May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.187Z: Fusing consumer Combine: 1/Combine.GroupedValues into Combine: 1/GroupByKey/ReadStream May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.220Z: Fusing consumer Collect end time metric2 into Combine: 1/Combine.GroupedValues May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.253Z: Fusing consumer Combine: 2/GroupByKey/WriteStream into Convert to Long: 2/Map May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.286Z: Fusing consumer Combine: 2/Combine.GroupedValues into Combine: 2/GroupByKey/ReadStream May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.316Z: Fusing consumer Collect end time metric3 into Combine: 2/Combine.GroupedValues May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.344Z: Fusing consumer Combine: 3/GroupByKey/WriteStream into Convert to Long: 3/Map May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.372Z: Fusing consumer Combine: 3/Combine.GroupedValues into Combine: 3/GroupByKey/ReadStream May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.404Z: Fusing consumer Collect end time metric4 into Combine: 3/Combine.GroupedValues May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.437Z: Fusing consumer Combine: 0/GroupByKey/WriteStream into Convert to Long: 0/Map May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.473Z: Fusing consumer Combine: 0/Combine.GroupedValues into Combine: 0/GroupByKey/ReadStream May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.529Z: Fusing consumer Collect end time metric into Combine: 0/Combine.GroupedValues May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:06.990Z: Executing operation Combine: 0/GroupByKey/ReadStream+Combine: 0/Combine.GroupedValues+Collect end time metric May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:07.023Z: Executing operation Combine: 3/GroupByKey/ReadStream+Combine: 3/Combine.GroupedValues+Collect end time metric4 May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:07.071Z: Starting 16 ****s in us-central1-f... May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:07.071Z: Executing operation Combine: 2/GroupByKey/ReadStream+Combine: 2/Combine.GroupedValues+Collect end time metric3 May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:07.110Z: Executing operation Combine: 1/GroupByKey/ReadStream+Combine: 1/Combine.GroupedValues+Collect end time metric2 May 13, 2021 12:20:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:07.135Z: Executing operation Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Read input/StripIds+Collect start time metric+Collect metrics+Window.Into()/Window.Assign+Convert to Long: 1/Map+Convert to Long: 2/Map+Convert to Long: 3/Map+Convert to Long: 0/Map+Combine: 1/GroupByKey/WriteStream+Combine: 2/GroupByKey/WriteStream+Combine: 3/GroupByKey/WriteStream+Combine: 0/GroupByKey/WriteStream May 13, 2021 12:20:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:16.437Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete May 13, 2021 12:20:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:49.541Z: Autoscaling: Raised the number of ****s to 15 so that the pipeline can catch up with its backlog and keep up with its input rate. May 13, 2021 12:20:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:20:49.574Z: Resized **** pool to 15, though goal was 16. This could be a quota issue. May 13, 2021 12:21:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:21:15.099Z: Workers have started successfully. May 13, 2021 12:21:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:21:15.123Z: Workers have started successfully. May 13, 2021 12:23:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-05-13T12:23:05.763Z: Autoscaling: Raised the number of ****s to 16 so that the pipeline can catch up with its backlog and keep up with its input rate. > Task :sdks:java:testing:load-tests:run FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=35284c77-8002-4e04-b0e4-a093e8c6b995, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Streaming/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 21158 log file: /home/jenkins/.gradle/daemon/6.8.3/daemon-21158.out.log ----- Last 20 lines from daemon log file - daemon-21158.out.log ----- INFO: 2021-05-13T12:23:05.763Z: Autoscaling: Raised the number of ****s to 16 so that the pipeline can catch up with its backlog and keep up with its input rate. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:load-tests:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 4m 18s 87 actionable tasks: 1 executed, 86 up-to-date ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
