See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/1021/display/redirect?page=changes>
Changes:
[relax] Add convenience methods to create TopCombineFns. Type-specific methods
[relax] Allow Coders to be explicitly specified in composed CombineFns for the
[relax] Apply spotless.
[relax] Address comments.
[relax] Revert unexpected changes.
------------------------------------------
[...truncated 18.69 MB...]
INFO: Adding PAssert$28/GroupGlobally/WindowIntoDummy/Window.Assign as step
s34
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
PAssert$28/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s35
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/GroupGlobally/FlattenDummyAndContents as step s36
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/GroupGlobally/NeverTrigger/Flatten.PCollections as
step s37
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/GroupGlobally/GroupDummyAndContents as step s38
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/GroupGlobally/Values/Values/Map as step s39
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/GroupGlobally/ParDo(Concat) as step s40
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/GetPane/Map as step s41
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/RunChecks as step s42
Sep 12, 2018 6:34:05 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$28/VerifyAssertions/ParDo(DefaultConclude) as step s43
Sep 12, 2018 6:34:05 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://temp-storage-for-validates-runner-tests//withtimestampstest0withtimestampslambdashouldapplytimestamps-jenkins-0912063401-a41ea9ee/output/results/staging/
Sep 12, 2018 6:34:06 AM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <87367 bytes, hash X5iDLRIUvbm7Eoz0Lp4Bmw> to
gs://temp-storage-for-validates-runner-tests//withtimestampstest0withtimestampslambdashouldapplytimestamps-jenkins-0912063401-a41ea9ee/output/results/staging/pipeline-X5iDLRIUvbm7Eoz0Lp4Bmw.pb
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsLambdaShouldApplyTimestamps STANDARD_OUT
Dataflow SDK version: 2.8.0-SNAPSHOT
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsLambdaShouldApplyTimestamps STANDARD_ERROR
Sep 12, 2018 6:34:08 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-09-11_23_34_06-16148944772497322411?project=apache-beam-testing
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsLambdaShouldApplyTimestamps STANDARD_OUT
Submitted job: 2018-09-11_23_34_06-16148944772497322411
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsLambdaShouldApplyTimestamps STANDARD_ERROR
Sep 12, 2018 6:34:08 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2018-09-11_23_34_06-16148944772497322411
Sep 12, 2018 6:34:08 AM org.apache.beam.runners.dataflow.TestDataflowRunner
run
INFO: Running Dataflow job 2018-09-11_23_34_06-16148944772497322411 with 2
expected assertions.
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:06.524Z: Autoscaling is enabled for job
2018-09-11_23_34_06-16148944772497322411. The number of workers will be between
1 and 1000.
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:06.564Z: Autoscaling was automatically enabled for
job 2018-09-11_23_34_06-16148944772497322411.
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-09-12T06:34:11.147Z: The workflow name is not a valid Cloud
Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring
will be labeled with this modified job name:
withtimestampstest0withtimestampslambdashouldapplytimestam-43ez. For the best
monitoring experience, please name your job with a valid Cloud Label. For
details, see:
https://cloud.google.com/compute/docs/labeling-resources#restrictions
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:11.514Z: Checking permissions granted to controller
Service Account.
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:16.284Z: Worker configuration: n1-standard-1 in
us-central1-b.
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:16.732Z: Expanding CoGroupByKey operations into
optimizable parts.
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:16.924Z: Expanding GroupByKey operations into
optimizable parts.
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:16.964Z: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.226Z: Fusing adjacent ParDo, Read, Write, and
Flatten operations
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.260Z: Elided trivial flatten
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.294Z: Elided trivial flatten
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.333Z: Elided trivial flatten
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.369Z: Elided trivial flatten
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.410Z: Elided trivial flatten
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.459Z: Elided trivial flatten
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.497Z: Fusing consumer ParDo(Anonymous) into
WithTimestamps/AddTimestamps
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.540Z: Fusing consumer
PAssert$27/GroupGlobally/Window.Into()/Window.Assign into
WithTimestamps/AddTimestamps
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.585Z: Unzipping flatten s16 for input
s11.org.apache.beam.sdk.values.PCollection.<init>:384#b0fb911e967c6511
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.630Z: Fusing unzipped copy of
PAssert$27/GroupGlobally/GroupDummyAndContents/Reify, through flatten
PAssert$27/GroupGlobally/FlattenDummyAndContents, into producer
PAssert$27/GroupGlobally/KeyForDummy/AddKeys/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.676Z: Fusing consumer PAssert$27/GetPane/Map into
PAssert$27/GroupGlobally/ParDo(Concat)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.720Z: Fusing consumer
PAssert$27/VerifyAssertions/ParDo(DefaultConclude) into PAssert$27/RunChecks
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.774Z: Fusing consumer
PAssert$28/VerifyAssertions/ParDo(DefaultConclude) into PAssert$28/RunChecks
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.825Z: Unzipping flatten s16-u40 for input
s18-reify-value0-c38
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.868Z: Fusing unzipped copy of
PAssert$27/GroupGlobally/GroupDummyAndContents/Write, through flatten s16-u40,
into producer PAssert$27/GroupGlobally/GroupDummyAndContents/Reify
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.922Z: Fusing consumer PAssert$27/RunChecks into
PAssert$27/GetPane/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:17.968Z: Fusing consumer PAssert$28/GetPane/Map into
PAssert$28/GroupGlobally/ParDo(Concat)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.013Z: Fusing consumer PAssert$28/RunChecks into
PAssert$28/GetPane/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.054Z: Fusing consumer
PAssert$28/GroupGlobally/Values/Values/Map into
PAssert$28/GroupGlobally/GroupDummyAndContents/GroupByWindow
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.097Z: Fusing consumer
PAssert$28/GroupGlobally/ParDo(Concat) into
PAssert$28/GroupGlobally/Values/Values/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.142Z: Fusing consumer
PAssert$27/GroupGlobally/GroupDummyAndContents/GroupByWindow into
PAssert$27/GroupGlobally/GroupDummyAndContents/Read
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.180Z: Fusing consumer
PAssert$27/GroupGlobally/Values/Values/Map into
PAssert$27/GroupGlobally/GroupDummyAndContents/GroupByWindow
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.225Z: Fusing consumer
PAssert$27/GroupGlobally/ParDo(Concat) into
PAssert$27/GroupGlobally/Values/Values/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.267Z: Fusing consumer
PAssert$28/GroupGlobally/GroupDummyAndContents/GroupByWindow into
PAssert$28/GroupGlobally/GroupDummyAndContents/Read
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.306Z: Fusing consumer
PAssert$28/GroupGlobally/GroupDummyAndContents/Write into
PAssert$28/GroupGlobally/GroupDummyAndContents/Reify
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.351Z: Unzipping flatten s36 for input
s31.org.apache.beam.sdk.values.PCollection.<init>:384#bae4c0026b38f8d4
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.395Z: Fusing unzipped copy of
PAssert$28/GroupGlobally/GroupDummyAndContents/Reify, through flatten
PAssert$28/GroupGlobally/FlattenDummyAndContents, into producer
PAssert$28/GroupGlobally/KeyForDummy/AddKeys/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.442Z: Fusing consumer
PAssert$27/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into
PAssert$27/GroupGlobally/Window.Into()/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.488Z: Fusing consumer
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.531Z: Fusing consumer
PAssert$28/GroupGlobally/GatherAllOutputs/Values/Values/Map into
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.574Z: Fusing consumer
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.615Z: Fusing consumer
PAssert$28/GroupGlobally/KeyForDummy/AddKeys/Map into
PAssert$28/GroupGlobally/RewindowActuals/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.664Z: Fusing consumer
PAssert$28/GroupGlobally/RewindowActuals/Window.Assign into
PAssert$28/GroupGlobally/GatherAllOutputs/Values/Values/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.714Z: Fusing consumer
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
PAssert$28/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.758Z: Fusing consumer
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.804Z: Fusing consumer
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
PAssert$27/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.855Z: Fusing consumer
PAssert$28/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
PAssert$28/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.927Z: Fusing consumer
PAssert$28/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into
PAssert$28/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:18.988Z: Fusing consumer
PAssert$28/GroupGlobally/Window.Into()/Window.Assign into ParDo(Anonymous)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.042Z: Fusing consumer
PAssert$28/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into
PAssert$28/GroupGlobally/Window.Into()/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.118Z: Fusing consumer
PAssert$27/GroupGlobally/KeyForDummy/AddKeys/Map into
PAssert$27/GroupGlobally/RewindowActuals/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.170Z: Fusing consumer
PAssert$27/GroupGlobally/RewindowActuals/Window.Assign into
PAssert$27/GroupGlobally/GatherAllOutputs/Values/Values/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.211Z: Fusing consumer
PAssert$27/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into
PAssert$27/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.246Z: Fusing consumer
PAssert$27/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
PAssert$27/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.283Z: Fusing consumer
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.316Z: Fusing consumer
PAssert$27/GroupGlobally/GatherAllOutputs/Values/Values/Map into
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.360Z: Fusing consumer
WithTimestamps/AddTimestamps into Create.Values/Read(CreateSource)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.404Z: Fusing consumer
PAssert$28/GroupGlobally/GroupDummyAndContents/Reify into
PAssert$28/GroupGlobally/WindowIntoDummy/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.451Z: Fusing consumer
PAssert$27/GroupGlobally/GroupDummyAndContents/Write into
PAssert$27/GroupGlobally/GroupDummyAndContents/Reify
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.496Z: Fusing consumer
PAssert$27/GroupGlobally/GroupDummyAndContents/Reify into
PAssert$27/GroupGlobally/WindowIntoDummy/Window.Assign
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.540Z: Fusing consumer
PAssert$27/GroupGlobally/WindowIntoDummy/Window.Assign into
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:19.589Z: Fusing consumer
PAssert$28/GroupGlobally/WindowIntoDummy/Window.Assign into
PAssert$28/GroupGlobally/Create.Values/Read(CreateSource)
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.055Z: Executing operation
PAssert$27/GroupGlobally/GroupDummyAndContents/Create
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.102Z: Executing operation
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.134Z: Starting 1 workers in us-central1-b...
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.146Z: Executing operation
PAssert$28/GroupGlobally/GroupDummyAndContents/Create
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.189Z: Executing operation
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.423Z: Executing operation
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$27/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$27/GroupGlobally/GroupDummyAndContents/Reify+PAssert$27/GroupGlobally/GroupDummyAndContents/Write
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.467Z: Executing operation
PAssert$28/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$28/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$28/GroupGlobally/GroupDummyAndContents/Reify+PAssert$28/GroupGlobally/GroupDummyAndContents/Write
Sep 12, 2018 6:34:24 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:20.516Z: Executing operation
Create.Values/Read(CreateSource)+WithTimestamps/AddTimestamps+ParDo(Anonymous)+PAssert$27/GroupGlobally/Window.Into()/Window.Assign+PAssert$27/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$28/GroupGlobally/Window.Into()/Window.Assign+PAssert$28/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$28/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$28/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Write+PAssert$27/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$27/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Sep 12, 2018 6:34:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:36.333Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Sep 12, 2018 6:34:53 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:52.684Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Sep 12, 2018 6:34:53 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:34:52.728Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Sep 12, 2018 6:35:06 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:04.188Z: Workers have started successfully.
Sep 12, 2018 6:35:06 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:04.225Z: Workers have started successfully.
Sep 12, 2018 6:35:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:31.153Z: Executing operation
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Sep 12, 2018 6:35:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:31.191Z: Executing operation
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Sep 12, 2018 6:35:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:31.249Z: Executing operation
PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$28/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$28/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$28/GroupGlobally/RewindowActuals/Window.Assign+PAssert$28/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$28/GroupGlobally/GroupDummyAndContents/Reify+PAssert$28/GroupGlobally/GroupDummyAndContents/Write
Sep 12, 2018 6:35:32 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:31.295Z: Executing operation
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$27/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$27/GroupGlobally/RewindowActuals/Window.Assign+PAssert$27/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$27/GroupGlobally/GroupDummyAndContents/Reify+PAssert$27/GroupGlobally/GroupDummyAndContents/Write
Sep 12, 2018 6:35:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:36.104Z: Executing operation
PAssert$27/GroupGlobally/GroupDummyAndContents/Close
Sep 12, 2018 6:35:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:36.210Z: Executing operation
PAssert$27/GroupGlobally/GroupDummyAndContents/Read+PAssert$27/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$27/GroupGlobally/Values/Values/Map+PAssert$27/GroupGlobally/ParDo(Concat)+PAssert$27/GetPane/Map+PAssert$27/RunChecks+PAssert$27/VerifyAssertions/ParDo(DefaultConclude)
Sep 12, 2018 6:35:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:38.839Z: Executing operation
PAssert$28/GroupGlobally/GroupDummyAndContents/Close
Sep 12, 2018 6:35:40 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:38.924Z: Executing operation
PAssert$28/GroupGlobally/GroupDummyAndContents/Read+PAssert$28/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$28/GroupGlobally/Values/Values/Map+PAssert$28/GroupGlobally/ParDo(Concat)+PAssert$28/GetPane/Map+PAssert$28/RunChecks+PAssert$28/VerifyAssertions/ParDo(DefaultConclude)
Sep 12, 2018 6:35:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:42.423Z: Cleaning up.
Sep 12, 2018 6:35:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:35:42.518Z: Stopping worker pool...
Sep 12, 2018 6:37:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:37:37.663Z: Autoscaling: Resized worker pool from 1 to
0.
Sep 12, 2018 6:37:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-12T06:37:37.696Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Sep 12, 2018 6:37:46 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-09-11_23_34_06-16148944772497322411 finished with status
DONE.
Sep 12, 2018 6:37:46 AM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-09-11_23_34_06-16148944772497322411. Found 2 success, 0 failures out of 2
expected assertions.
Gradle Test Executor 41 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
217 tests completed, 2 failed, 2 skipped
Finished generating test XML results (0.522 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.6 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task
worker for ':' Thread 52,5,main]) completed. Took 2 hrs 17 mins 49.103 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 19m 29s
33 actionable tasks: 29 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/rjmdr467a2ii4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
