See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/14/display/redirect?page=changes>
Changes:
[thw] Mention portable Flink runner support for state and timers in 2.9.0
------------------------------------------
[...truncated 8.10 MB...]
INFO: Adding PAssert$8/GroupGlobally/GroupDummyAndContents as step s31
Dec 17, 2018 2:19:53 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$8/GroupGlobally/Values/Values/Map as step s32
Dec 17, 2018 2:19:53 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$8/GroupGlobally/ParDo(Concat) as step s33
Dec 17, 2018 2:19:53 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$8/GetPane/Map as step s34
Dec 17, 2018 2:19:53 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$8/RunChecks as step s35
Dec 17, 2018 2:19:53 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$8/VerifyAssertions/ParDo(DefaultConclude) as step s36
Dec 17, 2018 2:19:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://temp-storage-for-end-to-end-tests/pardotest0basictests0testpardoemptyoutputs-jenkins-1217141938-45ca04b4/output/results/staging/
Dec 17, 2018 2:19:53 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <75774 bytes, hash lST_lHM3tL9GLk7mYm4LfQ> to
gs://temp-storage-for-end-to-end-tests/pardotest0basictests0testpardoemptyoutputs-jenkins-1217141938-45ca04b4/output/results/staging/pipeline-lST_lHM3tL9GLk7mYm4LfQ.pb
org.apache.beam.sdk.transforms.ParDoTest$BasicTests > testParDoEmptyOutputs
STANDARD_OUT
Dataflow SDK version: 2.10.0-SNAPSHOT
org.apache.beam.sdk.transforms.ParDoTest$BasicTests > testParDoEmptyOutputs
STANDARD_ERROR
Dec 17, 2018 2:19:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-17_06_19_53-14433492684120448856?project=apache-beam-testing
org.apache.beam.sdk.transforms.ParDoTest$BasicTests > testParDoEmptyOutputs
STANDARD_OUT
Submitted job: 2018-12-17_06_19_53-14433492684120448856
org.apache.beam.sdk.transforms.ParDoTest$BasicTests > testParDoEmptyOutputs
STANDARD_ERROR
Dec 17, 2018 2:19:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2018-12-17_06_19_53-14433492684120448856
Dec 17, 2018 2:19:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner
run
INFO: Running Dataflow job 2018-12-17_06_19_53-14433492684120448856 with 0
expected assertions.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:19:53.570Z: Autoscaling is enabled for job
2018-12-17_06_19_53-14433492684120448856. The number of workers will be between
1 and 1000.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:19:53.621Z: Autoscaling was automatically enabled for
job 2018-12-17_06_19_53-14433492684120448856.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-12-17T14:20:01.100Z: The workflow name is not a valid Cloud
Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring
will be labeled with this modified job name:
pardotest0basictests0testpardoemptyoutputs-jenkins-1217141-enr8. For the best
monitoring experience, please name your job with a valid Cloud Label. For
details, see:
https://cloud.google.com/compute/docs/labeling-resources#restrictions
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:07.129Z: Checking permissions granted to controller
Service Account.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:17.352Z: Worker configuration: n1-standard-1 in
us-central1-b.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:18.265Z: Expanding CollectionToSingleton operations
into optimizable parts.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:18.578Z: Expanding CoGroupByKey operations into
optimizable parts.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.037Z: Expanding GroupByKey operations into
optimizable parts.
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.334Z: Fusing adjacent ParDo, Read, Write, and
Flatten operations
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.390Z: Elided trivial flatten
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.434Z: Elided trivial flatten
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.484Z: Elided trivial flatten
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.534Z: Unzipping flatten s29 for input
s17.org.apache.beam.sdk.values.PCollection.<init>:402#bf6a8cd0eccecd8b
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.579Z: Fusing unzipped copy of
PAssert$8/GroupGlobally/GroupDummyAndContents/Reify, through flatten
PAssert$8/GroupGlobally/FlattenDummyAndContents, into producer
PAssert$8/GroupGlobally/KeyForDummy/AddKeys/Map
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.625Z: Fusing consumer
PAssert$8/VerifyAssertions/ParDo(DefaultConclude) into PAssert$8/RunChecks
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.672Z: Unzipping flatten s29-u40 for input
s31-reify-value18-c38
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.716Z: Fusing unzipped copy of
PAssert$8/GroupGlobally/GroupDummyAndContents/Write, through flatten s29-u40,
into producer PAssert$8/GroupGlobally/GroupDummyAndContents/Reify
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.765Z: Fusing consumer
PAssert$8/GroupGlobally/GroupDummyAndContents/GroupByWindow into
PAssert$8/GroupGlobally/GroupDummyAndContents/Read
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.815Z: Fusing consumer
PAssert$8/GroupGlobally/Values/Values/Map into
PAssert$8/GroupGlobally/GroupDummyAndContents/GroupByWindow
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.854Z: Fusing consumer PAssert$8/GetPane/Map into
PAssert$8/GroupGlobally/ParDo(Concat)
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.902Z: Fusing consumer PAssert$8/RunChecks into
PAssert$8/GetPane/Map
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.948Z: Fusing consumer
PAssert$8/GroupGlobally/ParDo(Concat) into
PAssert$8/GroupGlobally/Values/Values/Map
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:19.997Z: Fusing consumer
PAssert$8/GroupGlobally/GroupDummyAndContents/Reify into
PAssert$8/GroupGlobally/WindowIntoDummy/Window.Assign
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.047Z: Fusing consumer
PAssert$8/GroupGlobally/GroupDummyAndContents/Write into
PAssert$8/GroupGlobally/GroupDummyAndContents/Reify
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.092Z: Fusing consumer
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random
key
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.131Z: Fusing consumer
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.180Z: Fusing consumer
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
PAssert$8/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.216Z: Fusing consumer
PAssert$8/GroupGlobally/WindowIntoDummy/Window.Assign into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.264Z: Fusing consumer
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.357Z: Fusing consumer
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.601Z: Fusing consumer
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.715Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:20.973Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:21.142Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:21.449Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:21.644Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:21.838Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:22.448Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:22.750Z: Fusing consumer
PAssert$8/GroupGlobally/GatherAllOutputs/Values/Values/Map into
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:23.103Z: Fusing consumer
PAssert$8/GroupGlobally/Window.Into()/Window.Assign into TestDoFn
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:23.339Z: Fusing consumer
PAssert$8/GroupGlobally/RewindowActuals/Window.Assign into
PAssert$8/GroupGlobally/GatherAllOutputs/Values/Values/Map
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:23.523Z: Fusing consumer
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:23.817Z: Fusing consumer
Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource) into
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:23.915Z: Fusing consumer
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
into Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:24.037Z: Fusing consumer
PAssert$8/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into
PAssert$8/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:24.241Z: Fusing consumer
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:24.451Z: Fusing consumer
PAssert$8/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
PAssert$8/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:24.749Z: Fusing consumer
PAssert$8/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into
PAssert$8/GroupGlobally/Window.Into()/Window.Assign
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:24.983Z: Fusing consumer
PAssert$8/GroupGlobally/KeyForDummy/AddKeys/Map into
PAssert$8/GroupGlobally/RewindowActuals/Window.Assign
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:25.036Z: Fusing consumer
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:25.421Z: Fusing consumer
Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource) into
Create.Values/Read(CreateSource)/Impulse
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:25.536Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
into PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Impulse
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:25.652Z: Fusing consumer
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random key into
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:25.743Z: Fusing consumer TestDoFn into
Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:26.923Z: Executing operation
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:26.966Z: Executing operation
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:26.995Z: Executing operation
PAssert$8/GroupGlobally/GroupDummyAndContents/Create
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:27.013Z: Starting 1 workers in us-central1-b...
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:27.035Z: Executing operation
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:30.506Z: Executing operation
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Impulse+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 17, 2018 2:20:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:30.735Z: Executing operation
Create.Values/Read(CreateSource)/Impulse+Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
with random
key+Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 17, 2018 2:20:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:20:39.307Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Dec 17, 2018 2:21:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:18.189Z: Workers have started successfully.
Dec 17, 2018 2:21:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:20.480Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Dec 17, 2018 2:21:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:20.526Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Dec 17, 2018 2:21:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:49.248Z: Workers have started successfully.
Dec 17, 2018 2:21:50 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:50.127Z: Executing operation
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 17, 2018 2:21:50 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:50.225Z: Executing operation
Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+TestDoFn+PAssert$8/GroupGlobally/Window.Into()/Window.Assign+PAssert$8/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$8/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$8/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Dec 17, 2018 2:21:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:52.890Z: Executing operation
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 17, 2018 2:21:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:21:53.331Z: Executing operation
PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+PAssert$8/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+PAssert$8/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$8/GroupGlobally/GroupDummyAndContents/Reify+PAssert$8/GroupGlobally/GroupDummyAndContents/Write
Dec 17, 2018 2:22:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:22:03.690Z: Executing operation
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Dec 17, 2018 2:22:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:22:03.773Z: Executing operation
PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$8/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$8/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$8/GroupGlobally/RewindowActuals/Window.Assign+PAssert$8/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$8/GroupGlobally/GroupDummyAndContents/Reify+PAssert$8/GroupGlobally/GroupDummyAndContents/Write
Dec 17, 2018 2:22:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:22:06.130Z: Executing operation
PAssert$8/GroupGlobally/GroupDummyAndContents/Close
Dec 17, 2018 2:22:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:22:06.215Z: Executing operation
PAssert$8/GroupGlobally/GroupDummyAndContents/Read+PAssert$8/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$8/GroupGlobally/Values/Values/Map+PAssert$8/GroupGlobally/ParDo(Concat)+PAssert$8/GetPane/Map+PAssert$8/RunChecks+PAssert$8/VerifyAssertions/ParDo(DefaultConclude)
Dec 17, 2018 2:22:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:22:11.682Z: Cleaning up.
Dec 17, 2018 2:22:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:22:11.839Z: Stopping worker pool...
Dec 17, 2018 2:23:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:23:41.022Z: Autoscaling: Resized worker pool from 1 to
0.
Dec 17, 2018 2:23:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:23:41.065Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Dec 17, 2018 2:23:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-17T14:23:41.125Z: Worker pool stopped.
Dec 17, 2018 2:23:47 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-12-17_06_19_53-14433492684120448856 finished with status
DONE.
Dec 17, 2018 2:23:47 PM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-12-17_06_19_53-14433492684120448856. Found 0 success, 0 failures out of 0
expected assertions.
Gradle Test Executor 33 finished executing tests.
> Task
> :beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest
> FAILED
72 tests completed, 1 failed, 1 skipped
Finished generating test XML results (0.216 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerFnApiWorkerExecutableStageTest>
Generating HTML test report...
Finished generating test html results (0.31 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest
(Thread[Task worker for ':' Thread 29,5,main]) completed. Took 1 hrs 37 mins
5.393 secs.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task
worker for ':' Thread 29,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:cleanUpDockerImages
Caching disabled for task
':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages': Caching has not
been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages' is not
up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java>
Command: docker rmi
us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181217124424
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181217124424
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccd3ea3950bfdabb305af3a6d176a50ec1bb0d56ce5153b9c04ff8318d9f6295
Starting process 'command 'gcloud''. Working directory:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java>
Command: gcloud --quiet container images delete --force-delete-tags
us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181217124424
Successfully started process 'command 'gcloud''
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccd3ea3950bfdabb305af3a6d176a50ec1bb0d56ce5153b9c04ff8318d9f6295
Associated tags:
- 20181217124424
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181217124424
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181217124424].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ccd3ea3950bfdabb305af3a6d176a50ec1bb0d56ce5153b9c04ff8318d9f6295].
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task
worker for ':' Thread 29,5,main]) completed. Took 2.256 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 39m 38s
75 actionable tasks: 69 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/zq4oqwrwgzpmg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
