See 
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/53/display/redirect?page=changes>

Changes:

[scott] Add helper task to print pipeline options for Dataflow portability

[scott] Refactor build tasks for cleaning up docker container registry

------------------------------------------
[...truncated 18.23 MB...]
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.232Z: Fusing consumer PAssert$27/RunChecks into 
PAssert$27/GetPane/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.269Z: Fusing consumer 
PAssert$27/GroupGlobally/Values/Values/Map into 
PAssert$27/GroupGlobally/GroupDummyAndContents/GroupByWindow
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.308Z: Fusing consumer 
PAssert$27/GroupGlobally/ParDo(Concat) into 
PAssert$27/GroupGlobally/Values/Values/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.346Z: Unzipping flatten s43-u80 for input 
s45-reify-value58-c78
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.378Z: Fusing unzipped copy of 
PAssert$27/GroupGlobally/GroupDummyAndContents/Write, through flatten s43-u80, 
into producer PAssert$27/GroupGlobally/GroupDummyAndContents/Reify
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.412Z: Fusing consumer 
PAssert$27/GroupGlobally/GroupDummyAndContents/Reify into 
PAssert$27/GroupGlobally/WindowIntoDummy/Window.Assign
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.449Z: Fusing consumer 
PAssert$27/GroupGlobally/GroupDummyAndContents/Write into 
PAssert$27/GroupGlobally/GroupDummyAndContents/Reify
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.490Z: Fusing consumer 
Create123/Read(CreateSource)/ParDo(ReadFromBoundedSource) into 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.541Z: Fusing consumer 
PAssert$27/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.632Z: Fusing consumer 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable 
into 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.697Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.788Z: Fusing consumer 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
 into 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.843Z: Fusing consumer 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write 
into 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.878Z: Fusing consumer 
PAssert$27/GroupGlobally/WindowIntoDummy/Window.Assign into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.914Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
 into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:41.953Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
 into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.003Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
 into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.045Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
 into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.080Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
 into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.120Z: Fusing consumer OutputSideInputs into 
Create123/Read(CreateSource)/ParDo(ReadFromBoundedSource)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.157Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
 into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
 with random key
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.189Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
 with random key into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.229Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
 into PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Impulse
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.270Z: Fusing consumer 
PAssert$27/GroupGlobally/KeyForDummy/AddKeys/Map into 
PAssert$27/GroupGlobally/RewindowActuals/Window.Assign
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.302Z: Fusing consumer 
PAssert$27/GroupGlobally/RewindowActuals/Window.Assign into 
PAssert$27/GroupGlobally/GatherAllOutputs/Values/Values/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.341Z: Fusing consumer 
PAssert$27/GroupGlobally/GatherAllOutputs/Values/Values/Map into 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.381Z: Fusing consumer 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.411Z: Fusing consumer 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Write into 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.446Z: Fusing consumer 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into 
PAssert$27/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.483Z: Fusing consumer 
PAssert$27/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into 
PAssert$27/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.520Z: Fusing consumer 
PAssert$27/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into 
PAssert$27/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.559Z: Fusing consumer 
PAssert$27/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into 
PAssert$27/GroupGlobally/Window.Into()/Window.Assign
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.598Z: Fusing consumer 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.631Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.668Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.708Z: Fusing consumer 
Create47/Read(CreateSource)/ParDo(SplitBoundedSource) into 
Create47/Read(CreateSource)/Impulse
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.744Z: Fusing consumer 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable 
into 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.781Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.814Z: Fusing consumer 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify 
into 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.843Z: Fusing consumer 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
 into Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.878Z: Fusing consumer 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into 
Create123/Read(CreateSource)/ParDo(SplitBoundedSource)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.916Z: Fusing consumer 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
 into 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.953Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:42.991Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.029Z: Fusing consumer 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Read
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.065Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.103Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.143Z: Fusing consumer 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify 
into 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.177Z: Fusing consumer 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
 into 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.214Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.262Z: Fusing consumer 
Create123/Read(CreateSource)/ParDo(SplitBoundedSource) into 
Create123/Read(CreateSource)/Impulse
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.299Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
 into Create47/Read(CreateSource)/ParDo(ReadFromBoundedSource)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.336Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.370Z: Fusing consumer 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
 into Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.401Z: Fusing consumer 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into 
Create47/Read(CreateSource)/ParDo(SplitBoundedSource)
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.439Z: Fusing consumer 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
 into 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.473Z: Fusing consumer 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write 
into 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.511Z: Fusing consumer 
Create47/Read(CreateSource)/ParDo(ReadFromBoundedSource) into 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.890Z: Executing operation 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.926Z: Executing operation 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.960Z: Starting 1 workers in us-central1-b...
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.960Z: Executing operation 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:43.985Z: Executing operation 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Create
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:44.023Z: Executing operation 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:44.064Z: Executing operation 
PAssert$27/GroupGlobally/GroupDummyAndContents/Create
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:44.101Z: Executing operation 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:44.391Z: Executing operation 
Create123/Read(CreateSource)/Impulse+Create123/Read(CreateSource)/ParDo(SplitBoundedSource)+Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
 with random 
key+Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:44.426Z: Executing operation 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Impulse+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
 with random 
key+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Nov 08, 2018 5:35:49 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:44.524Z: Executing operation 
Create47/Read(CreateSource)/Impulse+Create47/Read(CreateSource)/ParDo(SplitBoundedSource)+Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair
 with random 
key+Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
    Nov 08, 2018 5:35:57 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:35:54.864Z: Autoscaling: Raised the number of workers 
to 0 based on the rate of progress in the currently running step(s).
    Nov 08, 2018 5:38:06 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:03.925Z: Autoscaling: Raised the number of workers 
to 1 based on the rate of progress in the currently running step(s).
    Nov 08, 2018 5:38:06 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:03.961Z: Autoscaling: Would further reduce the 
number of workers but reached the minimum number allowed for the job.
    Nov 08, 2018 5:38:15 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:12.400Z: Workers have started successfully.
    Nov 08, 2018 5:38:15 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:12.436Z: Workers have started successfully.
    Nov 08, 2018 5:38:34 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:34.352Z: Executing operation 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Nov 08, 2018 5:38:34 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:34.454Z: Executing operation 
Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Create47/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+Create47/Read(CreateSource)/ParDo(ReadFromBoundedSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
    Nov 08, 2018 5:38:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:41.759Z: Executing operation 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Nov 08, 2018 5:38:45 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:44.102Z: Executing operation 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
    Nov 08, 2018 5:38:45 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:44.189Z: Executing operation 
PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+PAssert$27/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+PAssert$27/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$27/GroupGlobally/GroupDummyAndContents/Reify+PAssert$27/GroupGlobally/GroupDummyAndContents/Write
    Nov 08, 2018 5:38:51 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:50.788Z: Executing operation 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
    Nov 08, 2018 5:38:51 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:50.868Z: Executing operation 
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
    Nov 08, 2018 5:38:58 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:57.637Z: Executing operation 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
    Nov 08, 2018 5:38:58 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:38:57.758Z: Executing operation 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
    Nov 08, 2018 5:39:08 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:07.575Z: Executing operation 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
    Nov 08, 2018 5:39:08 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:07.824Z: Executing operation 
Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Create123/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+Create123/Read(CreateSource)/ParDo(ReadFromBoundedSource)+OutputSideInputs+PAssert$27/GroupGlobally/Window.Into()/Window.Assign+PAssert$27/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$27/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$27/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Write
    Nov 08, 2018 5:39:14 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:12.405Z: Executing operation 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Close
    Nov 08, 2018 5:39:14 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:12.507Z: Executing operation 
PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$27/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$27/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$27/GroupGlobally/RewindowActuals/Window.Assign+PAssert$27/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$27/GroupGlobally/GroupDummyAndContents/Reify+PAssert$27/GroupGlobally/GroupDummyAndContents/Write
    Nov 08, 2018 5:39:17 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:16.946Z: Executing operation 
PAssert$27/GroupGlobally/GroupDummyAndContents/Close
    Nov 08, 2018 5:39:17 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:17.032Z: Executing operation 
PAssert$27/GroupGlobally/GroupDummyAndContents/Read+PAssert$27/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$27/GroupGlobally/Values/Values/Map+PAssert$27/GroupGlobally/ParDo(Concat)+PAssert$27/GetPane/Map+PAssert$27/RunChecks+PAssert$27/VerifyAssertions/ParDo(DefaultConclude)
    Nov 08, 2018 5:39:23 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:22.841Z: Cleaning up.
    Nov 08, 2018 5:39:23 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:39:22.958Z: Stopping worker pool...
    Nov 08, 2018 5:42:30 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:42:28.973Z: Autoscaling: Resized worker pool from 1 to 
0.
    Nov 08, 2018 5:42:30 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:42:29.005Z: Autoscaling: Would further reduce the 
number of workers but reached the minimum number allowed for the job.
    Nov 08, 2018 5:42:30 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
    INFO: 2018-11-08T05:42:29.047Z: Worker pool stopped.
    Nov 08, 2018 5:42:35 AM 
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
    INFO: Job 2018-11-07_21_35_32-8176276763261782037 finished with status DONE.
    Nov 08, 2018 5:42:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner 
checkForPAssertSuccess
    INFO: Success result for Dataflow job 
2018-11-07_21_35_32-8176276763261782037. Found 0 success, 0 failures out of 0 
expected assertions.

Gradle Test Executor 96 finished executing tests.

> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerTest

159 tests completed, 1 failed, 2 skipped
Finished generating test XML results (0.562 secs) into: 
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerFnApiWorkerTest>
Generating HTML test report...
Finished generating test html results (0.627 secs) into: 
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerTest>

> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerTest 
> FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerTest 
(Thread[Task worker for ':' Thread 14,5,main]) completed. Took 3 hrs 13 mins 
5.526 secs.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task 
worker for ':' Thread 14,5,main]) started.

> Task :beam-runners-google-cloud-dataflow-java:cleanUpDockerImages
Caching disabled for task 
':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages': Caching has not 
been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages' is not 
up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: 
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java>
 Command: docker rmi 
us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181108022620
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181108022620
Untagged: 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d3c54680851d849ddcfe656cd33b9b2dc79f3bbb1cb05321e688cc9148969e9
Starting process 'command 'gcloud''. Working directory: 
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java>
 Command: gcloud --quiet container images delete --force-delete-tags 
us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181108022620
Successfully started process 'command 'gcloud''
Digests:
- 
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d3c54680851d849ddcfe656cd33b9b2dc79f3bbb1cb05321e688cc9148969e9
  Associated tags:
 - 20181108022620
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181108022620
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181108022620].
Deleted 
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d3c54680851d849ddcfe656cd33b9b2dc79f3bbb1cb05321e688cc9148969e9].
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task 
worker for ':' Thread 14,5,main]) completed. Took 2.852 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task 
':beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerTest'.
> There were failing tests. See the report at: 
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerTest/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to 
get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See 
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3h 16m 31s
76 actionable tasks: 70 executed, 5 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/gg6fxcwxe5chi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Reply via email to