See
<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/1240/display/redirect>
------------------------------------------
[...truncated 323.17 KB...]
INFO: 2018-11-06T20:23:27.369Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.414Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.449Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.478Z: Fusing consumer
PAssert$0/CreateActual/FilterActuals/Window.Assign into Calculate
hashcode/ProduceDefault
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.517Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Calculate hashcode/ProduceDefault
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.554Z: Fusing consumer Read all
files/FileIO.MatchAll/Match filepatterns into Values/Values/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.591Z: Fusing consumer Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Calculate
hashcode/Values/Values/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.629Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/WithKeys/AddKeys/Map into
PAssert$0/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.668Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.705Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.744Z: Fusing consumer Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Values/Values/Map into Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.780Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.817Z: Fusing consumer Calculate
hashcode/WithKeys/AddKeys/Map into Read all files/TextIO.ReadFiles/Read all via
FileBasedSource/Read ranges
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.859Z: Fusing consumer Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Read
all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.887Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.923Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate
hashcode/WithKeys/AddKeys/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.961Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:27.998Z: Fusing consumer Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.037Z: Fusing consumer Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into
Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.076Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Finalize into Write content to
files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.112Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.149Z: Fusing consumer Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into
Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.185Z: Fusing consumer Calculate
hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.212Z: Fusing consumer Calculate
hashcode/Values/Values/Map into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.250Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
into Write content to
files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.279Z: Fusing consumer Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Pair with random key
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.315Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
into Write content to
files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.345Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via FileBasedSource/Read ranges into Read all
files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Values/Values/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.379Z: Fusing consumer Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Pair with random key into Read all
files/FileIO.MatchAll/Match filepatterns
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.415Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign into Read all
files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Pair with random
key
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.446Z: Fusing consumer Values/Values/Map into
Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.484Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.526Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.555Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via FileBasedSource/Split into ranges into Read
all files/FileIO.ReadMatches/ParDo(ToReadableFile)
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.588Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.614Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.647Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Pair with random
key into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Split
into ranges
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.681Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.718Z: Fusing consumer Read all
files/FileIO.ReadMatches/ParDo(ToReadableFile) into Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Values/Values/Map
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.755Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Values/Values/Map
into Read all files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.780Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.818Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.858Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.895Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.924Z: Fusing consumer Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.956Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key into Write content to
files/WriteFiles/FinalizeTempFileBundles/Finalize
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:28.983Z: Unzipping flatten s8 for input
s4.writtenRecords
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.013Z: Fusing unzipped copy of Write content to
files/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow),
through flatten Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections, into
producer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.051Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
into Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.090Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into
Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.120Z: Fusing consumer Produce text lines into
Generate sequence/Read(BoundedCountingSource)
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.151Z: Fusing consumer Write content to
files/WriteFiles/RewindowIntoGlobal/Window.Assign into Produce text lines
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.189Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
into Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.227Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into Write
content to files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.266Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into Write
content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.292Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into
Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.325Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into
Write content to files/WriteFiles/RewindowIntoGlobal/Window.Assign
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.363Z: Fusing consumer
PAssert$0/WindowToken/Window.Assign into
PAssert$0/Create.Values/Read(CreateSource)
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.391Z: Fusing consumer
PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.429Z: Fusing consumer PAssert$0/RunChecks into
PAssert$0/WindowToken/Window.Assign
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.871Z: Executing operation Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.902Z: Executing operation Read all
files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.934Z: Executing operation Read all
files/TextIO.ReadFiles/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.957Z: Starting 1 workers in us-central1-b...
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:29.972Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:30.008Z: Executing operation
PAssert$0/CreateActual/GatherPanes/GroupByKey/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:30.029Z: Executing operation Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:30.067Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:30.114Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:30.154Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:30.190Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Nov 06, 2018 8:23:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:30.548Z: Executing operation Generate
sequence/Read(BoundedCountingSource)+Produce text lines+Write content to
files/WriteFiles/RewindowIntoGlobal/Window.Assign+Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write
content to
files/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+Write
content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write
content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Nov 06, 2018 8:23:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:23:48.500Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Nov 06, 2018 8:24:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:24:20.876Z: Workers have started successfully.
Nov 06, 2018 8:24:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:24:44.911Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Nov 06, 2018 8:24:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:24:44.950Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Nov 06, 2018 8:32:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-06T20:32:11.346Z: Workers have started successfully.
STDERR: Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note:
<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/src/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/util/GcsUtil.java>
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note:
<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/src/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/ServerFactory.java>
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note:
<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/src/sdks/java/io/xml/src/test/java/org/apache/beam/sdk/io/xml/JAXBCoderTest.java>
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Note:
<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/src/sdks/java/io/file-based-io-tests/src/test/java/org/apache/beam/sdk/io/tfrecord/TFRecordIOIT.java>
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
2018-11-06 20:39:50,910 6902c4e2 MainThread beam_integration_benchmark(1/1)
ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 160, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-11-06 20:39:50,912 6902c4e2 MainThread beam_integration_benchmark(1/1)
INFO Cleaning up benchmark beam_integration_benchmark
2018-11-06 20:39:50,915 6902c4e2 MainThread beam_integration_benchmark(1/1)
ERROR Exception running benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 860, in RunBenchmarkTask
RunBenchmark(spec, collector)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 719, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 580, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 160, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-11-06 20:39:50,915 6902c4e2 MainThread beam_integration_benchmark(1/1)
ERROR Benchmark 1/1 beam_integration_benchmark (UID:
beam_integration_benchmark0) failed. Execution will continue.
2018-11-06 20:39:50,929 6902c4e2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed
Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-11-06 20:39:50,930 6902c4e2 MainThread INFO Complete logs can be found
at:
<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/runs/6902c4e2/pkb.log>
2018-11-06 20:39:50,930 6902c4e2 MainThread INFO Completion statuses can be
found at:
<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/runs/6902c4e2/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
