See
<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/1574/display/redirect?page=changes>
Changes:
[mxm] Remove undefined generic arguments for ExternalTransformBuilder
[mxm] [BEAM-6990] Use CoderTranslation for resolving coders in cross-language
[mxm] [BEAM-6990] Allow compound coders for externally configured transforms
[github] Pretty sure java cannot have local static field and miss a semicolon
[mxm] [BEAM-6730] Refactor generate_sequence Python wrapper
------------------------------------------
[...truncated 295.97 KB...]
INFO: 2019-04-08T20:15:34.621Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Read ranges into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.673Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.722Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.776Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Gather bundles into Write xml
files/WriteFiles/GatherTempFileResults/Drop key/Values/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.815Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key into Write xml files/WriteFiles/FinalizeTempFileBundles/Finalize
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.862Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.895Z: Fusing consumer Gather write end time into
Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.941Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Finalize into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:34.984Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.027Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
into Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.111Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.153Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.226Z: Fusing consumer Gather read start time into
Read matched files/ParDo(ToReadableFile)
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.276Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.328Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify into Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.370Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key into Read xml
files/ReadAllViaFileBasedSource/Split into ranges
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.413Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.460Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Split into ranges into Gather read start time
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.498Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.538Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.579Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.620Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.658Z: Fusing consumer Read matched
files/ParDo(ToReadableFile) into Find
files/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.692Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.742Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key into Write xml files/WriteFiles/GatherTempFileResults/Gather bundles
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.805Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Pair with random key into Find files/Match
filepatterns
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.857Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Drop key/Values/Map into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.904Z: Unzipping flatten s8 for input
s4.writtenRecords
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.948Z: Fusing unzipped copy of Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map, through
flatten Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections, into
producer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:35.982Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read
xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.022Z: Fusing consumer Get file names/Values/Map
into Gather write end time
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.062Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.098Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.121Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.166Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.212Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into
Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.252Z: Fusing consumer Gather write start time
into Create xml records/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.302Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.333Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into
Gather write start time
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.373Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.418Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into
Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.468Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.515Z: Fusing consumer Create xml records/Map into
Generate sequence/Read(BoundedCountingSource)
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.556Z: Fusing consumer
PAssert$0/GroupGlobally/Window.Into()/Window.Assign into Calculate
hashcode/ProduceDefault
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.591Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Calculate hashcode/ProduceDefault
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.626Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.669Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.716Z: Fusing consumer
PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into
PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.755Z: Fusing consumer
PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.799Z: Fusing consumer
PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into
PAssert$0/GroupGlobally/Window.Into()/Window.Assign
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.850Z: Fusing consumer
PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.905Z: Fusing consumer Calculate
hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.945Z: Fusing consumer
PAssert$0/GroupGlobally/GroupDummyAndContents/Reify into
PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:36.990Z: Fusing consumer
PAssert$0/GroupGlobally/GroupDummyAndContents/Write into
PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.032Z: Fusing consumer
PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign into
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.605Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.649Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.702Z: Executing operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.702Z: Starting 1 workers in us-central1-b...
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.764Z: Executing operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.812Z: Executing operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.853Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.911Z: Executing operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.946Z: Executing operation
PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:37.992Z: Executing operation
PAssert$0/GroupGlobally/GroupDummyAndContents/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:38.053Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:38.110Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:38.714Z: Executing operation Generate
sequence/Read(BoundedCountingSource)+Create xml records/Map+Gather write start
time+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write
xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write
xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Apr 08, 2019 8:15:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:38.772Z: Executing operation
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
Apr 08, 2019 8:15:53 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:15:52.255Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Apr 08, 2019 8:16:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:16:28.942Z: Workers have started successfully.
Apr 08, 2019 8:17:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:17:06.761Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Apr 08, 2019 8:17:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:17:06.799Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Apr 08, 2019 8:17:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:17:29.270Z: Workers have started successfully.
Apr 08, 2019 8:19:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:19:36.533Z: Autoscaling: Resizing worker pool from 1 to
2.
Apr 08, 2019 8:20:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:20:37.066Z: Autoscaling: Raised the number of workers
to 2 based on the rate of progress in the currently running step(s).
Apr 08, 2019 8:22:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:37.150Z: Executing operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Apr 08, 2019 8:22:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:37.386Z: Executing operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write
xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write
Apr 08, 2019 8:22:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:38.052Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Close
Apr 08, 2019 8:22:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:38.214Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable+Write xml
files/WriteFiles/GatherTempFileResults/Drop key/Values/Map+Write xml
files/WriteFiles/GatherTempFileResults/Gather bundles+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Apr 08, 2019 8:22:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:41.486Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Apr 08, 2019 8:22:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:41.659Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map+Write
xml files/WriteFiles/FinalizeTempFileBundles/Finalize+Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key+Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Apr 08, 2019 8:22:44 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:44.323Z: Executing operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Apr 08, 2019 8:22:44 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:44.523Z: Executing operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Gather
write end time+Get file names/Values/Map+Find files/Match filepatterns+Find
files/Reshuffle.ViaRandomKey/Pair with random key+Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Apr 08, 2019 8:22:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:48.695Z: Executing operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Apr 08, 2019 8:22:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:48.799Z: Executing operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Find
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Find
files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matched
files/ParDo(ToReadableFile)+Gather read start time+Read xml
files/ReadAllViaFileBasedSource/Split into ranges+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
Apr 08, 2019 8:22:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:51.450Z: Executing operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
Apr 08, 2019 8:22:51 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:22:51.540Z: Executing operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map+Read xml
files/ReadAllViaFileBasedSource/Read ranges+Gather read end time+Map xml
records to strings/Map+Calculate hashcode/WithKeys/AddKeys/Map+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write
Apr 08, 2019 8:26:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:26:02.782Z: Autoscaling: Resizing worker pool from 2 to
3.
Apr 08, 2019 8:27:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:27:02.906Z: Autoscaling: Raised the number of workers
to 3 based on the rate of progress in the currently running step(s).
Apr 08, 2019 8:27:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:27:54.419Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Close
Apr 08, 2019 8:27:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:27:54.507Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Calculate
hashcode/Values/Values/Map+Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/Window.Into()/Window.Assign+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write+PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Apr 08, 2019 8:27:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:27:57.919Z: Executing operation Calculate
hashcode/View.AsIterable/CreateDataflowView
Apr 08, 2019 8:28:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:27:58.134Z: Executing operation Calculate
hashcode/CreateVoid/Read(CreateSource)+Calculate
hashcode/ProduceDefault+PAssert$0/GroupGlobally/Window.Into()/Window.Assign+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write+PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Apr 08, 2019 8:28:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:27:59.971Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 08, 2019 8:28:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:00.015Z: Executing operation
PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Apr 08, 2019 8:28:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:00.068Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 08, 2019 8:28:00 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:00.120Z: Executing operation
PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$0/GroupGlobally/RewindowActuals/Window.Assign+PAssert$0/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
Apr 08, 2019 8:28:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:02.419Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 08, 2019 8:28:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:02.542Z: Executing operation
PAssert$0/GroupGlobally/GroupDummyAndContents/Close
Apr 08, 2019 8:28:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:02.583Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 08, 2019 8:28:03 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:02.656Z: Executing operation
PAssert$0/GroupGlobally/GroupDummyAndContents/Read+PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$0/GroupGlobally/Values/Values/Map+PAssert$0/GroupGlobally/ParDo(Concat)+PAssert$0/GetPane/Map+PAssert$0/RunChecks+PAssert$0/VerifyAssertions/ParDo(DefaultConclude)
Apr 08, 2019 8:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:05.801Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 08, 2019 8:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:06.035Z: Executing operation Delete test files
Apr 08, 2019 8:28:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:08.641Z: Cleaning up.
Apr 08, 2019 8:28:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-08T20:28:08.749Z: Stopping worker pool...
STDERR:
2019-04-08 20:34:44,831 3960ffc3 MainThread beam_integration_benchmark(1/1)
ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 748, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 599, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 160, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-04-08 20:34:44,833 3960ffc3 MainThread beam_integration_benchmark(1/1)
INFO Cleaning up benchmark beam_integration_benchmark
2019-04-08 20:34:44,836 3960ffc3 MainThread beam_integration_benchmark(1/1)
ERROR Exception running benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 891, in RunBenchmarkTask
RunBenchmark(spec, collector)
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 748, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 599, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 160, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-04-08 20:34:44,836 3960ffc3 MainThread beam_integration_benchmark(1/1)
ERROR Benchmark 1/1 beam_integration_benchmark (UID:
beam_integration_benchmark0) failed. Execution will continue.
2019-04-08 20:34:44,837 3960ffc3 MainThread beam_integration_benchmark(1/1)
INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed
Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-04-08 20:34:44,837 3960ffc3 MainThread beam_integration_benchmark(1/1)
INFO Complete logs can be found at:
<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/runs/3960ffc3/pkb.log>
2019-04-08 20:34:44,837 3960ffc3 MainThread beam_integration_benchmark(1/1)
INFO Completion statuses can be found at:
<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/runs/3960ffc3/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
