See
<https://ci-beam.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/6246/display/redirect?page=changes>
Changes:
[noreply] 21730 fix offset resetting (#22450)
[noreply] Bump google.golang.org/api from 0.88.0 to 0.89.0 in /sdks (#22464)
[noreply] Upgrades pip before installing Beam for Python default expansion
service
------------------------------------------
[...truncated 348.38 KB...]
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.398Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.435Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.475Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.506Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.541Z: Unzipping flatten s57-u108 for input
s59.org.apache.beam.sdk.values.PCollection.<init>:408#d928e938ba0454ea-c106
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.631Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$0/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.670Z: Unzipping flatten s53 for input
s48.org.apache.beam.sdk.values.PCollection.<init>:408#764b6639189c6083
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.705Z: Fusing unzipped copy of
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map,
through flatten Calculate hashcode/Flatten.PCollections, into producer
Calculate hashcode/Values/Values/Map
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.738Z: Unzipping flatten s53-c110 for input
s48.org.apache.beam.sdk.values.PCollection.<init>:408#764b6639189c6083
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.770Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous), through flatten
Calculate hashcode/Flatten.PCollections, into producer Calculate
hashcode/Values/Values/Map
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.800Z: Unzipping flatten s8 for input
s4.writtenRecords
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.841Z: Fusing unzipped copy of Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map, through
flatten Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections, into
producer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.899Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify into Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.937Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write into Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:51.956Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow into
Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.003Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.039Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Drop key/Values/Map into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.063Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Gather bundles into Write xml
files/WriteFiles/GatherTempFileResults/Drop key/Values/Map
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.097Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key into Write xml files/WriteFiles/GatherTempFileResults/Gather bundles
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.134Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.157Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.185Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.217Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.254Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.275Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map
into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.297Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Finalize into Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.319Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key into Write xml files/WriteFiles/FinalizeTempFileBundles/Finalize
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.348Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.376Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.419Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.452Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.485Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.515Z: Fusing consumer Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
into Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jul 27, 2022 8:20:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.548Z: Fusing consumer Gather write end time into
Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.646Z: Fusing consumer Get file names/Values/Map
into Gather write end time
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.677Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Pair with random key into Find files/Match
filepatterns
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.707Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Find
files/Reshuffle.ViaRandomKey/Pair with random key
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.734Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.767Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.801Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.837Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.894Z: Fusing consumer Find
files/Reshuffle.ViaRandomKey/Values/Values/Map into Find
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.919Z: Fusing consumer Read matched
files/ParDo(ToReadableFile) into Find
files/Reshuffle.ViaRandomKey/Values/Values/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.951Z: Fusing consumer Gather read start time into
Read matched files/ParDo(ToReadableFile)
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:52.992Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Split into ranges into Gather read start time
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.015Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key into Read xml
files/ReadAllViaFileBasedSource/Split into ranges
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.042Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.075Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read
xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.110Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.146Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.180Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.217Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.242Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Read ranges into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.269Z: Fusing consumer Gather read end time into
Read xml files/ReadAllViaFileBasedSource/Read ranges
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.297Z: Fusing consumer Map xml records to
strings/Map into Gather read end time
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.331Z: Fusing consumer Calculate
hashcode/WithKeys/AddKeys/Map into Map xml records to strings/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.365Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate
hashcode/WithKeys/AddKeys/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.419Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.448Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.467Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.500Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.532Z: Fusing consumer Calculate
hashcode/Values/Values/Map into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.634Z: Unzipping flatten s8-u138 for input
s9.org.apache.beam.sdk.values.PCollection.<init>:408#20ff67585e33a8f6-c136
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.669Z: Fusing unzipped copy of Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign,
through flatten Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1,
into producer Write xml files/WriteFiles/GatherTempFileResults/Add void
key/AddKeys/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.697Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.731Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
into Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.769Z: Fusing consumer
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) into Calculate
hashcode/ProduceDefault
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.799Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Calculate hashcode/ProduceDefault
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.826Z: Fusing consumer Create xml records/Map into
Generate sequence/Read(BoundedCountingSource)
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.891Z: Fusing consumer Gather write start time
into Create xml records/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.925Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into
Gather write start time
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:53.953Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into
Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.008Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into
Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.038Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.067Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.101Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.135Z: Fusing consumer Calculate
hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.171Z: Fusing consumer
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.199Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/Reify into
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.726Z: Executing operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jul 27, 2022 8:20:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:54.814Z: Starting 5 ****s in us-central1-a...
Jul 27, 2022 8:20:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:55.344Z: Finished operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jul 27, 2022 8:20:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:55.651Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create
Jul 27, 2022 8:20:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:55.804Z: Finished operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create
Jul 27, 2022 8:20:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:56.055Z: Executing operation Generate
sequence/Read(BoundedCountingSource)+Create xml records/Map+Gather write start
time+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write
xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write
xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Jul 27, 2022 8:20:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:20:56.542Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jul 27, 2022 8:21:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:21:34.559Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Jul 27, 2022 8:22:01 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-27T20:22:01.604Z: Workers have started successfully.
org.apache.beam.sdk.io.xml.XmlIOIT > writeThenReadAll SKIPPED
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for
':' Thread 3,5,main]) completed. Took 2 mins 11.267 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 1' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/7.4/userguide/java_testing.html#sec:test_execution
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 23s
153 actionable tasks: 91 executed, 60 from cache, 2 up-to-date
Publishing build scan...
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=c4195cb4-67bb-4e85-8332-fe4e72b1b721,
currentDir=<https://ci-beam.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 1751328
log file: /home/jenkins/.gradle/daemon/7.4/daemon-1751328.out.log
----- Last 20 lines from daemon log file - daemon-1751328.out.log -----
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/7.4/userguide/java_testing.html#sec:test_execution
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 23s
153 actionable tasks: 91 executed, 60 from cache, 2 up-to-date
Publishing build scan...
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
