See
<https://ci-beam.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/4109/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11076] Reuse TriggerProto translation in
------------------------------------------
[...truncated 365.49 KB...]
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.230Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Split into ranges into Gather read start time
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.258Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key into Read xml
files/ReadAllViaFileBasedSource/Split into ranges
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.281Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.303Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read
xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.333Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.365Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.408Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.435Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.464Z: Fusing consumer Read xml
files/ReadAllViaFileBasedSource/Read ranges into Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.486Z: Fusing consumer Gather read end time into
Read xml files/ReadAllViaFileBasedSource/Read ranges
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.540Z: Fusing consumer Map xml records to
strings/Map into Gather read end time
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.569Z: Fusing consumer Calculate
hashcode/WithKeys/AddKeys/Map into Map xml records to strings/Map
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.597Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate
hashcode/WithKeys/AddKeys/Map
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.628Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.661Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.690Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.722Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.754Z: Fusing consumer Calculate
hashcode/Values/Values/Map into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.790Z: Unzipping flatten s8-u138 for input
s9.org.apache.beam.sdk.values.PCollection.<init>:402#20ff67585e33a8f6-c136
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.824Z: Fusing unzipped copy of Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign,
through flatten Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1,
into producer Write xml files/WriteFiles/GatherTempFileResults/Add void
key/AddKeys/Map
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.870Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.905Z: Fusing consumer Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
into Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.941Z: Fusing consumer
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) into Calculate
hashcode/ProduceDefault
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:20:59.976Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Calculate hashcode/ProduceDefault
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.007Z: Fusing consumer Create xml records/Map into
Generate sequence/Read(BoundedCountingSource)
Jan 29, 2021 6:21:00 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.037Z: Fusing consumer Gather write start time
into Create xml records/Map
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.069Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into
Gather write start time
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.102Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into
Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.134Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into
Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.169Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.201Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.236Z: Fusing consumer Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.259Z: Fusing consumer Calculate
hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.285Z: Fusing consumer
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.320Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/Reify into
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.786Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.823Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.857Z: Executing operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.872Z: Starting 5 ****s in us-central1-f...
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.892Z: Executing operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.921Z: Executing operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.930Z: Finished operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.947Z: Finished operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.947Z: Finished operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.947Z: Finished operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.953Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.977Z: Finished operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:00.987Z: Executing operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.012Z: Finished operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.029Z: Executing operation
PAssert$0/GroupGlobally/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.044Z: Finished operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.079Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.108Z: Finished operation
PAssert$0/GroupGlobally/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.117Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.136Z: Finished operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.177Z: Finished operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.478Z: Executing operation Generate
sequence/Read(BoundedCountingSource)+Create xml records/Map+Gather write start
time+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write
xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write
xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Jan 29, 2021 6:21:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:01.501Z: Executing operation
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GroupByKey/Reify+PAssert$0/GroupGlobally/GroupByKey/Write
Jan 29, 2021 6:21:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:13.203Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 29, 2021 6:21:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:31.214Z: Autoscaling: Raised the number of ****s to
4 based on the rate of progress in the currently running stage(s).
Jan 29, 2021 6:21:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:31.291Z: Resized **** pool to 4, though goal was 5.
This could be a quota issue.
Jan 29, 2021 6:21:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:41.554Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Jan 29, 2021 6:21:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:56.678Z: Workers have started successfully.
Jan 29, 2021 6:21:56 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:21:56.711Z: Workers have started successfully.
Jan 29, 2021 6:22:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:27.464Z: Finished operation
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GroupByKey/Reify+PAssert$0/GroupGlobally/GroupByKey/Write
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:42.778Z: Finished operation Generate
sequence/Read(BoundedCountingSource)+Create xml records/Map+Gather write start
time+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write
xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write
xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:42.986Z: Executing operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:43.040Z: Finished operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:43.450Z: Executing operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write
xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:44.829Z: Finished operation Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write
xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write xml
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+Write xml
files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:44.926Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:45.218Z: Finished operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:22:45 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:45.322Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable+Write xml
files/WriteFiles/GatherTempFileResults/Drop key/Values/Map+Write xml
files/WriteFiles/GatherTempFileResults/Gather bundles+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:22:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:50.082Z: Finished operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow+Write
xml files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable+Write xml
files/WriteFiles/GatherTempFileResults/Drop key/Values/Map+Write xml
files/WriteFiles/GatherTempFileResults/Gather bundles+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random
key+Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:22:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:50.147Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:22:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:50.371Z: Finished operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:22:51 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:50.656Z: Executing operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map+Write
xml files/WriteFiles/FinalizeTempFileBundles/Finalize+Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key+Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:22:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:56.524Z: Finished operation Write xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write
xml
files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map+Write
xml files/WriteFiles/FinalizeTempFileBundles/Finalize+Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key+Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:22:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:56.599Z: Executing operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:22:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:56.655Z: Finished operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:22:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:22:56.720Z: Executing operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Gather
write end time+Get file names/Values/Map+Find files/Match filepatterns+Find
files/Reshuffle.ViaRandomKey/Pair with random key+Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:23:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:03.293Z: Finished operation Write xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write
xml
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Gather
write end time+Get file names/Values/Map+Find files/Match filepatterns+Find
files/Reshuffle.ViaRandomKey/Pair with random key+Find
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:23:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:03.394Z: Executing operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:23:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:03.446Z: Finished operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:23:04 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:03.520Z: Executing operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Find
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Find
files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matched
files/ParDo(ToReadableFile)+Gather read start time+Read xml
files/ReadAllViaFileBasedSource/Split into ranges+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:23:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:06.913Z: Finished operation Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Find
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Find
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Find
files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matched
files/ParDo(ToReadableFile)+Gather read start time+Read xml
files/ReadAllViaFileBasedSource/Split into ranges+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
Jan 29, 2021 6:23:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:06.984Z: Executing operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:23:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:07.042Z: Finished operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
Jan 29, 2021 6:23:07 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-01-29T06:23:07.114Z: Executing operation Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read+Read xml
files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable+Read
xml files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map+Read xml
files/ReadAllViaFileBasedSource/Read ranges+Gather read end time+Map xml
records to strings/Map+Calculate hashcode/WithKeys/AddKeys/Map+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write
org.apache.beam.sdk.io.xml.XmlIOIT > writeThenReadAll SKIPPED
Watching 1541 directories to track changes
Watching 1543 directories to track changes
Watching 1544 directories to track changes
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for
':' Thread 6,5,main]) completed. Took 2 mins 50.438 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 1' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/6.8/userguide/java_testing.html#sec:test_execution
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 6s
124 actionable tasks: 74 executed, 50 from cache
Watching 1544 directories to track changes
Publishing build scan...
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=7b24e70b-497e-4444-af64-6415a2fdacbd,
currentDir=<https://ci-beam.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 1839
log file: /home/jenkins/.gradle/daemon/6.8/daemon-1839.out.log
----- Last 20 lines from daemon log file - daemon-1839.out.log -----
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 1' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/6.8/userguide/java_testing.html#sec:test_execution
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 6s
124 actionable tasks: 74 executed, 50 from cache
Watching 1544 directories to track changes
Publishing build scan...
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
