See
<https://ci-beam.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/7499/display/redirect?page=changes>
Changes:
[noreply] Bump transformers (#27108)
------------------------------------------
[...truncated 417.76 KB...]
Jun 26, 2023 6:01:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-06-26_11_01_15-17222349804710685446
Jun 26, 2023 6:01:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2023-06-26_11_01_15-17222349804710685446
Jun 26, 2023 6:01:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:32.737Z: Worker configuration: e2-standard-2 in
us-central1-a.
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:34.261Z: Expanding CoGroupByKey operations into
optimizable parts.
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:34.554Z: Expanding GroupByKey operations into
optimizable parts.
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:34.583Z: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:34.926Z: Fusing adjacent ParDo, Read, Write, and
Flatten operations
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:34.955Z: Elided trivial flatten
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:34.987Z: Unzipping flatten s9 for input
s5.writtenRecords
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.021Z: Fusing unzipped copy of Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Pair with random key,
through flatten Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections, into
producer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.051Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Reify
into Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/Window.Into()/Window.Assign
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.074Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Write
into Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Reify
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.097Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/GroupByWindow
into Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Read
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.120Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/ExpandIterable
into Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/GroupByWindow
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.151Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Values/Values/Map into Write
content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/ExpandIterable
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.173Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
into Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Values/Values/Map
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.206Z: Unzipping flatten s9-u99 for input
s10.org.apache.beam.sdk.values.PCollection.<init>:397#2587af97b4865538-c97
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.237Z: Fusing unzipped copy of Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/Window.Into()/Window.Assign,
through flatten Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1,
into producer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Pair with random key
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.267Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Pair with random key into
Write content to files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.288Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/Window.Into()/Window.Assign
into Write content to files/WriteFiles/GatherTempFileResults/Consolidate/Pair
with random key
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.320Z: Fusing consumer Produce text lines into
Generate sequence/Read(BoundedCountingSource)
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.352Z: Fusing consumer Collect write start time
into Produce text lines
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.385Z: Fusing consumer Write content to
files/WriteFiles/RewindowIntoGlobal/Window.Assign into Collect write start time
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.416Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into
Write content to files/WriteFiles/RewindowIntoGlobal/Window.Assign
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.449Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into
Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.481Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into
Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
Jun 26, 2023 6:01:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.512Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
into Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.543Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into Write
content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.575Z: Fusing consumer Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into Write
content to files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.609Z: Unzipping flatten s56 for input
s54.org.apache.beam.sdk.values.PCollection.<init>:397#7bd1cf570234be8b
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.630Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map, through flatten
PAssert$0/GroupGlobally/Flatten.PCollections, into producer
PAssert$0/GroupGlobally/ParDo(ToSingletonIterables)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.650Z: Created new flatten s52-c112 to unzip
producers of s53
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.682Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.714Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.745Z: Fusing consumer
PAssert$0/GroupGlobally/ParDo(ToSingletonIterables) into
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.777Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/Write into
PAssert$0/GroupGlobally/GroupByKey/Reify
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.808Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/GroupByWindow into
PAssert$0/GroupGlobally/GroupByKey/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.841Z: Fusing consumer
PAssert$0/GroupGlobally/Values/Values/Map into
PAssert$0/GroupGlobally/GroupByKey/GroupByWindow
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.872Z: Fusing consumer
PAssert$0/GroupGlobally/ParDo(Concat) into
PAssert$0/GroupGlobally/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.905Z: Fusing consumer PAssert$0/GetPane/Map into
PAssert$0/GroupGlobally/ParDo(Concat)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.926Z: Fusing consumer PAssert$0/RunChecks into
PAssert$0/GetPane/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.947Z: Fusing consumer
PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.968Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:35.999Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.030Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.061Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.093Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.127Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.160Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.185Z: Unzipping flatten s56-u110 for input
s58.org.apache.beam.sdk.values.PCollection.<init>:397#4f24fdb6be16210b-c108
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.216Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/GroupByKey/Reify, through flatten
PAssert$0/GroupGlobally/Flatten.PCollections/Unzipped-1, into producer
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.237Z: Unzipping flatten s52 for input
s47.org.apache.beam.sdk.values.PCollection.<init>:397#710158705210b615
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.269Z: Fusing unzipped copy of
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map,
through flatten Calculate hashcode/Flatten.PCollections, into producer
Calculate hashcode/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.300Z: Unzipping flatten s52-c112 for input
s47.org.apache.beam.sdk.values.PCollection.<init>:397#710158705210b615
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.335Z: Fusing unzipped copy of
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous), through flatten
Calculate hashcode/Flatten.PCollections, into producer Calculate
hashcode/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.368Z: Fusing consumer
PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) into Calculate
hashcode/ProduceDefault
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.399Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Calculate hashcode/ProduceDefault
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.433Z: Fusing consumer Match all files/Match
filepatterns into Collect write end time
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.465Z: Fusing consumer Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Calculate
hashcode/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.497Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/AsPossiblyEmptyList/Reify.ReifyView/ParDo(Anonymous)
into Write content to
files/WriteFiles/GatherTempFileResults/AsPossiblyEmptyList/Create.Values/Read(CreateSource)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.529Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/AsPossiblyEmptyList/Values/Values/Map
into Write content to
files/WriteFiles/GatherTempFileResults/AsPossiblyEmptyList/Reify.ReifyView/ParDo(Anonymous)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.564Z: Fusing consumer Write content to
files/WriteFiles/GatherTempFileResults/IterableToList/Map into Write content to
files/WriteFiles/GatherTempFileResults/AsPossiblyEmptyList/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.596Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Finalize into Write content to
files/WriteFiles/GatherTempFileResults/IterableToList/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.627Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key into Write content to
files/WriteFiles/FinalizeTempFileBundles/Finalize
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.659Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with
random key
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.691Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.723Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.754Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.786Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.819Z: Fusing consumer Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
into Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.851Z: Fusing consumer Values/Values/Map into
Write content to
files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.884Z: Fusing consumer Collect write end time into
Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.917Z: Fusing consumer Match all
files/Reshuffle.ViaRandomKey/Pair with random key into Match all files/Match
filepatterns
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.949Z: Fusing consumer Match all
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Match
all files/Reshuffle.ViaRandomKey/Pair with random key
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:36.981Z: Fusing consumer Match all
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Match all
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.014Z: Fusing consumer Match all
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Match all
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.049Z: Fusing consumer Match all
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Match all
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.082Z: Fusing consumer Match all
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Match all
files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.113Z: Fusing consumer Match all
files/Reshuffle.ViaRandomKey/Values/Values/Map into Match all
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.137Z: Fusing consumer Read
matches/ParDo(ToReadableFile) into Match all
files/Reshuffle.ViaRandomKey/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.168Z: Fusing consumer Read files/Read all via
FileBasedSource/Split into ranges into Read matches/ParDo(ToReadableFile)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.200Z: Fusing consumer Read files/Read all via
FileBasedSource/Reshuffle/Pair with random key into Read files/Read all via
FileBasedSource/Split into ranges
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.231Z: Fusing consumer Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign into Read
files/Read all via FileBasedSource/Reshuffle/Pair with random key
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.264Z: Fusing consumer Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read files/Read all
via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.296Z: Fusing consumer Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read files/Read all
via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.329Z: Fusing consumer Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into Read
files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.361Z: Fusing consumer Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.365Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.384Z: Fusing consumer Read files/Read all via
FileBasedSource/Reshuffle/Values/Values/Map into Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.417Z: Fusing consumer Read files/Read all via
FileBasedSource/Read ranges into Read files/Read all via
FileBasedSource/Reshuffle/Values/Values/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.449Z: Fusing consumer Collect read end time into
Read files/Read all via FileBasedSource/Read ranges
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.484Z: Fusing consumer Calculate
hashcode/WithKeys/AddKeys/Map into Collect read end time
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.516Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate
hashcode/WithKeys/AddKeys/Map
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.548Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.581Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.613Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.648Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.680Z: Fusing consumer Calculate
hashcode/Values/Values/Map into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.702Z: Fusing consumer Calculate
hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.723Z: Fusing consumer
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map into
PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Jun 26, 2023 6:01:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:37.747Z: Fusing consumer
PAssert$0/GroupGlobally/GroupByKey/Reify into
PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Jun 26, 2023 6:01:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:38.125Z: Executing operation Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jun 26, 2023 6:01:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:38.199Z: Starting 5 ****s in us-central1-a...
Jun 26, 2023 6:01:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:38.435Z: Finished operation Write content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jun 26, 2023 6:01:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:41.370Z: Executing operation Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Create
Jun 26, 2023 6:01:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:41.504Z: Finished operation Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Create
Jun 26, 2023 6:01:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:01:41.664Z: Executing operation Generate
sequence/Read(BoundedCountingSource)+Produce text lines+Collect write start
time+Write content to files/WriteFiles/RewindowIntoGlobal/Window.Assign+Write
content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write
content to files/WriteFiles/GatherTempFileResults/Consolidate/Pair with random
key+Write content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/Window.Into()/Window.Assign+Write
content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Reify+Write
content to
files/WriteFiles/GatherTempFileResults/Consolidate/Reshuffle/GroupByKey/Write+Write
content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write
content to
files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Jun 26, 2023 6:02:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:02:35.115Z: Autoscaling: Raised the number of ****s to
5 based on the rate of progress in the currently running stage(s).
Jun 26, 2023 6:02:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-06-26T18:02:57.903Z: Workers have started successfully.
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-12' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy146.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:321)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException: Pipe closed after 0 cycles
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126)
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105)
at
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94)
at
hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75)
at
hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105)
at
hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-12 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
