See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/1399/display/redirect?page=changes>
Changes:
[bulatkazan] [Website] center the main content #24521
[Moritz Mack] [Spark Dataset runner] Broadcast pipeline options
[bulatkazan] [Website] update copy icon positioning #24426
[noreply] Update google-cloud-bigquery-storage requirement from <2.14,>=2.6.3 to
[noreply] Bump cloud.google.com/go/pubsub from 1.27.1 to 1.28.0 in /sdks
(#24534)
[noreply] Bump golang.org/x/net from 0.2.0 to 0.3.0 in /sdks (#24544)
------------------------------------------
[...truncated 209.62 KB...]
INFO: 2022-12-06T15:28:06.070Z: Finished operation
Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create
Dec 06, 2022 3:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:06.231Z: Executing operation
Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query12/Query12.Monitor/ParMultiDo(Monitor)+Query12/Query12.Snoop/ParMultiDo(Anonymous)+Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous)+Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query12/Query12/Window.Into()/Window.Assign+Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous)+Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 06, 2022 3:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:05.241Z: Finished operation
Query1.ReadBounded/Impulse+Query1.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Dec 06, 2022 3:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:05.396Z: Executing operation
Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query1/Query1.Monitor/ParMultiDo(Monitor)+Query1/Query1.Snoop/ParMultiDo(Anonymous)+Query1/Query1/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query1/Query1/justBids/AsBid/ParMultiDo(Anonymous)+Query1/Query1/Query1.ToEuros/ParMultiDo(Anonymous)+Query1/Query1.Debug/ParMultiDo(Monitor)+Query1/Query1.Stamp/ParMultiDo(Anonymous)+Query1.Format/ParMultiDo(Anonymous)+Query1.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:04.671Z: Executing operation
Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query14/Query14.Monitor/ParMultiDo(Monitor)+Query14/Query14.Snoop/ParMultiDo(Anonymous)+Query14/Query14/Reshuffle.ViaRandomKey/Pair
with random
key/ParMultiDo(AssignShard)+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 06, 2022 3:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:06.842Z: Finished operation
Query8/Query8/CoGroupByKey/GBK/Create
Dec 06, 2022 3:28:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:07.042Z: Executing operation
Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query8/Query8.Monitor/ParMultiDo(Monitor)+Query8/Query8.Snoop/ParMultiDo(Anonymous)+Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous)+Query8/Query8/Query8.WindowPersons/Window.Assign+Query8/Query8/PersonById/ParMultiDo(Anonymous)+Query8/Query8/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)+Query8/Query8/CoGroupByKey/GBK/Reify+Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous)+Query8/Query8/Query8.WindowAuctions/Window.Assign+Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous)+Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+Query8/Query8/CoGroupByKey/GBK/Reify+Query8/Query8/CoGroupByKey/GBK/Session/Flatten+Query8/Query8/CoGroupByKey/GBK/Write
Dec 06, 2022 3:28:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:06.359Z: Finished operation
Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create
Dec 06, 2022 3:28:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:06.582Z: Executing operation
Query11-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query11/Query11.Monitor/ParMultiDo(Monitor)+Query11/Query11.Snoop/ParMultiDo(Anonymous)+Query11/Query11/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query11/Query11/justBids/AsBid/ParMultiDo(Anonymous)+Query11/Query11/Query11.Rekey/ParMultiDo(Anonymous)+Query11/Query11/Window.Into()/Window.Assign+Query11/Query11/Count.PerElement/Init/Map/ParMultiDo(Anonymous)+Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/AddInput+Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 06, 2022 3:28:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:07.031Z: Finished operation
Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create
Dec 06, 2022 3:28:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:07.184Z: Executing operation
Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query5/Query5.Monitor/ParMultiDo(Monitor)+Query5/Query5.Snoop/ParMultiDo(Anonymous)+Query5/Query5/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous)+Query5/Query5/Window.Into()/Window.Assign+Query5/Query5/BidToAuction/ParMultiDo(Anonymous)+Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous)+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 06, 2022 3:28:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:06.621Z: Finished operation
Query2.ReadBounded/Impulse+Query2.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Dec 06, 2022 3:28:09 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:06.788Z: Executing operation
Query2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query2/Query2.Monitor/ParMultiDo(Monitor)+Query2/Query2.Snoop/ParMultiDo(Anonymous)+Query2/Query2/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query2/Query2/justBids/AsBid/ParMultiDo(Anonymous)+Query2/Query2/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query2/Query2/Query2.Project/ParMultiDo(Anonymous)+Query2/Query2.Debug/ParMultiDo(Monitor)+Query2/Query2.Stamp/ParMultiDo(Anonymous)+Query2.Format/ParMultiDo(Anonymous)+Query2.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:10.174Z: All ****s have finished the startup processes
and began to receive work requests.
Dec 06, 2022 3:28:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:13.368Z: Finished operation
Query10.ReadBounded/Impulse+Query10.ReadBounded/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Dec 06, 2022 3:28:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:13.496Z: Executing operation
Query10/Query10/Query10.GroupByKey/Create
Dec 06, 2022 3:28:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:13.810Z: Finished operation
Query10/Query10/Query10.GroupByKey/Create
Dec 06, 2022 3:28:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:13.933Z: Executing operation
Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query10/Query10.Monitor/ParMultiDo(Monitor)+Query10/Query10.Snoop/ParMultiDo(Anonymous)+Query10/Query10/Query10.ShardEvents/ParMultiDo(Anonymous)+Query10/Query10/Query10.WindowEvents/Window.Assign+Query10/Query10/Query10.GroupByKey/Reify+Query10/Query10/Query10.GroupByKey/Write
Dec 06, 2022 3:28:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:24.179Z: Finished operation
Query12-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query12/Query12.Monitor/ParMultiDo(Monitor)+Query12/Query12.Snoop/ParMultiDo(Anonymous)+Query12/Query12/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query12/Query12/justBids/AsBid/ParMultiDo(Anonymous)+Query12/Query12/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query12/Query12/Window.Into()/Window.Assign+Query12/Query12/Count.PerElement/Init/Map/ParMultiDo(Anonymous)+Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 06, 2022 3:28:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:24.259Z: Executing operation
Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 06, 2022 3:28:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:24.315Z: Finished operation
Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 06, 2022 3:28:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:24.381Z: Executing operation
Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous)+Query12/Query12.Debug/ParMultiDo(Monitor)+Query12/Query12.Stamp/ParMultiDo(Anonymous)+Query12.Format/ParMultiDo(Anonymous)+Query12.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:23.503Z: Finished operation
Query8-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query8/Query8.Monitor/ParMultiDo(Monitor)+Query8/Query8.Snoop/ParMultiDo(Anonymous)+Query8/Query8/justNewAuctions/IsNewAuction/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query8/Query8/justNewPersons/IsNewPerson/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query8/Query8/justNewPersons/AsPerson/ParMultiDo(Anonymous)+Query8/Query8/Query8.WindowPersons/Window.Assign+Query8/Query8/PersonById/ParMultiDo(Anonymous)+Query8/Query8/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)+Query8/Query8/CoGroupByKey/GBK/Reify+Query8/Query8/justNewAuctions/AsAuction/ParMultiDo(Anonymous)+Query8/Query8/Query8.WindowAuctions/Window.Assign+Query8/Query8/AuctionBySeller/ParMultiDo(Anonymous)+Query8/Query8/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+Query8/Query8/CoGroupByKey/GBK/Reify+Query8/Query8/CoGroupByKey/GBK/Session/Flatten+Query8/Query8/CoGroupByKey/GBK/Write
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:23.590Z: Executing operation
Query8/Query8/CoGroupByKey/GBK/Close
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:23.653Z: Finished operation
Query8/Query8/CoGroupByKey/GBK/Close
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:23.738Z: Executing operation
Query8/Query8/CoGroupByKey/GBK/Read+Query8/Query8/CoGroupByKey/GBK/GroupByWindow+Query8/Query8/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+Query8/Query8/Query8.Select/ParMultiDo(Anonymous)+Query8/Query8.Debug/ParMultiDo(Monitor)+Query8/Query8.Stamp/ParMultiDo(Anonymous)+Query8.Format/ParMultiDo(Anonymous)+Query8.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:23.942Z: Finished operation
Query2-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query2/Query2.Monitor/ParMultiDo(Monitor)+Query2/Query2.Snoop/ParMultiDo(Anonymous)+Query2/Query2/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query2/Query2/justBids/AsBid/ParMultiDo(Anonymous)+Query2/Query2/Filter/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query2/Query2/Query2.Project/ParMultiDo(Anonymous)+Query2/Query2.Debug/ParMultiDo(Monitor)+Query2/Query2.Stamp/ParMultiDo(Anonymous)+Query2.Format/ParMultiDo(Anonymous)+Query2.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:24.113Z: Cleaning up.
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:24.198Z: Stopping **** pool...
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:25.622Z: Finished operation
Query1-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query1/Query1.Monitor/ParMultiDo(Monitor)+Query1/Query1.Snoop/ParMultiDo(Anonymous)+Query1/Query1/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query1/Query1/justBids/AsBid/ParMultiDo(Anonymous)+Query1/Query1/Query1.ToEuros/ParMultiDo(Anonymous)+Query1/Query1.Debug/ParMultiDo(Monitor)+Query1/Query1.Stamp/ParMultiDo(Anonymous)+Query1.Format/ParMultiDo(Anonymous)+Query1.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:25 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:25.784Z: Cleaning up.
Dec 06, 2022 3:28:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:26.604Z: Finished operation
Query12/Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12/Query12.ToResult/ParMultiDo(Anonymous)+Query12/Query12.Debug/ParMultiDo(Monitor)+Query12/Query12.Stamp/ParMultiDo(Anonymous)+Query12.Format/ParMultiDo(Anonymous)+Query12.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:26.776Z: Cleaning up.
Dec 06, 2022 3:28:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:25.871Z: Stopping **** pool...
Dec 06, 2022 3:28:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:26.840Z: Stopping **** pool...
Dec 06, 2022 3:28:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:27.834Z: Finished operation
Query8/Query8/CoGroupByKey/GBK/Read+Query8/Query8/CoGroupByKey/GBK/GroupByWindow+Query8/Query8/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)+Query8/Query8/Query8.Select/ParMultiDo(Anonymous)+Query8/Query8.Debug/ParMultiDo(Monitor)+Query8/Query8.Stamp/ParMultiDo(Anonymous)+Query8.Format/ParMultiDo(Anonymous)+Query8.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:27.989Z: Cleaning up.
Dec 06, 2022 3:28:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:28.070Z: Stopping **** pool...
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.002Z: Finished operation
Query5-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query5/Query5.Monitor/ParMultiDo(Monitor)+Query5/Query5.Snoop/ParMultiDo(Anonymous)+Query5/Query5/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query5/Query5/justBids/AsBid/ParMultiDo(Anonymous)+Query5/Query5/Window.Into()/Window.Assign+Query5/Query5/BidToAuction/ParMultiDo(Anonymous)+Query5/Query5/Count.PerElement/Init/Map/ParMultiDo(Anonymous)+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.068Z: Executing operation
Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.114Z: Finished operation
Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.190Z: Executing operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Create
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:28.267Z: Finished operation
Query13-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query13/Query13.Monitor/ParMultiDo(Monitor)+Query13/Query13.Snoop/ParMultiDo(Anonymous)+Query13/Query13/Pair
with random key/ParMultiDo(AssignShard)+Query13/Query13/GroupByKey/Write
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:28.357Z: Executing operation
Query13/Query13/GroupByKey/Close
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:28.425Z: Finished operation
Query13/Query13/GroupByKey/Close
Dec 06, 2022 3:28:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:28.510Z: Executing operation
Query13/Query13/GroupByKey/Read+Query13/Query13/ExpandIterable/ParMultiDo(Anonymous)+Query13/Query13/Query13.Serialize/ParMultiDo(Anonymous)+Query13/Query13.Debug/ParMultiDo(Monitor)+Query13/Query13.Stamp/ParMultiDo(Anonymous)+Query13.Format/ParMultiDo(Anonymous)+Query13.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.147Z: Finished operation
Query14-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query14/Query14.Monitor/ParMultiDo(Monitor)+Query14/Query14.Snoop/ParMultiDo(Anonymous)+Query14/Query14/Reshuffle.ViaRandomKey/Pair
with random
key/ParMultiDo(AssignShard)+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.233Z: Executing operation
Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.316Z: Finished operation
Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.412Z: Executing operation
Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable/ParMultiDo(Anonymous)+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query14/Query14/Reshuffle.ViaRandomKey/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query14/Query14/Reshuffle.ViaRandomKey/Values/Values/Map/ParMultiDo(Anonymous)+Query14/Query14.Debug/ParMultiDo(Monitor)+Query14/Query14.Stamp/ParMultiDo(Anonymous)+Query14.Format/ParMultiDo(Anonymous)+Query14.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.336Z: Finished operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Create
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.485Z: Executing operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Create
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.622Z: Finished operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Create
Dec 06, 2022 3:28:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:29.775Z: Executing operation
Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PrepareCold/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Reify+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Write+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Write
Dec 06, 2022 3:28:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:30.245Z: Finished operation
Query0-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query0/Query0.Monitor/ParMultiDo(Monitor)+Query0/Query0.Snoop/ParMultiDo(Anonymous)+Query0/Query0/Query0.Serialize/ParMultiDo(Anonymous)+Query0/Query0.Debug/ParMultiDo(Monitor)+Query0/Query0.Stamp/ParMultiDo(Anonymous)+Query0.Format/ParMultiDo(Anonymous)+Query0.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:30.386Z: Cleaning up.
Dec 06, 2022 3:28:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:30.465Z: Stopping **** pool...
Dec 06, 2022 3:28:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:37.240Z: Finished operation
Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query5/Query5/Combine.globally(Top)/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/AddNonce+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PrepareCold/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Reify+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Write+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Partial+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Reify+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Write
Dec 06, 2022 3:28:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:37.311Z: Executing operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Close
Dec 06, 2022 3:28:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:37.372Z: Finished operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Close
Dec 06, 2022 3:28:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:37.441Z: Executing operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Read+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Reify+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Write
Dec 06, 2022 3:28:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.542Z: Finished operation
Query11-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query11/Query11.Monitor/ParMultiDo(Monitor)+Query11/Query11.Snoop/ParMultiDo(Anonymous)+Query11/Query11/justBids/IsBid/ParDo(Anonymous)/ParMultiDo(Anonymous)+Query11/Query11/justBids/AsBid/ParMultiDo(Anonymous)+Query11/Query11/Query11.Rekey/ParMultiDo(Anonymous)+Query11/Query11/Window.Into()/Window.Assign+Query11/Query11/Count.PerElement/Init/Map/ParMultiDo(Anonymous)+Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/AddInput+Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 06, 2022 3:28:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.628Z: Executing operation
Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 06, 2022 3:28:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.693Z: Finished operation
Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 06, 2022 3:28:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.783Z: Executing operation
Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow+Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query11/Query11/Query11.ToResult/ParMultiDo(Anonymous)+Query11/Query11.Debug/ParMultiDo(Monitor)+Query11/Query11.Stamp/ParMultiDo(Anonymous)+Query11.Format/ParMultiDo(Anonymous)+Query11.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:38.834Z: Finished operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/Read+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/GroupByKey/GroupByWindow+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PreCombineHot/Combine.GroupedValues/Extract+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/StripNonce/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/Window.Remerge/Identity/Map/ParMultiDo(Anonymous)+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Partial+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Reify+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Write
Dec 06, 2022 3:28:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:38.915Z: Executing operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Close
Dec 06, 2022 3:28:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:38.985Z: Finished operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Close
Dec 06, 2022 3:28:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.039Z: Executing operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Read+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/GroupByWindow+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Extract+Query5/Query5/Combine.globally(Top)/Values/Values/Map/ParMultiDo(Anonymous)+Query5/Query5/Query5.Select/ParMultiDo(Anonymous)+Query5/Query5.Debug/ParMultiDo(Monitor)+Query5/Query5.Stamp/ParMultiDo(Anonymous)+Query5.Format/ParMultiDo(Anonymous)+Query5.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.568Z: Finished operation
Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/Read+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/GroupByKey/GroupByWindow+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues+Query5/Query5/Combine.globally(Top)/Combine.perKeyWithFanout(Top)/PostCombine/Combine.GroupedValues/Extract+Query5/Query5/Combine.globally(Top)/Values/Values/Map/ParMultiDo(Anonymous)+Query5/Query5/Query5.Select/ParMultiDo(Anonymous)+Query5/Query5.Debug/ParMultiDo(Monitor)+Query5/Query5.Stamp/ParMultiDo(Anonymous)+Query5.Format/ParMultiDo(Anonymous)+Query5.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.710Z: Cleaning up.
Dec 06, 2022 3:28:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:39.790Z: Stopping **** pool...
Dec 06, 2022 3:28:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:45.200Z: Finished operation
Query10-ReadBounded-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Query10/Query10.Monitor/ParMultiDo(Monitor)+Query10/Query10.Snoop/ParMultiDo(Anonymous)+Query10/Query10/Query10.ShardEvents/ParMultiDo(Anonymous)+Query10/Query10/Query10.WindowEvents/Window.Assign+Query10/Query10/Query10.GroupByKey/Reify+Query10/Query10/Query10.GroupByKey/Write
Dec 06, 2022 3:28:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:45.265Z: Executing operation
Query10/Query10/Query10.GroupByKey/Close
Dec 06, 2022 3:28:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:45.323Z: Finished operation
Query10/Query10/Query10.GroupByKey/Close
Dec 06, 2022 3:28:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:45.380Z: Executing operation
Query10/Query10/Query10.GroupByKey2/Create
Dec 06, 2022 3:28:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:45.522Z: Finished operation
Query10/Query10/Query10.GroupByKey2/Create
Dec 06, 2022 3:28:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:45.642Z: Executing operation
Query10/Query10/Query10.GroupByKey/Read+Query10/Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10/Query10.CheckForLateEvents/ParMultiDo(Anonymous)+Query10/Query10/Query10.UploadEvents/ParMultiDo(Anonymous)+Query10/Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10/Query10.GroupByKey2/Reify+Query10/Query10/Query10.GroupByKey2/Write
Dec 06, 2022 3:28:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:49.478Z: Finished operation
Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/GroupByWindow+Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query11/Query11/Query11.ToResult/ParMultiDo(Anonymous)+Query11/Query11.Debug/ParMultiDo(Monitor)+Query11/Query11.Stamp/ParMultiDo(Anonymous)+Query11.Format/ParMultiDo(Anonymous)+Query11.DevNull/ParMultiDo(Anonymous)
Dec 06, 2022 3:28:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:49.647Z: Cleaning up.
Dec 06, 2022 3:28:52 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-12-06T15:28:49.734Z: Stopping **** pool...
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-3155599397047954375
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_40-3168488564825719173
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-6366341005621623865
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-12305608257252990961
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-181358297590797879
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-10746065487698396479
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-13007714038427534990
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-4912556177847868000
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-7357194748279441283
Dec 06, 2022 3:28:52 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not
cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-11030463434536487871
> Task :sdks:java:testing:nexmark:run FAILED
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=f470cd80-0c0b-4721-b2b5-233e9cbac542,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 959272
log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-959272.out.log
----- Last 20 lines from daemon log file - daemon-959272.out.log -----
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2022-12-06_07_25_39-11030463434536487871
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221206152431
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fbbf3ae6cb567c476330eb9e43c61e1f72c323a869a51fe9a7a9b757e7894a19
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:231)
at
org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
at
org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
at
org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:366)
at
org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
at
org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
at
org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221206152431
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fbbf3ae6cb567c476330eb9e43c61e1f72c323a869a51fe9a7a9b757e7894a19
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
