See <https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1482/display/redirect?page=changes>
Changes: [noreply] [BEAM-12769] Adds support for expanding a Java cross-language transform ------------------------------------------ [...truncated 4.01 MB...] Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign as step s15 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey as step s16 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable as step s17 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop key/Values/Map as step s18 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather bundles as step s19 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key as step s20 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign as step s21 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey as step s22 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable as step s23 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map as step s24 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize as step s25 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key as step s26 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign as step s27 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey as step s28 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable as step s29 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep INFO: Adding WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map as step s30 Sep 05, 2021 3:13:05 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Dataflow SDK version: 2.34.0-SNAPSHOT Sep 05, 2021 3:13:06 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-05_08_13_05-8917006244634038809?project=apache-beam-testing Sep 05, 2021 3:13:06 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: Submitted job: 2021-09-05_08_13_05-8917006244634038809 Sep 05, 2021 3:13:06 PM org.apache.beam.runners.dataflow.DataflowRunner run INFO: To cancel the job using the 'gcloud' tool, run: > gcloud dataflow jobs --project=apache-beam-testing cancel > --region=us-central1 2021-09-05_08_13_05-8917006244634038809 Sep 05, 2021 3:13:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:09.016Z: Autoscaling is enabled for job 2021-09-05_08_13_05-8917006244634038809. The number of workers will be between 1 and 1000. Sep 05, 2021 3:13:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:09.148Z: Autoscaling was automatically enabled for job 2021-09-05_08_13_05-8917006244634038809. Sep 05, 2021 3:13:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:15.789Z: Worker configuration: e2-standard-2 in us-central1-c. Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:16.532Z: Expanding CoGroupByKey operations into optimizable parts. Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:16.745Z: Expanding GroupByKey operations into optimizable parts. Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:16.791Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.034Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.073Z: Fusing consumer ParseGameEvent into TextIO.Read/Read Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.108Z: Fusing consumer FilterStartTime/ParDo(Anonymous) into ParseGameEvent Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.140Z: Fusing consumer FilterEndTime/ParDo(Anonymous) into FilterStartTime/ParDo(Anonymous) Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.181Z: Fusing consumer AddEventTimestamps/AddTimestamps into FilterEndTime/ParDo(Anonymous) Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.215Z: Fusing consumer FixedWindowsTeam/Window.Assign into AddEventTimestamps/AddTimestamps Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.249Z: Fusing consumer ExtractTeamScore/MapElements/Map into FixedWindowsTeam/Window.Assign Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.282Z: Fusing consumer ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Partial into ExtractTeamScore/MapElements/Map Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.314Z: Fusing consumer ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Reify into ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Partial Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.349Z: Fusing consumer ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Write into ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Reify Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.383Z: Fusing consumer ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues into ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Read Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.419Z: Fusing consumer ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Extract into ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.444Z: Fusing consumer WriteTeamScoreSums/ConvertToRow into ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Extract Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.472Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/ApplyShardingKey into WriteTeamScoreSums/ConvertToRow Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.509Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Reify into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/ApplyShardingKey Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.533Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Write into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Reify Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.568Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/GroupByWindow into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Read Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.602Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/WriteShardsIntoTempFiles into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/GroupByWindow Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.637Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/WriteShardsIntoTempFiles Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.669Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.703Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.735Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.803Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.836Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.862Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop key/Values/Map into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.895Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather bundles into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop key/Values/Map Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.931Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather bundles Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.957Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:17.986Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.010Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Sep 05, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.045Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.078Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.103Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.138Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.170Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.196Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.229Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.264Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.303Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.334Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.378Z: Fusing consumer WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map into WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.777Z: Executing operation ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Create Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:18.852Z: Starting 1 workers in us-central1-c... Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:19.253Z: Finished operation ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Create Sep 05, 2021 3:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:19.420Z: Executing operation TextIO.Read/Read+ParseGameEvent+FilterStartTime/ParDo(Anonymous)+FilterEndTime/ParDo(Anonymous)+AddEventTimestamps/AddTimestamps+FixedWindowsTeam/Window.Assign+ExtractTeamScore/MapElements/Map+ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Partial+ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Reify+ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Write Sep 05, 2021 3:13:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:36.344Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete Sep 05, 2021 3:14:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:13:58.895Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). Sep 05, 2021 3:14:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:27.751Z: Workers have started successfully. Sep 05, 2021 3:14:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:27.789Z: Workers have started successfully. Sep 05, 2021 3:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:44.727Z: Finished operation TextIO.Read/Read+ParseGameEvent+FilterStartTime/ParDo(Anonymous)+FilterEndTime/ParDo(Anonymous)+AddEventTimestamps/AddTimestamps+FixedWindowsTeam/Window.Assign+ExtractTeamScore/MapElements/Map+ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Partial+ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Reify+ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Write Sep 05, 2021 3:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:44.792Z: Executing operation ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Close Sep 05, 2021 3:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:45.367Z: Finished operation ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Close Sep 05, 2021 3:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:45.449Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Create Sep 05, 2021 3:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:45.883Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Create Sep 05, 2021 3:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:46.042Z: Executing operation ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Read+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Extract+WriteTeamScoreSums/ConvertToRow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/ApplyShardingKey+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Write Sep 05, 2021 3:14:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:47.612Z: Finished operation ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey/Read+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues+ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Extract+WriteTeamScoreSums/ConvertToRow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/ApplyShardingKey+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Write Sep 05, 2021 3:14:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:47.677Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Close Sep 05, 2021 3:14:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:47.739Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Close Sep 05, 2021 3:14:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:47.812Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create Sep 05, 2021 3:14:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:48.067Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create Sep 05, 2021 3:14:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:48.218Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/WriteShardsIntoTempFiles+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write Sep 05, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:50.413Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteShardedBundlesToTempFiles/WriteShardsIntoTempFiles+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write Sep 05, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:50.488Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Close Sep 05, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:50.549Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Close Sep 05, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:50.624Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Sep 05, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:50.798Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Sep 05, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:50.996Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop key/Values/Map+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather bundles+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Sep 05, 2021 3:14:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:52.523Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop key/Values/Map+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather bundles+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Sep 05, 2021 3:14:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:52.589Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Sep 05, 2021 3:14:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:52.652Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Sep 05, 2021 3:14:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:52.723Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Sep 05, 2021 3:14:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:52.941Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Sep 05, 2021 3:14:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:53.081Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Sep 05, 2021 3:14:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:55.045Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Sep 05, 2021 3:14:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:55.133Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Sep 05, 2021 3:14:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:55.203Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Sep 05, 2021 3:14:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:55.270Z: Executing operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map Sep 05, 2021 3:14:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:56.544Z: Finished operation WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteTeamScoreSums/WriteToText.WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map Sep 05, 2021 3:14:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:56.714Z: Cleaning up. Sep 05, 2021 3:14:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:14:56.807Z: Stopping worker pool... Sep 05, 2021 3:17:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:17:06.162Z: Autoscaling: Resized worker pool from 1 to 0. Sep 05, 2021 3:17:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2021-09-05T15:17:06.208Z: Worker pool stopped. Sep 05, 2021 3:17:44 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState INFO: Job 2021-09-05_08_13_05-8917006244634038809 finished with status DONE. gsutil cat gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/java-hourlyteamscore-result-dataflow-runner.txt* | grep AzureBilby ServiceException: 503 None ServiceException: 503 None [ERROR] Failed command > Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 12m 11s 9 actionable tasks: 9 executed Publishing build scan... https://gradle.com/s/zzcd2niwa37ze Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
