See <https://builds.apache.org/job/beam_PreCommit_Java_Cron/267/display/redirect?page=changes>
Changes: [github] Update JavaDoc for cloud dataflow to support region flag [github] Update DataflowPipelineOptions.java [holden] Make run_validatescontainer.sh not quite as hard coded. [holden] Fix typo [Jozef.Vilcek] Relax back restriction on parsing file scheme [mxm] [BEAM-4130] Bring up Job Server container for Python jobs [thw] [BEAM-2930] Side input support for Flink portable streaming. [github] Remove accidentally added .DS_Store file (#6275) ------------------------------------------ [...truncated 17.26 MB...] INFO: 2018-08-25T00:19:28.290Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.330Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.377Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map into WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.414Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.461Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.507Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.555Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.600Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map into WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.632Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize into WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.663Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map into WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.712Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign into WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.760Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial into WordCount.CountWords/Count.PerElement/Init/Map Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.814Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.865Z: Fusing consumer Window.Into()/Window.Assign into ParDo(AddTimestamp) Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.914Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.960Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:28.991Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.035Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.070Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.109Z: Fusing consumer MapElements/Map into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.157Z: Fusing consumer ParDo(AddTimestamp) into TextIO.Read/Read Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.205Z: Fusing consumer WordCount.CountWords/ParDo(ExtractWords) into Window.Into()/Window.Assign Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.249Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.286Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into MapElements/Map Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.331Z: Fusing consumer WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow into WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.370Z: Fusing consumer WordCount.CountWords/Count.PerElement/Init/Map into WordCount.CountWords/ParDo(ExtractWords) Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.419Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.901Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.947Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.995Z: Starting 1 workers in us-central1-b... Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:29.995Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:30.044Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:30.096Z: Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create Aug 25, 2018 12:19:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:30.468Z: Executing operation TextIO.Read/Read+ParDo(AddTimestamp)+Window.Into()/Window.Assign+WordCount.CountWords/ParDo(ExtractWords)+WordCount.CountWords/Count.PerElement/Init/Map+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write Aug 25, 2018 12:19:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:19:45.521Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). Aug 25, 2018 12:20:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:06.776Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). Aug 25, 2018 12:20:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:06.810Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. Aug 25, 2018 12:20:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:22.285Z: Workers have started successfully. Aug 25, 2018 12:20:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:22.324Z: Workers have started successfully. Aug 25, 2018 12:20:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:40.705Z: Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close Aug 25, 2018 12:20:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:40.806Z: Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+MapElements/Map+WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write+WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write Aug 25, 2018 12:20:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:52.518Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close Aug 25, 2018 12:20:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:52.620Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+WriteOneFilePerWindow/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write Aug 25, 2018 12:20:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:53.699Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Close Aug 25, 2018 12:20:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:53.804Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Drop key/Values/Map+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Gather bundles+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Aug 25, 2018 12:20:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:59.124Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Aug 25, 2018 12:20:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:20:59.225Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteOneFilePerWindow/TextIO.Write/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Finalize+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write Aug 25, 2018 12:21:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:21:05.640Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close Aug 25, 2018 12:21:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:21:05.735Z: Executing operation WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteOneFilePerWindow/TextIO.Write/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map Aug 25, 2018 12:21:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:21:10.174Z: Cleaning up. Aug 25, 2018 12:21:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:21:10.261Z: Stopping worker pool... Aug 25, 2018 12:22:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:22:42.287Z: Autoscaling: Resized worker pool from 1 to 0. Aug 25, 2018 12:22:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:22:42.324Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. Aug 25, 2018 12:22:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-08-25T00:22:42.369Z: Worker pool stopped. Aug 25, 2018 12:22:52 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-08-24_17_19_17-2341964863010194196 finished with status DONE. Aug 25, 2018 12:22:52 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess INFO: Success result for Dataflow job 2018-08-24_17_19_17-2341964863010194196. Found 0 success, 0 failures out of 0 expected assertions. Aug 25, 2018 12:22:55 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-08-24_17_19_17-2341964863010194196 finished with status DONE. Gradle Test Executor 94 finished executing tests. > Task :beam-runners-google-cloud-dataflow-java-examples:preCommit Finished generating test XML results (0.004 secs) into: <https://builds.apache.org/job/beam_PreCommit_Java_Cron/ws/src/runners/google-cloud-dataflow-java/examples/build/test-results/preCommit> Generating HTML test report... Finished generating test html results (0.005 secs) into: <https://builds.apache.org/job/beam_PreCommit_Java_Cron/ws/src/runners/google-cloud-dataflow-java/examples/build/reports/tests/preCommit> Packing task ':beam-runners-google-cloud-dataflow-java-examples:preCommit' :beam-runners-google-cloud-dataflow-java-examples:preCommit (Thread[Task worker for ':',5,main]) completed. Took 14 mins 3.649 secs. :beam-examples-java:preCommit (Thread[Task worker for ':',5,main]) started. :beam-runners-google-cloud-dataflow-java-examples:test (Thread[Task worker for ':' Thread 7,5,main]) started. > Task :beam-examples-java:preCommit Skipping task ':beam-examples-java:preCommit' as it has no actions. :beam-examples-java:preCommit (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs. > Task :beam-runners-google-cloud-dataflow-java-examples:test NO-SOURCE Skipping task ':beam-runners-google-cloud-dataflow-java-examples:test' as it has no source files and no previous output files. :beam-runners-google-cloud-dataflow-java-examples:test (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.001 secs. :beam-runners-google-cloud-dataflow-java-examples:check (Thread[Task worker for ':' Thread 7,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java-examples:check Skipping task ':beam-runners-google-cloud-dataflow-java-examples:check' as it has no actions. :beam-runners-google-cloud-dataflow-java-examples:check (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. :beam-runners-google-cloud-dataflow-java-examples:build (Thread[Task worker for ':' Thread 7,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java-examples:build Skipping task ':beam-runners-google-cloud-dataflow-java-examples:build' as it has no actions. :beam-runners-google-cloud-dataflow-java-examples:build (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. :beam-runners-google-cloud-dataflow-java-examples:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java-examples:buildDependents Caching disabled for task ':beam-runners-google-cloud-dataflow-java-examples:buildDependents': Caching has not been enabled for the task Task ':beam-runners-google-cloud-dataflow-java-examples:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-google-cloud-dataflow-java-examples:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. :beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started. :beam-runners-google-cloud-dataflow-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started. > Task :beam-examples-java:buildDependents Caching disabled for task ':beam-examples-java:buildDependents': Caching has not been enabled for the task Task ':beam-examples-java:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. > Task :beam-runners-google-cloud-dataflow-java:buildDependents Caching disabled for task ':beam-runners-google-cloud-dataflow-java:buildDependents': Caching has not been enabled for the task Task ':beam-runners-google-cloud-dataflow-java:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-google-cloud-dataflow-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs. :beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started. > Task :beam-sdks-java-io-google-cloud-platform:buildDependents Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs. :beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started. :beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started. > Task :beam-runners-direct-java:buildDependents Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching has not been enabled for the task Task ':beam-runners-direct-java:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs. > Task :beam-sdks-java-extensions-protobuf:buildDependents Caching disabled for task ':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. :beam-runners-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started. :beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started. > Task :beam-runners-java-fn-execution:buildDependents Caching disabled for task ':beam-runners-java-fn-execution:buildDependents': Caching has not been enabled for the task Task ':beam-runners-java-fn-execution:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs. > Task :beam-runners-local-java-core:buildDependents Caching disabled for task ':beam-runners-local-java-core:buildDependents': Caching has not been enabled for the task Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs. :beam-sdks-java-harness:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started. :beam-vendor-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started. > Task :beam-sdks-java-harness:buildDependents Caching disabled for task ':beam-sdks-java-harness:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-harness:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-harness:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs. > Task :beam-vendor-sdks-java-extensions-protobuf:buildDependents Caching disabled for task ':beam-vendor-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task Task ':beam-vendor-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-vendor-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. :beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started. :beam-sdks-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started. > Task :beam-sdks-java-extensions-google-cloud-platform-core:buildDependents Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. > Task :beam-sdks-java-fn-execution:buildDependents Caching disabled for task ':beam-sdks-java-fn-execution:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-fn-execution:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-runners-apex:compileTestJava'. > Compilation failed with exit code 1; see the compiler error output for > details. * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 22m 43s 804 actionable tasks: 799 executed, 5 from cache Publishing build scan... https://gradle.com/s/r53zttwmf3of6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure