See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/854/display/redirect?page=changes>
Changes: [kenn] [BEAM-5817] Use an explicit enum for naming Nexmark benchmarks ------------------------------------------ [...truncated 1.31 MB...] Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.836Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write, through flatten s17-u13, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.882Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.929Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.977Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1 Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.010Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.055Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.104Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.150Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.186Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.235Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.279Z: Fusing consumer SqlQuery3/SqlQuery3.Snoop into SqlQuery3/SqlQuery3.Monitor Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.328Z: Fusing consumer SqlQuery3/SqlQuery3/Window.Into()/Window.Assign into SqlQuery3/SqlQuery3.Snoop Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.365Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.413Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.461Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.507Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.554Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.604Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded Oct 29, 2018 9:09:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:19.054Z: Starting 4 workers in us-central1-b... Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process WARNING: 2018-10-29T09:09:10.189Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE). Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:12.945Z: Checking permissions granted to controller Service Account. Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:16.331Z: Worker configuration: n1-standard-1 in us-central1-b. Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:16.910Z: Expanding CoGroupByKey operations into optimizable parts. Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:16.955Z: Expanding GroupByKey operations into optimizable parts. Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:16.991Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.095Z: Fusing adjacent ParDo, Read, Write, and Flatten operations Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.141Z: Fusing consumer SqlQuery1/SqlQuery1.Monitor into SqlQuery1.ReadBounded Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.182Z: Fusing consumer SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) into SqlQuery1/SqlQuery1.Snoop Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.228Z: Fusing consumer SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc) Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.275Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc) into SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous) Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.320Z: Fusing consumer SqlQuery1.DevNull into SqlQuery1.Format Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.366Z: Fusing consumer SqlQuery1.Format into SqlQuery1/SqlQuery1.Stamp Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.403Z: Fusing consumer SqlQuery1/SqlQuery1.Stamp into SqlQuery1/SqlQuery1.Debug Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.451Z: Fusing consumer SqlQuery1/SqlQuery1.Debug into SqlQuery1/SqlQuery1.Forget Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.497Z: Fusing consumer SqlQuery1/SqlQuery1.Forget into SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.540Z: Fusing consumer SqlQuery1/SqlQuery1.Snoop into SqlQuery1/SqlQuery1.Monitor Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.566Z: Fusing consumer SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) into SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:17.612Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.055Z: Executing operation SqlQuery1.ReadBounded+SqlQuery1/SqlQuery1.Monitor+SqlQuery1/SqlQuery1.Snoop+SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc)+SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1.Forget+SqlQuery1/SqlQuery1.Debug+SqlQuery1/SqlQuery1.Stamp+SqlQuery1.Format+SqlQuery1.DevNull Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:18.166Z: Starting 4 workers in us-central1-b... Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:19.112Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Create Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:19.215Z: Starting 4 workers in us-central1-b... Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:19.434Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write Oct 29, 2018 9:09:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:30.154Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:09:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:30.266Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:09:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:33.005Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:09:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:09:32.799Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:00.596Z: Workers have started successfully. Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:01.114Z: Workers have started successfully. Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:00.532Z: Workers have started successfully. Oct 29, 2018 9:10:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:04.214Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:03.009Z: Workers have started successfully. Oct 29, 2018 9:10:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:04.255Z: Resized worker pool to 1, though goal was 4. This could be a quota issue. Oct 29, 2018 9:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:08.916Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:08.955Z: Resized worker pool to 3, though goal was 4. This could be a quota issue. Oct 29, 2018 9:10:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:10.043Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:12.611Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:12.657Z: Resized worker pool to 2, though goal was 4. This could be a quota issue. Oct 29, 2018 9:10:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:13.145Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:13.185Z: Resized worker pool to 3, though goal was 4. This could be a quota issue. Oct 29, 2018 9:10:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:14.936Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:18.170Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:31.422Z: Workers have started successfully. Oct 29, 2018 9:10:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:31.830Z: Workers have started successfully. Oct 29, 2018 9:10:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:31.780Z: Workers have started successfully. Oct 29, 2018 9:10:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:34.152Z: Workers have started successfully. Oct 29, 2018 9:10:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:35.890Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s). Oct 29, 2018 9:10:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:52.962Z: Cleaning up. Oct 29, 2018 9:10:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:10:53.097Z: Stopping worker pool... Oct 29, 2018 9:11:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:22.914Z: Cleaning up. Oct 29, 2018 9:11:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:23.017Z: Stopping worker pool... Oct 29, 2018 9:11:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:31.272Z: Cleaning up. Oct 29, 2018 9:11:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:31.368Z: Stopping worker pool... Oct 29, 2018 9:11:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:43.719Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Close Oct 29, 2018 9:11:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:43.823Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull Oct 29, 2018 9:11:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:47.633Z: Cleaning up. Oct 29, 2018 9:11:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-29T09:11:47.732Z: Stopping worker pool... Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-29T09:13:11.024Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-29T09:13:11.051Z RUNNING SqlQuery0 Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned. State value RUNNING 2018-10-29T09:13:11.092Z Waiting for main pipeline to 'finish' 2018-10-29T09:13:11.226Z RUNNING SqlQuery1 Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-29T09:13:11.227Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-29T09:13:11.257Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-29T09:13:11.266Z RUNNING SqlQuery2 2018-10-29T09:13:11.290Z RUNNING SqlQuery3 2018-10-29T09:13:11.954Z new perf {"snapshots":null,"runtimeSec":76.565,"numEvents":10000000,"eventsPerSec":130607.98014758702,"eventBytesPerSec":1.6764381858551558E7,"numResults":9200000,"resultsPerSec":120159.34173578006,"resultBytesPerSec":1.2075942610853523E7,"startupDelaySec":-177.634,"processingDelaySec":0.766,"shutdownDelaySec":101.069,"timeDilation":13.060144974857964,"errors":null,"jobId":null} 2018-10-29T09:13:11.998Z new perf {"snapshots":null,"runtimeSec":70.253,"numEvents":10000000,"eventsPerSec":142342.67575761888,"eventBytesPerSec":1.827060619475325E7,"numResults":9200000,"resultsPerSec":130955.26169700938,"resultBytesPerSec":1.3160926166854085E7,"startupDelaySec":-178.699,"processingDelaySec":0.631,"shutdownDelaySec":108.446,"timeDilation":14.2335558623831,"errors":null,"jobId":null} 2018-10-29T09:13:12.041Z new perf {"snapshots":null,"runtimeSec":40.904,"numEvents":10000000,"eventsPerSec":244474.86798357125,"eventBytesPerSec":3.1379935874242127E7,"numResults":83527,"resultsPerSec":2042.0252298063758,"resultBytesPerSec":32672.403676902013,"startupDelaySec":-179.503,"processingDelaySec":1.135,"shutdownDelaySec":138.599,"timeDilation":24.44601994914923,"errors":null,"jobId":null} 2018-10-29T09:13:12.114Z new perf {"snapshots":null,"runtimeSec":89.979,"numEvents":10000000,"eventsPerSec":111137.04308783161,"eventBytesPerSec":1.4265160726391714E7,"numResults":9054,"resultsPerSec":100.62347881172273,"resultBytesPerSec":3213.6943064492825,"startupDelaySec":-173.886,"processingDelaySec":87.123,"shutdownDelaySec":83.907,"timeDilation":11.00256726569533,"errors":null,"jobId":null} 2018-10-29T09:13:27.001Z RUNNING SqlQuery0 2018-10-29T09:13:27.031Z RUNNING SqlQuery1 2018-10-29T09:13:27.071Z RUNNING SqlQuery2 2018-10-29T09:13:27.146Z RUNNING SqlQuery3 2018-10-29T09:13:27.723Z no activity 2018-10-29T09:13:27.750Z no activity 2018-10-29T09:13:27.969Z no activity 2018-10-29T09:13:28.003Z no activity 2018-10-29T09:13:42.801Z RUNNING SqlQuery1 2018-10-29T09:13:42.801Z RUNNING SqlQuery0 2018-10-29T09:13:42.997Z RUNNING SqlQuery2 2018-10-29T09:13:43.030Z RUNNING SqlQuery3 2018-10-29T09:13:43.495Z no activity 2018-10-29T09:13:43.496Z no activity 2018-10-29T09:13:43.655Z no activity 2018-10-29T09:13:43.794Z no activity 2018-10-29T09:13:58.523Z RUNNING SqlQuery1 2018-10-29T09:13:58.525Z RUNNING SqlQuery0 2018-10-29T09:13:58.683Z RUNNING SqlQuery2 2018-10-29T09:13:58.822Z RUNNING SqlQuery3 2018-10-29T09:13:59.139Z no activity 2018-10-29T09:13:59.171Z no activity 2018-10-29T09:13:59.424Z no activity 2018-10-29T09:13:59.692Z no activity 2018-10-29T09:14:14.174Z RUNNING SqlQuery1 2018-10-29T09:14:14.198Z RUNNING SqlQuery0 2018-10-29T09:14:14.446Z RUNNING SqlQuery2 2018-10-29T09:14:14.723Z RUNNING SqlQuery3 2018-10-29T09:14:14.921Z no activity 2018-10-29T09:14:14.953Z no activity 2018-10-29T09:14:15.171Z no activity 2018-10-29T09:14:15.726Z no activity 2018-10-29T09:14:29.989Z RUNNING SqlQuery1 2018-10-29T09:14:29.990Z RUNNING SqlQuery0 2018-10-29T09:14:30.328Z DONE SqlQuery2 2018-10-29T09:14:30.760Z RUNNING SqlQuery3 2018-10-29T09:14:30.790Z no activity 2018-10-29T09:14:30.801Z no activity 2018-10-29T09:14:31.599Z no activity 2018-10-29T09:14:45.824Z DONE SqlQuery0 2018-10-29T09:14:45.836Z RUNNING SqlQuery1 2018-10-29T09:14:46.613Z no activity 2018-10-29T09:14:46.637Z RUNNING SqlQuery3 2018-10-29T09:14:47.473Z no activity 2018-10-29T09:15:01.656Z DONE SqlQuery1 2018-10-29T09:15:02.501Z RUNNING SqlQuery3 2018-10-29T09:15:03.335Z no activity 2018-10-29T09:15:18.368Z DONE SqlQuery3 > Task :beam-sdks-java-nexmark:run FAILED :beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 6 mins 16.241 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-sdks-java-nexmark:run'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6m 27s 68 actionable tasks: 2 executed, 66 up-to-date Publishing build scan... https://gradle.com/s/gfx3yqldbxugc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org