See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/833/display/redirect?page=changes>
Changes: [scott] Replace precommit dashboard image with an actual image [amaliujia] apply spotless ------------------------------------------ [...truncated 526.75 KB...] INFO: 2018-10-26T20:32:00.159Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s). Oct 26, 2018 8:32:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:04.525Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s). Oct 26, 2018 8:32:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:05.203Z: Executing operation Query3/CoGroupByKey/GBK/Close Oct 26, 2018 8:32:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:05.354Z: Executing operation Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write Oct 26, 2018 8:32:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:07.417Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close Oct 26, 2018 8:32:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:07.505Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12.ToResult+Query12/Query12.Forget+Query12/Query12.Debug+Query12/Query12.Stamp+Query12.Format+Query12.DevNull Oct 26, 2018 8:32:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:09.468Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close Oct 26, 2018 8:32:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:09.558Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write Oct 26, 2018 8:32:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:10.983Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close Oct 26, 2018 8:32:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:11.081Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull Oct 26, 2018 8:32:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:11.613Z: Cleaning up. Oct 26, 2018 8:32:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:11.730Z: Stopping worker pool... Oct 26, 2018 8:32:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:13.994Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close Oct 26, 2018 8:32:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:14.084Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull Oct 26, 2018 8:32:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:15.669Z: Cleaning up. Oct 26, 2018 8:32:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:15.786Z: Stopping worker pool... Oct 26, 2018 8:32:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:15.029Z: Cleaning up. Oct 26, 2018 8:32:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:15.141Z: Stopping worker pool... Oct 26, 2018 8:32:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:16.294Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close Oct 26, 2018 8:32:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:16.405Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull Oct 26, 2018 8:32:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:32.756Z: Executing operation Query6/Query6.WinningBids/CoGroupByKey/GBK/Close Oct 26, 2018 8:32:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:31.183Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Close Oct 26, 2018 8:32:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:31.292Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Read+Query4/Query4.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query4/Query4.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query4/Query4.WinningBids/Query4.WinningBids.Join+Query4/Query4.WinningBidsMonitor+Query4/Query4.Rekey+Query4/Window.Into()/Window.Assign+Query4/Combine.perKeyWithFanout(Mean)/AddNonce+Query4/Combine.perKeyWithFanout(Mean)/PrepareCold/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Write Oct 26, 2018 8:32:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:32.866Z: Executing operation Query6/Query6.WinningBids/CoGroupByKey/GBK/Read+Query6/Query6.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query6/Query6.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query6/Query6.WinningBids/Query6.WinningBids.Join+Query6/Query6.Rekey+Query6/Window.Into()/Window.Assign+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Partial+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Reify+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Write Oct 26, 2018 8:32:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:34.105Z: Cleaning up. Oct 26, 2018 8:32:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:34.046Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Close Oct 26, 2018 8:32:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:34.157Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Read+Query9/Query9/CoGroupByKey/GBK/GroupByWindow+Query9/Query9/CoGroupByKey/ConstructCoGbkResultFn+Query9/Query9/Query9.Join+Query9/Query9.Forget+Query9/Query9.Debug+Query9/Query9.Stamp+Query9.Format+Query9.DevNull Oct 26, 2018 8:32:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:34.238Z: Stopping worker pool... Oct 26, 2018 8:32:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:36.971Z: Executing operation Query8/CoGroupByKey/GBK/Close Oct 26, 2018 8:32:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:37.122Z: Executing operation Query8/CoGroupByKey/GBK/Read+Query8/CoGroupByKey/GBK/GroupByWindow+Query8/CoGroupByKey/ConstructCoGbkResultFn+Query8/Query8.Select+Query8/Query8.Forget+Query8/Query8.Debug+Query8/Query8.Stamp+Query8.Format+Query8.DevNull Oct 26, 2018 8:32:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:45.681Z: Cleaning up. Oct 26, 2018 8:32:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:45.819Z: Stopping worker pool... Oct 26, 2018 8:32:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:50.555Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Close Oct 26, 2018 8:32:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:50.352Z: Cleaning up. Oct 26, 2018 8:32:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:50.470Z: Stopping worker pool... Oct 26, 2018 8:32:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:50.775Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Close Oct 26, 2018 8:32:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:50.880Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write Oct 26, 2018 8:32:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:52.558Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Close Oct 26, 2018 8:32:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:52.638Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull Oct 26, 2018 8:32:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:50.765Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Read+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Extract+Query6/Query6.Select+Query6/Query6.Forget+Query6/Query6.Debug+Query6/Query6.Stamp+Query6.Format+Query6.DevNull Oct 26, 2018 8:32:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:53.315Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close Oct 26, 2018 8:32:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:53.428Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write Oct 26, 2018 8:32:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:54.309Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close Oct 26, 2018 8:32:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:54.414Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write Oct 26, 2018 8:32:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:54.772Z: Cleaning up. Oct 26, 2018 8:32:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:54.052Z: Cleaning up. Oct 26, 2018 8:32:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:54.177Z: Stopping worker pool... Oct 26, 2018 8:32:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:56.807Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close Oct 26, 2018 8:32:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:56.907Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) Oct 26, 2018 8:32:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:32:54.872Z: Stopping worker pool... Oct 26, 2018 8:33:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:33:00.478Z: Executing operation Query7/Combine.GloballyAsSingletonView/CreateDataflowView Oct 26, 2018 8:33:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:33:00.716Z: Executing operation Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull Oct 26, 2018 8:33:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:21.496Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:21.521Z RUNNING Query5 Oct 26, 2018 8:33:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:21.612Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:21.647Z RUNNING Query12 ========================================================================================== Run started 2018-10-26T20:29:08.432Z and ran for PT253.263S Default configuration: Exception in thread "main" {"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1} Configurations: Conf Description 0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000 java.lang.RuntimeException: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables 0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000 at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144) 0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000 at org.apache.beam.sdk.nexmark.Main.main(Main.java:477) 0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 *** not run *** 0001 *** not run *** 0002 *** not run *** 0003 *** not run *** 0004 *** not run *** 0005 *** not run *** 0006 *** not run *** 0007 *** not run *** 0008 *** not run *** 0009 *** not run *** 0010 *** not run *** 0011 *** not run *** 0012 *** not run *** ========================================================================================== Caused by: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128) at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65) at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250) at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435) at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156) at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108) at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.ClassNotFoundException: org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 13 more Oct 26, 2018 8:33:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:21.723Z Waiting for main pipeline to 'finish'WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:21.750Z Waiting for main pipeline to 'finish' Oct 26, 2018 8:33:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:21.758Z RUNNING Query3 2018-10-26T20:33:21.779Z RUNNING Query11 Oct 26, 2018 8:33:23 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:23.671Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:23.735Z RUNNING Query6 Oct 26, 2018 8:33:24 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:24.019Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:24.054Z RUNNING Query4 2018-10-26T20:33:25.638Z Waiting for main pipeline to 'finish' Oct 26, 2018 8:33:25 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:25.670Z RUNNING Query9 Oct 26, 2018 8:33:29 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:29.728Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:29.781Z RUNNING Query2 Oct 26, 2018 8:33:30 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:30.318Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:30.354Z RUNNING Query0 Oct 26, 2018 8:33:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:31.329Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:31.362Z RUNNING Query10 Oct 26, 2018 8:33:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:31.898Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:31.921Z RUNNING Query8 Oct 26, 2018 8:33:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:33:32.460Z: Cleaning up. 2018-10-26T20:33:32.660Z Waiting for main pipeline to 'finish' Oct 26, 2018 8:33:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-26T20:33:32.615Z: Stopping worker pool... Oct 26, 2018 8:33:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:32.689Z RUNNING Query7 Oct 26, 2018 8:33:34 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-26T20:33:34.935Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-26T20:33:34.969Z RUNNING Query1 > Task :beam-sdks-java-nexmark:run FAILED :beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 4 mins 27.403 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-sdks-java-nexmark:run'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 21s 68 actionable tasks: 64 executed, 4 from cache Publishing build scan... https://gradle.com/s/zhtvza3mxxtog Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org