See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/849/display/redirect?page=changes>
Changes: [coheigea] Move array declarations after the type ------------------------------------------ [...truncated 1.05 MB...] Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:54:51.078Z: Fusing consumer Query1/Query1.Stamp into Query1/Query1.Debug Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:54:51.080Z: Fusing consumer Query1/Query1.Debug into Query1/Query1.Forget Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:54:51.082Z: Fusing consumer Query1/Query1.Monitor into Query1.ReadUnbounded/StripIds Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:54:51.085Z: Fusing consumer Query1/justBids/IsBid/ParDo(Anonymous) into Query1/Query1.Snoop Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:54:51.087Z: Fusing consumer Query1/justBids/AsBid into Query1/justBids/IsBid/ParDo(Anonymous) Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:54:51.308Z: Starting 4 workers... Oct 28, 2018 8:54:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:54:56.851Z: Executing operation Query1.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query1.ReadUnbounded/StripIds+Query1/Query1.Monitor+Query1/Query1.Snoop+Query1/justBids/IsBid/ParDo(Anonymous)+Query1/justBids/AsBid+Query1/Query1.ToEuros+Query1/Query1.Forget+Query1/Query1.Debug+Query1/Query1.Stamp+Query1.Format+Query1.DevNull Oct 28, 2018 8:55:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:16.247Z: Workers have started successfully. Oct 28, 2018 8:55:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:16.234Z: Workers have started successfully. Oct 28, 2018 8:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:17.756Z: Workers have started successfully. Oct 28, 2018 8:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:16.387Z: Workers have started successfully. Oct 28, 2018 8:55:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:17.936Z: Workers have started successfully. Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:18.671Z: Workers have started successfully. Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:19.534Z: Workers have started successfully. Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:19.177Z: Workers have started successfully. Oct 28, 2018 8:55:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:19.769Z: Workers have started successfully. Oct 28, 2018 8:55:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:25.293Z: Workers have started successfully. Oct 28, 2018 8:55:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:27.271Z: Workers have started successfully. Oct 28, 2018 8:55:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:28.739Z: Workers have started successfully. Oct 28, 2018 8:55:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:55:30.266Z: Workers have started successfully. Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:04.686Z: Cleaning up. Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:04.720Z: Worker pool stopped. Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:04.732Z: Stopping worker pool... Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:09.529Z: Cleaning up. Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:09.572Z: Worker pool stopped. Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:09.590Z: Stopping worker pool... Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:18.606Z: Cleaning up. Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:18.661Z: Worker pool stopped. Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:18.688Z: Stopping worker pool... Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:29.214Z: Cleaning up. Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:29.246Z: Worker pool stopped. Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:29.262Z: Stopping worker pool... Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:35.173Z: Cleaning up. Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:35.199Z: Worker pool stopped. Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:35.214Z: Stopping worker pool... Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:36.500Z: Cleaning up. Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:36.531Z: Worker pool stopped. Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:36.545Z: Stopping worker pool... Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:39.679Z: Cleaning up. Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:39.732Z: Worker pool stopped. Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:39.755Z: Stopping worker pool... Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:54.874Z: Cleaning up. Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:54.924Z: Worker pool stopped. Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:57:54.944Z: Stopping worker pool... Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:58:19.440Z: Cleaning up. Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:58:19.472Z: Worker pool stopped. Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:58:19.485Z: Stopping worker pool... Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:58:32.867Z: Cleaning up. Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-10-28T20:58:32.911Z: Worker pool stopped. Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.383Z Waiting for main pipeline to 'finish' Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.385Z Waiting for main pipeline to 'finish' Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.405Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.407Z RUNNING Query10 2018-10-28T20:58:33.409Z RUNNING Query0 2018-10-28T20:58:33.432Z RUNNING Query11 Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.551Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.559Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.579Z RUNNING Query6 2018-10-28T20:58:33.586Z RUNNING Query2 Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.595Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.599Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.616Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.625Z RUNNING Query9 Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.626Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.628Z RUNNING Query12 2018-10-28T20:58:33.651Z RUNNING Query5 2018-10-28T20:58:33.661Z RUNNING Query8 Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process 2018-10-28T20:58:33.668Z Waiting for main pipeline to 'finish' INFO: 2018-10-28T20:58:32.924Z: Stopping worker pool... Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.722Z RUNNING Query7 Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:33.811Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:33.846Z RUNNING Query3 2018-10-28T20:58:34.107Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.190Z 1 samples not enough to calculate steady-state event rate ========================================================================================== Run started 2018-10-28T20:54:22.980Z and ran for PT251.209S Default configuration: {"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1} Exception in thread "main" Configurations: Conf Description 0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 *** not run *** 0001 *** not run *** 0002 *** not run *** 0003 *** not run *** 0004 *** not run *** 0005 *** not run *** java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0. 0006 *** not run *** at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144) 0007 *** at org.apache.beam.sdk.nexmark.Main.main(Main.java:477) not run *** 0008 *** not run *** 0009 *** not run *** 0010 *** not run *** 0011 *** not run *** 0012 *** not run *** ========================================================================================== Caused by: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0. at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444) at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127) at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65) at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447) at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156) at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108) at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2018-10-28T20:58:34.228Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.266Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.365Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.383Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.385Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.399Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.445Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.479Z 1 samples not enough to calculate steady-state event rate 2018-10-28T20:58:34.621Z 1 samples not enough to calculate steady-state event rate Oct 28, 2018 8:58:37 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:37.030Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:37.057Z RUNNING Query4 2018-10-28T20:58:37.848Z 1 samples not enough to calculate steady-state event rate Oct 28, 2018 8:58:45 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish 2018-10-28T20:58:45.809Z Waiting for main pipeline to 'finish' WARNING: No terminal state was returned. State value RUNNING 2018-10-28T20:58:45.834Z RUNNING Query1 2018-10-28T20:58:46.420Z 1 samples not enough to calculate steady-state event rate > Task :beam-sdks-java-nexmark:run FAILED :beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 4 mins 24.225 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-sdks-java-nexmark:run'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 5m 55s 68 actionable tasks: 15 executed, 53 up-to-date Publishing build scan... https://gradle.com/s/3mwxvvkokhe3u Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org