See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/849/display/redirect?page=changes>
Changes:
[coheigea] Move array declarations after the type
------------------------------------------
[...truncated 1.05 MB...]
Oct 28, 2018 8:54:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.078Z: Fusing consumer Query1/Query1.Stamp into
Query1/Query1.Debug
Oct 28, 2018 8:54:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.080Z: Fusing consumer Query1/Query1.Debug into
Query1/Query1.Forget
Oct 28, 2018 8:54:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.082Z: Fusing consumer Query1/Query1.Monitor into
Query1.ReadUnbounded/StripIds
Oct 28, 2018 8:54:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.085Z: Fusing consumer
Query1/justBids/IsBid/ParDo(Anonymous) into Query1/Query1.Snoop
Oct 28, 2018 8:54:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.087Z: Fusing consumer Query1/justBids/AsBid into
Query1/justBids/IsBid/ParDo(Anonymous)
Oct 28, 2018 8:54:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.308Z: Starting 4 workers...
Oct 28, 2018 8:54:57 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:56.851Z: Executing operation
Query1.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query1.ReadUnbounded/StripIds+Query1/Query1.Monitor+Query1/Query1.Snoop+Query1/justBids/IsBid/ParDo(Anonymous)+Query1/justBids/AsBid+Query1/Query1.ToEuros+Query1/Query1.Forget+Query1/Query1.Debug+Query1/Query1.Stamp+Query1.Format+Query1.DevNull
Oct 28, 2018 8:55:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.247Z: Workers have started successfully.
Oct 28, 2018 8:55:17 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.234Z: Workers have started successfully.
Oct 28, 2018 8:55:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:17.756Z: Workers have started successfully.
Oct 28, 2018 8:55:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.387Z: Workers have started successfully.
Oct 28, 2018 8:55:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:17.936Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:18.671Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.534Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.177Z: Workers have started successfully.
Oct 28, 2018 8:55:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.769Z: Workers have started successfully.
Oct 28, 2018 8:55:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:25.293Z: Workers have started successfully.
Oct 28, 2018 8:55:28 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:27.271Z: Workers have started successfully.
Oct 28, 2018 8:55:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:28.739Z: Workers have started successfully.
Oct 28, 2018 8:55:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:30.266Z: Workers have started successfully.
Oct 28, 2018 8:57:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.686Z: Cleaning up.
Oct 28, 2018 8:57:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.720Z: Worker pool stopped.
Oct 28, 2018 8:57:04 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.732Z: Stopping worker pool...
Oct 28, 2018 8:57:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.529Z: Cleaning up.
Oct 28, 2018 8:57:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.572Z: Worker pool stopped.
Oct 28, 2018 8:57:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.590Z: Stopping worker pool...
Oct 28, 2018 8:57:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.606Z: Cleaning up.
Oct 28, 2018 8:57:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.661Z: Worker pool stopped.
Oct 28, 2018 8:57:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.688Z: Stopping worker pool...
Oct 28, 2018 8:57:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.214Z: Cleaning up.
Oct 28, 2018 8:57:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.246Z: Worker pool stopped.
Oct 28, 2018 8:57:29 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.262Z: Stopping worker pool...
Oct 28, 2018 8:57:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.173Z: Cleaning up.
Oct 28, 2018 8:57:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.199Z: Worker pool stopped.
Oct 28, 2018 8:57:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.214Z: Stopping worker pool...
Oct 28, 2018 8:57:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.500Z: Cleaning up.
Oct 28, 2018 8:57:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.531Z: Worker pool stopped.
Oct 28, 2018 8:57:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.545Z: Stopping worker pool...
Oct 28, 2018 8:57:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.679Z: Cleaning up.
Oct 28, 2018 8:57:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.732Z: Worker pool stopped.
Oct 28, 2018 8:57:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.755Z: Stopping worker pool...
Oct 28, 2018 8:57:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.874Z: Cleaning up.
Oct 28, 2018 8:57:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.924Z: Worker pool stopped.
Oct 28, 2018 8:57:55 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.944Z: Stopping worker pool...
Oct 28, 2018 8:58:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.440Z: Cleaning up.
Oct 28, 2018 8:58:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.472Z: Worker pool stopped.
Oct 28, 2018 8:58:20 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.485Z: Stopping worker pool...
Oct 28, 2018 8:58:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:32.867Z: Cleaning up.
Oct 28, 2018 8:58:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:32.911Z: Worker pool stopped.
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.383Z Waiting for main pipeline to 'finish'
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.385Z Waiting for main pipeline to 'finish'
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.405Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.407Z RUNNING Query10
2018-10-28T20:58:33.409Z RUNNING Query0
2018-10-28T20:58:33.432Z RUNNING Query11
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.551Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.559Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.579Z RUNNING Query6
2018-10-28T20:58:33.586Z RUNNING Query2
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.595Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.599Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.616Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.625Z RUNNING Query9
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.626Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.628Z RUNNING Query12
2018-10-28T20:58:33.651Z RUNNING Query5
2018-10-28T20:58:33.661Z RUNNING Query8
Oct 28, 2018 8:58:33 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
2018-10-28T20:58:33.668Z Waiting for main pipeline to 'finish'
INFO: 2018-10-28T20:58:32.924Z: Stopping worker pool...
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.722Z RUNNING Query7
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:33.811Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.846Z RUNNING Query3
2018-10-28T20:58:34.107Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.190Z 1 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2018-10-28T20:54:22.980Z and ran for PT251.209S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Exception in thread "main"
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
java.lang.RuntimeException: java.lang.IllegalStateException: More than one
metric matches name: fatal in namespace Query0.
0006 *** not run ***
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0007 *** at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.IllegalStateException: More than one metric matches name:
fatal in namespace Query0.
at
org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at
org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at
org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-28T20:58:34.228Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.266Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.365Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.383Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.385Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.399Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.445Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.479Z 1 samples not enough to calculate steady-state event
rate
2018-10-28T20:58:34.621Z 1 samples not enough to calculate steady-state event
rate
Oct 28, 2018 8:58:37 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:37.030Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:37.057Z RUNNING Query4
2018-10-28T20:58:37.848Z 1 samples not enough to calculate steady-state event
rate
Oct 28, 2018 8:58:45 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-28T20:58:45.809Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:45.834Z RUNNING Query1
2018-10-28T20:58:46.420Z 1 samples not enough to calculate steady-state event
rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 4,5,main])
completed. Took 4 mins 24.225 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 55s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/3mwxvvkokhe3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
