See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/831/display/redirect?page=changes>
Changes:
[github] Update web site links for the 2.8.0 release (#6745)
------------------------------------------
[...truncated 463.90 KB...]
INFO: 2018-10-26T19:31:07.041Z: Autoscaling: Raised the number of workers to 3
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:07.096Z: Resized worker pool to 3, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:07.219Z: Autoscaling: Raised the number of workers to 2
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:07.257Z: Resized worker pool to 2, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:08.804Z: Workers have started successfully.
Oct 26, 2018 7:31:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:09.945Z: Autoscaling: Raised the number of workers to 2
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:09.990Z: Resized worker pool to 2, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:10 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:08.447Z: Workers have started successfully.
Oct 26, 2018 7:31:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:10.744Z: Workers have started successfully.
Oct 26, 2018 7:31:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:11.213Z: Workers have started successfully.
Oct 26, 2018 7:31:11 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:10.870Z: Workers have started successfully.
Oct 26, 2018 7:31:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:12.977Z: Autoscaling: Raised the number of workers to 4
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:11.969Z: Workers have started successfully.
Oct 26, 2018 7:31:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:15.138Z: Workers have started successfully.
Oct 26, 2018 7:31:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:15.687Z: Autoscaling: Raised the number of workers to 3
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:15.733Z: Resized worker pool to 3, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:16 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:16.171Z: Workers have started successfully.
Oct 26, 2018 7:31:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:16.340Z: Autoscaling: Raised the number of workers to 2
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:16.382Z: Resized worker pool to 2, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:18 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:16.655Z: Workers have started successfully.
Oct 26, 2018 7:31:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:19.014Z: Autoscaling: Raised the number of workers to 1
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:19.061Z: Resized worker pool to 1, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:19.541Z: Workers have started successfully.
Oct 26, 2018 7:31:21 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:19.510Z: Workers have started successfully.
Oct 26, 2018 7:31:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:21.182Z: Autoscaling: Raised the number of workers to 4
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:22.062Z: Autoscaling: Raised the number of workers to 3
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:23 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:22.110Z: Resized worker pool to 3, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:24.562Z: Autoscaling: Raised the number of workers to 4
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:26 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:26.552Z: Autoscaling: Raised the number of workers to 4
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:27 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:26.690Z: Workers have started successfully.
Oct 26, 2018 7:31:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:27.919Z: Autoscaling: Raised the number of workers to 1
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:30 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:27.956Z: Resized worker pool to 1, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:29.723Z: Autoscaling: Raised the number of workers to 1
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:29.758Z: Resized worker pool to 1, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:30.541Z: Workers have started successfully.
Oct 26, 2018 7:31:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:31.797Z: Autoscaling: Raised the number of workers to 2
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:32 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:31.850Z: Resized worker pool to 2, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:32.233Z: Autoscaling: Raised the number of workers to 1
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:32.276Z: Resized worker pool to 1, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:33.429Z: Autoscaling: Raised the number of workers to 2
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:33.476Z: Resized worker pool to 2, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:35.729Z: Autoscaling: Raised the number of workers to 3
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:35.757Z: Resized worker pool to 3, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:37.666Z: Autoscaling: Raised the number of workers to 3
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:38 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:37.706Z: Resized worker pool to 3, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:38.140Z: Autoscaling: Raised the number of workers to 3
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:38.185Z: Resized worker pool to 3, though goal was 4.
This could be a quota issue.
Oct 26, 2018 7:31:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:39.606Z: Workers have started successfully.
Oct 26, 2018 7:31:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:39.744Z: Autoscaling: Raised the number of workers to 4
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:39.964Z: Workers have started successfully.
Oct 26, 2018 7:31:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:42.047Z: Workers have started successfully.
Oct 26, 2018 7:31:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:43.594Z: Workers have started successfully.
Oct 26, 2018 7:31:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:43.794Z: Autoscaling: Raised the number of workers to 4
based on the rate of progress in the currently running step(s).
Oct 26, 2018 7:31:47 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-26T19:31:47.481Z: Workers have started successfully.
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.529ZWARNING: No terminal state was returned. State value
RUNNING
Waiting for main pipeline to 'finish'
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.546Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:31:50.575Z RUNNING Query11
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.580Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:31:50.591Z RUNNING Query5
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.597Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:31:50.625Z RUNNING Query0
2018-10-26T19:31:50.627Z RUNNING Query2
2018-10-26T19:31:50.633Z Waiting for main pipeline to 'finish'
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.645Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:31:50.659Z RUNNING Query7
==========================================================================================
Run started 2018-10-26T19:27:37.683Z and ran for PT252.967S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0001 query:1; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
java.lang.RuntimeException: java.lang.NoClassDefFoundError:
org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.NoClassDefFoundError:
org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at
org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at
org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
2018-10-26T19:31:50.674Z RUNNING Query1
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.727Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.750Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:31:50.767Z RUNNING Query9
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.772Z WARNING: No terminal state was returned. State value
RUNNING
Waiting for main pipeline to 'finish'
2018-10-26T19:31:50.796Z RUNNING Query6
2018-10-26T19:31:50.801Z RUNNING Query8
Oct 26, 2018 7:31:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:50.830Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:31:50.857Z RUNNING Query3
Oct 26, 2018 7:31:51 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:31:51.137Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:31:51.169Z RUNNING Query4
Oct 26, 2018 7:32:04 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:32:04.619Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:32:04.652Z RUNNING Query12
Oct 26, 2018 7:32:04 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
2018-10-26T19:32:04.874Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-26T19:32:04.908Z RUNNING Query10
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Daemon worker,5,main]) completed. Took 4
mins 28.91 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 48s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/d2yxw2o6nr6ks
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
