See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4472/display/redirect>
Changes:
------------------------------------------
[...truncated 277.87 KB...]
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 *** not run ***
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2019-12-07T12:23:11.048Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:23:11.048Z no activity
2019-12-07T12:23:24.487Z RUNNING Query6
2019-12-07T12:23:25.241Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:23:25.310Z streaming query appears to have finished waiting for
completion.
2019-12-07T12:23:25.311Z no activity
2019-12-07T12:23:26.226Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:23:26.955Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:23:26.955Z no activity
2019-12-07T12:23:40.354Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:23:41.038Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:23:41.038Z no activity
2019-12-07T12:23:41.989Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:23:42.667Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:23:42.667Z no activity
2019-12-07T12:23:56.076Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:23:56.840Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:23:56.841Z no activity
2019-12-07T12:23:57.758Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:23:58.833Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:23:58.834Z no activity
2019-12-07T12:24:11.874Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:12.644Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:24:12.644Z no activity
2019-12-07T12:24:13.867Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:24:14.620Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:24:14.621Z no activity
2019-12-07T12:24:27.682Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:28.401Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:24:28.401Z no activity
2019-12-07T12:24:29.693Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:24:30.413Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:24:30.413Z no activity
2019-12-07T12:24:43.435Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:44.163Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:24:44.163Z no activity
2019-12-07T12:24:45.445Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:24:46.267Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:24:46.267Z no activity
2019-12-07T12:24:59.200Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:59.945Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:24:59.945Z no activity
2019-12-07T12:25:01.302Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:25:02.020Z 4 samples not enough to calculate steady-state event
rate
2019-12-07T12:25:02.020Z no activity
2019-12-07T12:25:14.973Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:25:15.705Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:25:15.705Z no activity
2019-12-07T12:25:17.061Z DONE BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:25:17.108Z 4 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2019-12-07T12:08:46.156Z and ran for PT990.952S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 *** not run ***
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 159.6 62649.6 9200000
==========================================================================================
2019-12-07T12:25:30.750Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:25:31.509Z 3 samples not enough to calculate steady-state event
rate
2019-12-07T12:25:31.509Z no activity
2019-12-07T12:25:46.550Z DONE Query6 (waiting for shutdown)
2019-12-07T12:25:46.590Z 3 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2019-12-07T12:08:46.156Z and ran for PT1020.435S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 53.9 18556.7 15844
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 159.6 62649.6 9200000
==========================================================================================
==========================================================================================
Run started 2019-12-07T12:08:46.156Z and ran for PT1023.556S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Exception in thread "main" Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 53.9 18556.7 15844
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 159.6 62649.6 9200000
==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 9s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/uhwnqnkbg5p7o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
