See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4979/display/redirect>
Changes:
------------------------------------------
[...truncated 293.94 KB...]
2020-02-06T13:47:12.135Z WARNING: streaming query appears to have been stuck
for 54 min.
2020-02-06T13:47:12.135Z no activity
2020-02-06T13:47:27.164Z RUNNING Query1
2020-02-06T13:47:27.656Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:47:27.708Z WARNING: streaming query appears to have been stuck
for 54 min.
2020-02-06T13:47:27.708Z no activity
2020-02-06T13:47:42.736Z RUNNING Query1
2020-02-06T13:47:43.298Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:47:43.355Z WARNING: streaming query appears to have been stuck
for 55 min.
2020-02-06T13:47:43.355Z no activity
2020-02-06T13:47:58.388Z RUNNING Query1
2020-02-06T13:47:58.894Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:47:58.945Z WARNING: streaming query appears to have been stuck
for 55 min.
2020-02-06T13:47:58.946Z no activity
2020-02-06T13:48:13.978Z RUNNING Query1
2020-02-06T13:48:14.465Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:48:14.513Z WARNING: streaming query appears to have been stuck
for 55 min.
2020-02-06T13:48:14.513Z no activity
2020-02-06T13:48:29.539Z RUNNING Query1
2020-02-06T13:48:30.070Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:48:30.122Z WARNING: streaming query appears to have been stuck
for 55 min.
2020-02-06T13:48:30.122Z no activity
2020-02-06T13:48:45.151Z RUNNING Query1
2020-02-06T13:48:45.646Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:48:45.697Z WARNING: streaming query appears to have been stuck
for 56 min.
2020-02-06T13:48:45.697Z no activity
2020-02-06T13:49:00.727Z RUNNING Query1
2020-02-06T13:49:01.221Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:49:01.267Z WARNING: streaming query appears to have been stuck
for 56 min.
2020-02-06T13:49:01.268Z no activity
2020-02-06T13:49:16.305Z RUNNING Query1
2020-02-06T13:49:16.807Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:49:16.851Z WARNING: streaming query appears to have been stuck
for 56 min.
2020-02-06T13:49:16.851Z no activity
2020-02-06T13:49:31.875Z RUNNING Query1
2020-02-06T13:49:32.391Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:49:32.436Z WARNING: streaming query appears to have been stuck
for 57 min.
2020-02-06T13:49:32.436Z no activity
2020-02-06T13:49:47.469Z RUNNING Query1
2020-02-06T13:49:48.054Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:49:48.105Z WARNING: streaming query appears to have been stuck
for 57 min.
2020-02-06T13:49:48.105Z no activity
2020-02-06T13:50:03.132Z RUNNING Query1
2020-02-06T13:50:03.673Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:50:03.717Z WARNING: streaming query appears to have been stuck
for 57 min.
2020-02-06T13:50:03.717Z no activity
2020-02-06T13:50:18.750Z RUNNING Query1
2020-02-06T13:50:19.255Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:50:19.304Z WARNING: streaming query appears to have been stuck
for 57 min.
2020-02-06T13:50:19.304Z no activity
2020-02-06T13:50:34.327Z RUNNING Query1
2020-02-06T13:50:35.823Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:50:35.882Z WARNING: streaming query appears to have been stuck
for 58 min.
2020-02-06T13:50:35.882Z no activity
2020-02-06T13:50:50.919Z RUNNING Query1
2020-02-06T13:50:51.437Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:50:51.485Z WARNING: streaming query appears to have been stuck
for 58 min.
2020-02-06T13:50:51.486Z no activity
2020-02-06T13:51:06.510Z RUNNING Query1
2020-02-06T13:51:07.052Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:51:07.100Z WARNING: streaming query appears to have been stuck
for 58 min.
2020-02-06T13:51:07.100Z no activity
2020-02-06T13:51:22.138Z RUNNING Query1
2020-02-06T13:51:22.709Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:51:22.749Z WARNING: streaming query appears to have been stuck
for 58 min.
2020-02-06T13:51:22.749Z no activity
2020-02-06T13:51:37.783Z RUNNING Query1
2020-02-06T13:51:38.347Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:51:38.400Z WARNING: streaming query appears to have been stuck
for 59 min.
2020-02-06T13:51:38.400Z no activity
2020-02-06T13:51:53.460Z RUNNING Query1
2020-02-06T13:51:54.263Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:51:54.304Z WARNING: streaming query appears to have been stuck
for 59 min.
2020-02-06T13:51:54.304Z no activity
2020-02-06T13:52:09.335Z RUNNING Query1
2020-02-06T13:52:09.835Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:52:09.894Z WARNING: streaming query appears to have been stuck
for 59 min.
2020-02-06T13:52:09.894Z no activity
2020-02-06T13:52:24.924Z RUNNING Query1
2020-02-06T13:52:25.446Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:52:25.494Z WARNING: streaming query appears to have been stuck
for 59 min.
2020-02-06T13:52:25.494Z no activity
2020-02-06T13:52:40.523Z RUNNING Query1
2020-02-06T13:52:41.043Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:52:41.090Z ERROR: streaming query appears to have been stuck for
60 minutes, cancelling job.
2020-02-06T13:52:41.128Z no activity
2020-02-06T13:52:56.162Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:52:56.737Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:52:56.738Z no activity
2020-02-06T13:53:11.771Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:53:12.438Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:53:12.438Z no activity
2020-02-06T13:53:27.468Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:53:28.007Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:53:28.008Z no activity
2020-02-06T13:53:43.041Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:53:43.585Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:53:43.586Z no activity
2020-02-06T13:53:58.619Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:53:59.180Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:53:59.180Z no activity
2020-02-06T13:54:14.205Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:54:14.819Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:54:14.819Z no activity
2020-02-06T13:54:29.852Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:54:30.433Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:54:30.433Z no activity
2020-02-06T13:54:45.466Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:54:45.974Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:54:45.974Z no activity
2020-02-06T13:55:01.008Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:55:01.778Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:55:01.778Z no activity
2020-02-06T13:55:16.809Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:55:17.364Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:55:17.364Z no activity
2020-02-06T13:55:32.406Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:55:33.021Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:55:33.022Z no activity
2020-02-06T13:55:48.064Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:55:48.640Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:55:48.641Z no activity
2020-02-06T13:56:03.866Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:56:04.573Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:56:04.573Z no activity
2020-02-06T13:56:19.601Z UNRECOGNIZED Query1 (waiting for shutdown)
2020-02-06T13:56:20.199Z 0 samples not enough to calculate steady-state event
rate
2020-02-06T13:56:20.199Z no activity
2020-02-06T13:56:35.239Z CANCELLED Query1 (waiting for shutdown)
2020-02-06T13:56:35.260Z 0 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2020-02-06T12:48:17.632Z and ran for PT4097.628S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardMinutes":10,"standardSeconds":600,"standardDays":0,"standardHours":0,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.8 420521.4 10000000
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 11.1 902445.6 83527
0003 46.1 216811.6 59455
0004 52.8 18954.5 140
0005 126.9 78793.5 4567
0006 53.8 18590.1 15604
0007 115.0 86931.6 100
0008 49.8 200992.9 92833
0009 36.9 27091.5 32548
0010 106.9 93573.4 100
0011 194.2 51487.2 1839657
0012 94.5 105806.7 607023
0013 27.0 370823.6 9200000
0014 134.5 74375.4 9200000
==========================================================================================
==========================================================================================
Run started 2020-02-06T12:48:17.632Z and ran for PT4101.174S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardMinutes":10,"standardSeconds":600,"standardDays":0,"standardHours":0,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 23.8 420521.4 10000000
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 11.1 902445.6 83527
0003 46.1 216811.6 59455
0004 52.8 18954.5 140
0005 126.9 78793.5 4567
0006 53.8 18590.1 15604
0007 115.0 86931.6 100
0008 49.8 200992.9 92833
0009 36.9 27091.5 32548
0010 106.9 93573.4 100
0011 194.2 51487.2 1839657
0012 94.5 105806.7 607023
Exception in thread "main" 0013 27.0 370823.6
9200000
0014 134.5 74375.4 9200000
==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 8m 28s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://gradle.com/s/5jvu76iruh43a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
