See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/1143/display/redirect>
------------------------------------------
[...truncated 486.29 KB...]
0004 1.7 5793.7 40
0005 6.3 15780.3 12
0006 1.1 8881.0 401
0007 82.9 1206.0 1
0008 2.2 45454.5 6000
0009 0.9 11376.6 298
0010 71.0 1408.5 1
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
==========================================================================================
2018-11-16T06:09:02.245Z Generating 100000 events in streaming mode
2018-11-16T06:09:06.160Z Waiting for main pipeline to 'finish'
2018-11-16T06:09:06.160Z DONE Query11
2018-11-16T06:09:06.160Z 1 samples not enough to calculate steady-state event
rate
Nov 16, 2018 6:09:06 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2018-11-16T06:09:06.161Z Running query:PROCESSING_TIME_WINDOWS;
exportSummaryToBigQuery:true
==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT188.048S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 6.1 16474.5 100000
0001 3.7 27240.5 92000
0002 1.8 56053.8 351
0003 3.7 27100.3 445
0004 1.7 5793.7 40
0005 6.3 15780.3 12
0006 1.1 8881.0 401
0007 82.9 1206.0 1
0008 2.2 45454.5 6000
0009 0.9 11376.6 298
0010 71.0 1408.5 1
0011 3.8 26267.4 1919
0012 *** not run ***
0013 *** not run ***
==========================================================================================
2018-11-16T06:09:06.162Z Generating 100000 events in streaming mode
2018-11-16T06:09:09.402Z Waiting for main pipeline to 'finish'
2018-11-16T06:09:09.402Z DONE Query12
2018-11-16T06:09:09.403Z 1 samples not enough to calculate steady-state event
rate
Nov 16, 2018 6:09:09 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
2018-11-16T06:09:09.403Z Running query:BOUNDED_SIDE_INPUT_JOIN;
exportSummaryToBigQuery:true
SEVERE: Failed to get metric fatal, from namespace Query12
==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT191.290S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 6.1 16474.5 100000
0001 3.7 27240.5 92000
0002 1.8 56053.8 351
0003 3.7 27100.3 445
0004 1.7 5793.7 40
0005 6.3 15780.3 12
0006 1.1 8881.0 401
0007 82.9 1206.0 1
0008 2.2 45454.5 6000
0009 0.9 11376.6 298
0010 71.0 1408.5 1
0011 3.8 26267.4 1919
0012 3.1 31826.9 1919
0013 *** not run ***
==========================================================================================
2018-11-16T06:09:09.405Z Generating 100000 events in streaming mode
2018-11-16T06:09:12.861Z Waiting for main pipeline to 'finish'
2018-11-16T06:09:12.861Z DONE JoinToFiles
2018-11-16T06:09:12.862Z 1 samples not enough to calculate steady-state event
rate
Nov 16, 2018 6:09:12 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace JoinToFiles
==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT194.749S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 6.1 16474.5 100000
0001 3.7 27240.5 92000
0002 1.8 56053.8 351
0003 3.7 27100.3 445
0004 1.7 5793.7 40
0005 6.3 15780.3 12
0006 1.1 8881.0 401
0007 82.9 1206.0 1
0008 2.2 45454.5 6000
0009 0.9 11376.6 298
0010 71.0 1408.5 1
0011 3.8 26267.4 1919
0012 3.1 31826.9 1919
0013 3.4 29761.9 92000
==========================================================================================
==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT197.194S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
Exception in thread "main" 0000 query:PASSTHROUGH;
exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
java.lang.NullPointerException
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
at
com.google.cloud.bigquery.StandardTableDefinition$StreamingBuffer.fromPb(StandardTableDefinition.java:116)
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
at
com.google.cloud.bigquery.StandardTableDefinition.fromPb(StandardTableDefinition.java:225)
at
com.google.cloud.bigquery.TableDefinition.fromPb(TableDefinition.java:155)
Performance:
at
com.google.cloud.bigquery.TableInfo$BuilderImpl.<init>(TableInfo.java:183)
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
at com.google.cloud.bigquery.Table.fromPb(Table.java:593)
0000 6.1 16474.5 100000
at
com.google.cloud.bigquery.BigQueryImpl.getTable(BigQueryImpl.java:410)
0001 3.7 27240.5 92000
at
org.apache.beam.sdk.testutils.publishing.BigQueryClient.createTableIfNotExists(BigQueryClient.java:74)
0002 1.8 56053.8 351
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:184)
0003 3.7 27100.3 445
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:148)
0004 1.7 5793.7 40
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:98)
0005 6.3 15780.3 12
at org.apache.beam.sdk.nexmark.Main.main(Main.java:423)
0006 1.1 8881.0 401
0007 82.9 1206.0 1
0008 2.2 45454.5 6000
0009 0.9 11376.6 298
0010 71.0 1408.5 1
0011 3.8 26267.4 1919
0012 3.1 31826.9 1919
0013 3.4 29761.9 92000
==========================================================================================
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 6,5,main])
completed. Took 3 mins 19.309 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 50s
65 actionable tasks: 14 executed, 51 up-to-date
Publishing build scan...
https://gradle.com/s/4h2r72cyxqpc4
Build cache (/home/jenkins/.gradle/caches/build-cache-1) removing files not
accessed on or after Fri Nov 09 06:04:30 UTC 2018.
Cache entries evicted. In-memory cache of
/home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4311}
MaxSize{4500}, CacheStats{hitCount=3, missCount=3998, loadSuccessCount=3999,
loadExceptionCount=0, totalLoadTime=207497380, evictionCount=1}
Performance may suffer from in-memory cache misses. Increase max heap size of
Gradle build process to reduce cache misses.
Cache entries evicted. In-memory cache of
/home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4500}
MaxSize{4500}, CacheStats{hitCount=3, missCount=4637, loadSuccessCount=4638,
loadExceptionCount=0, totalLoadTime=239953428, evictionCount=451}
Performance may suffer from in-memory cache misses. Increase max heap size of
Gradle build process to reduce cache misses.
Cache entries evicted. In-memory cache of
/home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4500}
MaxSize{4500}, CacheStats{hitCount=3, missCount=5087, loadSuccessCount=5088,
loadExceptionCount=0, totalLoadTime=259783903, evictionCount=901}
Performance may suffer from in-memory cache misses. Increase max heap size of
Gradle build process to reduce cache misses.
Cache entries evicted. In-memory cache of
/home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4500}
MaxSize{4500}, CacheStats{hitCount=3, missCount=5537, loadSuccessCount=5538,
loadExceptionCount=0, totalLoadTime=278410281, evictionCount=1351}
Performance may suffer from in-memory cache misses. Increase max heap size of
Gradle build process to reduce cache misses.
Build cache (/home/jenkins/.gradle/caches/build-cache-1) cleaned up in 0.468
secs.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
