See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/1021/display/redirect?page=changes>
Changes:
[valentyn] Disambiguate between snappy and python-snappy PyPi packages in test
------------------------------------------
[...truncated 240.31 KB...]
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00007-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00016-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00022-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00004-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
]}
2018-11-03T01:12:23.788Z Waiting for main pipeline to 'finish'
2018-11-03T01:12:23.788Z DONE Query10
2018-11-03T01:12:23.789Z Running query:USER_SESSIONS;
exportSummaryToBigQuery:true
==========================================================================================
Run started 2018-11-03T01:11:15.659Z and ran for PT68.130S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 7.5 13351.1 100000
0001 3.8 26267.4 92000
0002 1.6 61881.2 351
0003 3.0 32916.4 460
0004 1.7 5743.8 40
0005 5.5 18079.9 12
0006 1.2 8382.2 401
0007 14.7 6793.9 1
0008 1.7 57937.4 6000
0009 1.1 8787.3 298
0010 20.1 4970.9 1
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
==========================================================================================
2018-11-03T01:12:23.791Z Generating 100000 events in batch mode
2018-11-03T01:12:27.535Z Waiting for main pipeline to 'finish'
2018-11-03T01:12:27.535Z DONE Query11
2018-11-03T01:12:27.536Z Running query:PROCESSING_TIME_WINDOWS;
exportSummaryToBigQuery:true
==========================================================================================
Run started 2018-11-03T01:11:15.659Z and ran for PT71.877S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 7.5 13351.1 100000
0001 3.8 26267.4 92000
0002 1.6 61881.2 351
0003 3.0 32916.4 460
0004 1.7 5743.8 40
0005 5.5 18079.9 12
0006 1.2 8382.2 401
0007 14.7 6793.9 1
0008 1.7 57937.4 6000
0009 1.1 8787.3 298
0010 20.1 4970.9 1
0011 3.5 28304.6 1919
0012 *** not run ***
0013 *** not run ***
==========================================================================================
2018-11-03T01:12:27.538Z Generating 100000 events in batch mode
2018-11-03T01:12:30.043Z Waiting for main pipeline to 'finish'
2018-11-03T01:12:30.043Z DONE Query12
2018-11-03T01:12:30.044Z Running query:BOUNDED_SIDE_INPUT_JOIN;
exportSummaryToBigQuery:true
==========================================================================================
Run started 2018-11-03T01:11:15.659Z and ran for PT74.385S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 7.5 13351.1 100000
0001 3.8 26267.4 92000
0002 1.6 61881.2 351
0003 3.0 32916.4 460
0004 1.7 5743.8 40
0005 5.5 18079.9 12
0006 1.2 8382.2 401
0007 14.7 6793.9 1
0008 1.7 57937.4 6000
0009 1.1 8787.3 298
0010 20.1 4970.9 1
0011 3.5 28304.6 1919
0012 2.3 42936.9 1919
0013 *** not run ***
==========================================================================================
2018-11-03T01:12:30.046Z Generating 100000 events in batch mode
==========================================================================================
Exception in thread "main" Run started 2018-11-03T01:11:15.659Z and ran for
PT74.392S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
java.lang.RuntimeException: java.lang.IllegalStateException: Configuration
error: side input is null
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
Configurations:
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:BOUNDED_SIDE_INPUT_JOIN; exporCaused by:
java.lang.IllegalStateException: Configuration error: side input is null
tSummaryToBigQuery:true
at
org.apache.beam.repackaged.beam_sdks_java_nexmark.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
Performance:
at
org.apache.beam.sdk.nexmark.queries.BoundedSideInputJoin.applyTyped(BoundedSideInputJoin.java:50)
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
at
org.apache.beam.sdk.nexmark.queries.BoundedSideInputJoin.applyPrim(BoundedSideInputJoin.java:81)
0000 7.5 13351.1 100000
at
org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:267)
0001 3.8 26267.4 92000
at
org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:45)
0002 1.6 61881.2 351
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
0003 3.0 32916.4 460
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
0004 1.7 5743.8 40
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
0005 5.5 18079.9 12
at
org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1144)
0006 1.2 8382.2 401
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
0007 14.7 6793.9 1
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
0008 1.7 57937.4 6000
0009 1.1 8787.3 298
0010 20.1 4970.9 1
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
0011 3.5 28304.6 1919
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
0012 2.3 42936.9 1919
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
0013 *** not run ***
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
==========================================================================================
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 10,5,main])
completed. Took 1 mins 15.853 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 7s
65 actionable tasks: 61 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/zmsu6liqejilo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
