See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/1/display/redirect>
------------------------------------------
[...truncated 223.85 KB...]
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00006-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
]}
Jun 19, 2018 2:13:53 PM
org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector
verifyUnmodifiedThrowingCheckedExceptions
WARNING: Coder of type class org.apache.beam.sdk.coders.KvCoder has a
#structuralValue method which does not return true when the encoding of the
elements is equal. Element KV{null, [2015-07-15T00:00:09.999Z
shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00004-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00022-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00008-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00013-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00019-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00016-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00007-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00003-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00006-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
]}
2018-06-19T14:13:53.047Z Waiting for main pipeline to 'finish'
2018-06-19T14:13:53.047Z DONE Query10
==========================================================================================
Run started 2018-06-19T14:13:13.993Z and ran for PT39.054S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.0 25195.3 100000
0001 2.7 36724.2 92000
0002 0.9 107642.6 351
0003 2.1 47326.1 455
0004 1.3 7968.1 40
0005 3.8 26511.1 12
0006 0.7 14409.2 401
0007 9.1 10974.5 1
0008 1.1 90744.1 6000
0009 0.6 16366.6 298
0010 9.7 10288.1 1
0011 *** not run ***
0012 *** not run ***
==========================================================================================
2018-06-19T14:13:53.048Z Running query:11; exportSummaryToBigQuery:true
2018-06-19T14:13:53.049Z Generating 100000 events in batch mode
2018-06-19T14:13:55.371Z Waiting for main pipeline to 'finish'
2018-06-19T14:13:55.371Z DONE Query11
==========================================================================================
Run started 2018-06-19T14:13:13.993Z and ran for PT41.378S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.0 25195.3 100000
0001 2.7 36724.2 92000
0002 0.9 107642.6 351
0003 2.1 47326.1 455
0004 1.3 7968.1 40
0005 3.8 26511.1 12
0006 0.7 14409.2 401
0007 9.1 10974.5 1
0008 1.1 90744.1 6000
0009 0.6 16366.6 298
0010 9.7 10288.1 1
0011 2.2 46296.3 1919
0012 *** not run ***
==========================================================================================
2018-06-19T14:13:55.372Z Running query:12; exportSummaryToBigQuery:true
2018-06-19T14:13:55.374Z Generating 100000 events in batch mode
2018-06-19T14:13:56.726Z Waiting for main pipeline to 'finish'
2018-06-19T14:13:56.726Z DONE Query12
==========================================================================================
Run started 2018-06-19T14:13:13.993Z and ran for PT42.733S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.0 25195.3 100000
0001 2.7 36724.2 92000
0002 0.9 107642.6 351
0003 2.1 47326.1 455
0004 1.3 7968.1 40
0005 3.8 26511.1 12
0006 0.7 14409.2 401
0007 9.1 10974.5 1
0008 1.1 90744.1 6000
0009 0.6 16366.6 298
0010 9.7 10288.1 1
0011 2.2 46296.3 1919
0012 1.2 81234.8 1919
==========================================================================================
Exception in thread "main"
==========================================================================================
Run started 2018-06-19T14:13:13.993Z and ran for PT43.038S
Default configuration:
java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location
to store temp files.
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
at
com.google.common.base.Preconditions.checkArgument(Preconditions.java:122)
at
org.apache.beam.sdk.io.gcp.bigquery.BatchLoads.validate(BatchLoads.java:194)
Configurations:
at
org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
Conf Description
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
0000 query:0; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0001 query:1; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0002 query:2; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
0003 query:3; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
0005 query:5; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
0007 query:7; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
0008 query:8; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:182)
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:102)
0010 query:10; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.main(Main.java:395)
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.0 25195.3 100000
0001 2.7 36724.2 92000
0002 0.9 107642.6 351
0003 2.1 47326.1 455
0004 1.3 7968.1 40
0005 3.8 26511.1 12
0006 0.7 14409.2 401
0007 9.1 10974.5 1
0008 1.1 90744.1 6000
0009 0.6 16366.6 298
0010 9.7 10288.1 1
0011 2.2 46296.3 1919
0012 1.2 81234.8 1919
==========================================================================================
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 11,5,main])
completed. Took 44.63 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 5s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/bbbidmq2try7y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
