See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/2/display/redirect>
------------------------------------------
[...truncated 222.09 KB...]
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
Jun 19, 2018 5:15:07 PM
org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector
verifyUnmodifiedThrowingCheckedExceptions
WARNING: Coder of type class org.apache.beam.sdk.coders.KvCoder has a
#structuralValue method which does not return true when the encoding of the
elements is equal. Element KV{null, [2015-07-15T00:00:09.999Z
shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00003-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00004-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00013-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00022-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00019-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00008-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00016-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00006-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00007-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
2018-06-19T17:15:07.227Z Waiting for main pipeline to 'finish'
2018-06-19T17:15:07.227Z DONE Query10
==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT39.294S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 *** not run ***
0012 *** not run ***
==========================================================================================
2018-06-19T17:15:07.228Z Running query:11; exportSummaryToBigQuery:true
2018-06-19T17:15:07.230Z Generating 100000 events in batch mode
2018-06-19T17:15:09.615Z Waiting for main pipeline to 'finish'
2018-06-19T17:15:09.615Z DONE Query11
==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT41.682S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 2.2 44984.3 1919
0012 *** not run ***
==========================================================================================
2018-06-19T17:15:09.617Z Running query:12; exportSummaryToBigQuery:true
2018-06-19T17:15:09.618Z Generating 100000 events in batch mode
2018-06-19T17:15:11.029Z Waiting for main pipeline to 'finish'
2018-06-19T17:15:11.029Z DONE Query12
==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT43.097S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 2.2 44984.3 1919
0012 1.3 77459.3 1919
==========================================================================================
Exception in thread "main"
==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT43.392S
Default configuration:
java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location
to store temp files.
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
at
com.google.common.base.Preconditions.checkArgument(Preconditions.java:122)
Configurations:
Conf Description
at
org.apache.beam.sdk.io.gcp.bigquery.BatchLoads.validate(BatchLoads.java:194)
0000 query:0; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
0001 query:1; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
0002 query:2; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0003 query:3; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
0005 query:5; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
0007 query:7; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
0008 query:8; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:182)
0010 query:10; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:102)
0011 query:11; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.main(Main.java:395)
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 2.2 44984.3 1919
0012 1.3 77459.3 1919
==========================================================================================
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 14,5,main])
completed. Took 45.02 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 4s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/z2mtgbud4ncpi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
