See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/4/display/redirect>
------------------------------------------
[...truncated 230.43 KB...]
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
Jun 19, 2018 6:17:42 PM
org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector
verifyUnmodifiedThrowingCheckedExceptions
WARNING: Coder of type class org.apache.beam.sdk.coders.KvCoder has a
#structuralValue method which does not return true when the encoding of the
elements is equal. Element KV{null, [2015-07-15T00:00:09.999Z
shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00007-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00003-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00004-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00022-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00013-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00016-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00019-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00008-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00006-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
2018-06-19T18:17:42.979Z Waiting for main pipeline to 'finish'
2018-06-19T18:17:42.979Z DONE Query10
==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT38.777S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 *** not run ***
0012 *** not run ***
==========================================================================================
2018-06-19T18:17:42.981Z Running query:11; exportSummaryToBigQuery:true
2018-06-19T18:17:42.982Z Generating 100000 events in batch mode
2018-06-19T18:17:45.305Z Waiting for main pipeline to 'finish'
2018-06-19T18:17:45.305Z DONE Query11
==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT41.103S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 2.1 47415.8 1919
0012 *** not run ***
==========================================================================================
2018-06-19T18:17:45.307Z Running query:12; exportSummaryToBigQuery:true
2018-06-19T18:17:45.308Z Generating 100000 events in batch mode
2018-06-19T18:17:46.746Z Waiting for main pipeline to 'finish'
2018-06-19T18:17:46.746Z DONE Query12
==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT42.543S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 2.1 47415.8 1919
0012 1.3 76982.3 1919
==========================================================================================
Exception in thread "main"
==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT42.858S
java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location
to store temp files.
at
com.google.common.base.Preconditions.checkArgument(Preconditions.java:122)
Default configuration:
at
org.apache.beam.sdk.io.gcp.bigquery.BatchLoads.validate(BatchLoads.java:194)
at
org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
Configurations:
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
Conf Description
at
org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
0000 query:0; exportSummaryToBigQuery:true
at
org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
0001 query:1; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
0002 query:2; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
0003 query:3; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
0005 query:5; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:182)
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:102)
0007 query:7; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.main(Main.java:395)
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 2.1 47415.8 1919
0012 1.3 76982.3 1919
==========================================================================================
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 2,5,main])
completed. Took 44.523 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 31s
59 actionable tasks: 53 executed, 6 from cache
Publishing build scan...
https://gradle.com/s/nqawdi2e65upe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user [email protected]
