See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Spark/7562/display/redirect?page=changes>
Changes:
[cgray] [BEAM-7169] Fix singleton assertion in PAssert javadoc.
[noreply] Revert "[BEAM-10913] - Forcing update of YAML file by running kubectl
[kawaigin] [BEAM-12997] Upgraded labextension to V3
------------------------------------------
[...truncated 7.40 MB...]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
ManagedSelector@5e2a7638{STOPPED} id=1 keys=-1 selected=-1 updates=0
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
ManagedSelector@77d76c3a{STARTED} id=0 keys=0 selected=0 updates=0
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Queued
change lazy=false
org.sparkproject.jetty.io.ManagedSelector$CloseConnections@3cb5e941 on
ManagedSelector@77d76c3a{STOPPING} id=0 keys=0 selected=0 updates=0
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Wakeup on
submit ManagedSelector@77d76c3a{STOPPING} id=0 keys=0 selected=0 updates=1
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Selector
sun.nio.ch.EPollSelectorImpl@1779c960 woken with none selected
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Selector
sun.nio.ch.EPollSelectorImpl@1779c960 woken up from select, 0/0/0 selected
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Selector
sun.nio.ch.EPollSelectorImpl@1779c960 processing 0 keys, 1 updates
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: updateable 1
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: update
org.sparkproject.jetty.io.ManagedSelector$CloseConnections@3cb5e941
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Closing 0
connections on ManagedSelector@77d76c3a{STOPPING} id=0 keys=0 selected=0
updates=0
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: updates 0
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Selector
sun.nio.ch.EPollSelectorImpl@1779c960 waiting with 0 keys
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Queued
change lazy=false
org.sparkproject.jetty.io.ManagedSelector$StopSelector@708e8390 on
ManagedSelector@77d76c3a{STOPPING} id=0 keys=0 selected=0 updates=0
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Wakeup on
submit ManagedSelector@77d76c3a{STOPPING} id=0 keys=0 selected=0 updates=1
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Selector
sun.nio.ch.EPollSelectorImpl@1779c960 woken with none selected
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Selector
sun.nio.ch.EPollSelectorImpl@1779c960 woken up from select, 0/0/0 selected
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: Selector
sun.nio.ch.EPollSelectorImpl@1779c960 processing 0 keys, 1 updates
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: updateable 1
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: update
org.sparkproject.jetty.io.ManagedSelector$StopSelector@708e8390
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.io.ManagedSelector: updates 0
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran org.sparkproject.jetty.io.ManagedSelector$$Lambda$525/2119361519@5b05fb59
in
QueuedThreadPool[SparkUI]@13735656{STARTED,8<=10<=200,i=9,r=-1,q=0}[ReservedThreadExecutor@7f7bbe26{s=0/16,p=0}]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
EatWhatYouKill@7f671898/SelectorProducer@76ae15fe/IDLE/p=false/QueuedThreadPool[SparkUI]@13735656{STARTED,8<=10<=200,i=9,r=-1,q=0}[ReservedThreadExecutor@7f7bbe26{s=0/16,p=0}][pc=0,pic=0,pec=0,epc=0]@2021-10-13T00:41:43.83Z
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
EatWhatYouKill@7f671898/SelectorProducer@76ae15fe/IDLE/p=false/QueuedThreadPool[SparkUI]@13735656{STARTED,8<=10<=200,i=10,r=-1,q=0}[ReservedThreadExecutor@7f7bbe26{s=0/16,p=0}][pc=0,pic=0,pec=0,epc=0]@2021-10-13T00:41:43.83Z
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
ManagedSelector@77d76c3a{STOPPED} id=0 keys=-1 selected=-1 updates=0
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
SelectorManager@Spark@19521258{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
HttpConnectionFactory@4edbb2f6[HTTP/1.1]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
HttpConnectionFactory@4edbb2f6[HTTP/1.1]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
ScheduledExecutorScheduler@2684ef8e{STARTED}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
ScheduledExecutorScheduler@2684ef8e{STOPPED}
21/10/13 00:41:43 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped
Spark@19521258{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
Spark@19521258{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.server.handler.AbstractHandler:
stopping Server@50396e03{STOPPING}[9.4.40.v20210413]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
ContextHandlerCollection@3dbc885f{STARTED}
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.server.handler.AbstractHandler:
stopping ContextHandlerCollection@3dbc885f{STOPPING}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
ContextHandlerCollection@3dbc885f{STOPPED}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
ErrorHandler@34f4a971{STARTED}
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.server.handler.AbstractHandler:
stopping ErrorHandler@34f4a971{STOPPING}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
ErrorHandler@34f4a971{STOPPED}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
QueuedThreadPool[SparkUI]@13735656{STARTED,8<=10<=200,i=10,r=-1,q=0}[ReservedThreadExecutor@7f7bbe26{s=0/16,p=0}]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Stopping
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=10<=200,i=10,r=-1,q=0}[ReservedThreadExecutor@7f7bbe26{s=0/16,p=0}]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: stopping
ReservedThreadExecutor@7f7bbe26{s=0/16,p=0}
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
ReservedThreadExecutor@7f7bbe26{s=-1/16,p=0}
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Waiting for Thread[SparkUI-1030,5,main] for 14999
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1030,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Waiting for Thread[SparkUI-1032,5,main] for 14999
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1029,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1033,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1027,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1031,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1032,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1028,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
run
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1026,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Waiting for Thread[SparkUI-1027,5,] for 14999
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1024,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Waiting for Thread[SparkUI-1024,5,main] for 14999
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
ran
org.sparkproject.jetty.util.thread.QueuedThreadPool$$Lambda$508/1047957911@51db570a
in QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Waiting for Thread[SparkUI-1025,5,main] for 14999
21/10/13 00:41:43 DEBUG org.sparkproject.jetty.util.thread.QueuedThreadPool:
Thread[SparkUI-1025,5,main] exited for
QueuedThreadPool[SparkUI]@13735656{STOPPING,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
QueuedThreadPool[SparkUI]@13735656{STOPPED,8<=0<=200,i=10,r=-1,q=0}[NO_TRY]
21/10/13 00:41:43 DEBUG
org.sparkproject.jetty.util.component.AbstractLifeCycle: STOPPED
Server@50396e03{STOPPED}[9.4.40.v20210413]
2021-10-13T00:41:43.857Z Waiting for main pipeline to 'finish'
2021-10-13T00:41:43.857Z DONE SessionSideInputJoin
==========================================================================================
Run started 2021-10-13T00:41:17.215Z and ran for PT26.642S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000;
streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
streamTimeout:60
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; streamTimeout:60
0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 1.3 77220.1 100000
0001 0.4 226757.4 92000
0002 0.3 337837.8 351
0003 2.2 45766.6 580
0004 1.2 8510.6 40
0005 1.5 67842.6 12
0006 0.7 14662.8 103
0007 1.6 61842.9 1
0008 1.5 65573.8 6000
0009 0.6 17482.5 298
0010 0.7 136239.8 1
0011 1.4 71377.6 1919
0012 0.8 120919.0 1919
0013 0.9 113507.4 100000
0014 0.3 312500.0 92000
0015 0.8 120336.9 92000
==========================================================================================
==========================================================================================
Run started 2021-10-13T00:41:17.215Z and ran for PT37.268S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000;
streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
streamTimeout:60
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; streamTimeout:60
0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
streamTimeout:60
Performance:
Exception in thread "main" Conf Runtime(sec) (Baseline) Events(/sec)
(Baseline) Results (Baseline)
0000 1.3 77220.1 100000
0001 0.4 226757.4 92000
0002 0.3 337837.8 351
0003 2.2 45766.6 580
0004 1.2 8510.6 40
0005 1.5 67842.6 12
0006 0.7 14662.8 103
0007 1.6 61842.9 1
0008 1.5 65573.8 6000
0009 0.6 17482.5 298
0010 0.7 136239.8 1
0011 1.4 71377.6 1919
0012 0.8 120919.0 1919
0013 0.9 113507.4 100000
0014 0.3 312500.0 92000
0015 0.8 120336.9 92000
==========================================================================================
com.google.cloud.bigquery.BigQueryException: 502 Bad Gateway
POST
https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/nexmark/tables/nexmark_8_SparkRunner_batch/insertAll?prettyPrint=false
<!DOCTYPE html>
<html lang=en>
<meta charset=utf-8>
<meta name=viewport content="initial-scale=1, minimum-scale=1,
width=device-width">
<title>Error 502 (Server Error)!!1</title>
<style>
*{margin:0;padding:0}html,code{font:15px/22px
arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7%
auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* >
body{background:url(//www.google.com/images/errors/robot.png) 100% 5px
no-repeat;padding-right:205px}p{margin:11px 0
22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media
screen and
(max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png)
no-repeat;margin-left:-5px}@media only screen and
(min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat 0% 0%/100%
100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
0}}@media only screen and
(-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat;-webkit-background-size:100%
100%}}#logo{display:inline-block;height:54px;width:150px}
</style>
<a href=//www.google.com/><span id=logo aria-label=Google></span></a>
<p><b>502.</b> <ins>That’s an error.</ins>
<p>The server encountered a temporary error and could not complete your
request.<p>Please try again in 30 seconds. <ins>That’s all we know.</ins>
at
com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:115)
at
com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:494)
at
com.google.cloud.bigquery.BigQueryImpl.insertAll(BigQueryImpl.java:1065)
at
org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertAll(BigQueryClient.java:123)
at
org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertRow(BigQueryClient.java:98)
at
org.apache.beam.sdk.testutils.publishing.BigQueryClient.insertRow(BigQueryClient.java:89)
at
org.apache.beam.sdk.testutils.publishing.BigQueryResultsPublisher.publish(BigQueryResultsPublisher.java:47)
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:203)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:164)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException:
502 Bad Gateway
POST
https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/nexmark/tables/nexmark_8_SparkRunner_batch/insertAll?prettyPrint=false
<!DOCTYPE html>
<html lang=en>
<meta charset=utf-8>
<meta name=viewport content="initial-scale=1, minimum-scale=1,
width=device-width">
<title>Error 502 (Server Error)!!1</title>
<style>
*{margin:0;padding:0}html,code{font:15px/22px
arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7%
auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* >
body{background:url(//www.google.com/images/errors/robot.png) 100% 5px
no-repeat;padding-right:205px}p{margin:11px 0
22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media
screen and
(max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png)
no-repeat;margin-left:-5px}@media only screen and
(min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat 0% 0%/100%
100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
0}}@media only screen and
(-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png)
no-repeat;-webkit-background-size:100%
100%}}#logo{display:inline-block;height:54px;width:150px}
</style>
<a href=//www.google.com/><span id=logo aria-label=Google></span></a>
<p><b>502.</b> <ins>That’s an error.</ins>
<p>The server encountered a temporary error and could not complete your
request.<p>Please try again in 30 seconds. <ins>That’s all we know.</ins>
at
com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:428)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1111)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:514)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at
com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.insertAll(HttpBigQueryRpc.java:492)
... 8 more
21/10/13 00:41:54 DEBUG org.apache.hadoop.util.ShutdownHookManager: Completed
shutdown in 0.008 seconds; Timeouts: 0
21/10/13 00:41:54 DEBUG org.apache.hadoop.util.ShutdownHookManager:
ShutdownHookManger completed shutdown.
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 43s
111 actionable tasks: 6 executed, 1 from cache, 104 up-to-date
Publishing build scan...
https://gradle.com/s/jhokg5lhkww56
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
