See
<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4741/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-8337] Hard-code Flink versions.
[kcweaver] fix indentation
[kcweaver] Update release guide
[lostluck] [BEAM-9080] Support KVs in the Go SDK's Partition
[github] Rephrasing lull logging to avoid alarming users (#10446)
------------------------------------------
[...truncated 187.91 KB...]
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 22.4 446149.7 10000000
0001 16.9 592662.8 9200000
0002 11.7 853096.7 83527
0003 50.2 199008.9 59419
0004 55.4 18062.6 140
0005 *** not run ***
0006 53.2 18813.3 16113
0007 *** not run ***
0008 54.0 185099.5 92833
0009 35.1 28485.2 32548
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 35.5 281793.3 9200000
0014 *** not run ***
==========================================================================================
2020-01-10T21:48:09.076Z RUNNING Query7
2020-01-10T21:48:09.366Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:09.410Z RUNNING BoundedSideInputJoin
2020-01-10T21:48:09.428Z no activity
2020-01-10T21:48:09.627Z 4 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:09.690Z new perf
{"snapshots":null,"runtimeSec":193.469,"numEvents":10000000,"eventsPerSec":51687.86730690705,"eventBytesPerSec":6634473.207593982,"numResults":1659126,"resultsPerSec":8575.668453343947,"resultBytesPerSec":137210.52985232777,"startupDelaySec":-160.726,"processingDelaySec":20.7,"shutdownDelaySec":15.38,"timeDilation":5.168528291354171,"errors":null,"jobId":null}
2020-01-10T21:48:09.833Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:09.898Z no activity
2020-01-10T21:48:10.249Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:10.324Z no activity
2020-01-10T21:48:24.053Z RUNNING Query5
2020-01-10T21:48:24.077Z RUNNING Query10
2020-01-10T21:48:24.460Z RUNNING Query12
2020-01-10T21:48:24.727Z RUNNING Query11
2020-01-10T21:48:24.730Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:24.780Z streaming query appears to have finished waiting for
completion.
2020-01-10T21:48:24.780Z no activity
2020-01-10T21:48:24.869Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:24.933Z streaming query appears to have finished waiting for
completion.
2020-01-10T21:48:24.933Z no activity
2020-01-10T21:48:24.970Z RUNNING Query7
2020-01-10T21:48:25.187Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:25.248Z streaming query appears to have finished waiting for
completion.
2020-01-10T21:48:25.248Z no activity
2020-01-10T21:48:25.376Z RUNNING BoundedSideInputJoin
2020-01-10T21:48:25.405Z 5 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:25.466Z new perf
{"snapshots":null,"runtimeSec":202.823,"numEvents":10000000,"eventsPerSec":49304.07300947131,"eventBytesPerSec":6328497.739408252,"numResults":1839657,"resultsPerSec":9070.258304038496,"resultBytesPerSec":145124.13286461594,"startupDelaySec":-160.726,"processingDelaySec":20.7,"shutdownDelaySec":21.77,"timeDilation":4.930160780582084,"errors":null,"jobId":null}
2020-01-10T21:48:25.615Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:25.679Z streaming query appears to have finished waiting for
completion.
2020-01-10T21:48:25.679Z no activity
2020-01-10T21:48:26.167Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:26.244Z streaming query appears to have finished waiting for
completion.
2020-01-10T21:48:26.244Z no activity
2020-01-10T21:48:39.814Z RUNNING Query10 (waiting for shutdown)
2020-01-10T21:48:39.962Z RUNNING Query5 (waiting for shutdown)
2020-01-10T21:48:40.282Z DONE Query12 (waiting for shutdown)
2020-01-10T21:48:40.313Z 1 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2020-01-10T21:43:07.448Z and ran for PT332.866S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 22.4 446149.7 10000000
0001 16.9 592662.8 9200000
0002 11.7 853096.7 83527
0003 50.2 199008.9 59419
0004 55.4 18062.6 140
0005 *** not run ***
0006 53.2 18813.3 16113
0007 *** not run ***
0008 54.0 185099.5 92833
0009 35.1 28485.2 32548
0010 *** not run ***
0011 *** not run ***
0012 86.8 115239.2 579904
0013 35.5 281793.3 9200000
0014 *** not run ***
==========================================================================================
2020-01-10T21:48:40.431Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:40.431Z no activity
2020-01-10T21:48:40.497Z RUNNING Query11
2020-01-10T21:48:40.590Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:40.590Z no activity
2020-01-10T21:48:40.726Z RUNNING Query7 (waiting for shutdown)
2020-01-10T21:48:41.220Z 5 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:41.303Z no activity
2020-01-10T21:48:41.305Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2020-01-10T21:48:41.471Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:41.472Z no activity
2020-01-10T21:48:42.099Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:42.099Z no activity
2020-01-10T21:48:55.465Z DONE Query10 (waiting for shutdown)
2020-01-10T21:48:55.499Z 1 samples not enough to calculate steady-state event
rate
==========================================================================================
Run started 2020-01-10T21:43:07.448Z and ran for PT348.051S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true;
numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true;
numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true;
numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true;
numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true;
numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true;
numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 22.4 446149.7 10000000
0001 16.9 592662.8 9200000
0002 11.7 853096.7 83527
0003 50.2 199008.9 59419
0004 55.4 18062.6 140
0005 *** not run ***
0006 53.2 18813.3 16113
0007 *** not run ***
0008 54.0 185099.5 92833
0009 35.1 28485.2 32548
0010 99.7 100321.0 140
0011 *** not run ***
0012 86.8 115239.2 579904
0013 35.5 281793.3 9200000
0014 *** not run ***
==========================================================================================
2020-01-10T21:48:55.625Z RUNNING Query5 (waiting for shutdown)
2020-01-10T21:48:56.310Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:56.310Z no activity
2020-01-10T21:48:56.348Z RUNNING Query11
2020-01-10T21:48:56.509Z RUNNING Query7 (waiting for shutdown)
2020-01-10T21:48:57.017Z 5 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:57.091Z no activity
2020-01-10T21:48:57.141Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2020-01-10T21:48:57.226Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:57.226Z no activity
2020-01-10T21:48:57.995Z 1 samples not enough to calculate steady-state event
rate
2020-01-10T21:48:57.995Z no activity
FATAL: command execution failed
java.io.IOException: Backing channel 'JNLP4-connect connection from
30.83.202.35.bc.googleusercontent.com/35.202.83.30:49434' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283)
at com.sun.proxy.$Proxy141.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1150)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1142)
at hudson.Launcher$ProcStarter.join(Launcher.java:470)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
at hudson.model.Build$BuildExecution.build(Build.java:206)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
at hudson.model.Run.execute(Run.java:1815)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: java.nio.channels.ClosedChannelException
at
org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onReadClosed(ChannelApplicationLayer.java:209)
at
org.jenkinsci.remoting.protocol.ApplicationLayer.onRecvClosed(ApplicationLayer.java:222)
at
org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:816)
at
org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287)
at
org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:181)
at
org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.switchToNoSecure(SSLEngineFilterLayer.java:283)
at
org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processWrite(SSLEngineFilterLayer.java:503)
at
org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processQueuedWrites(SSLEngineFilterLayer.java:248)
at
org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doSend(SSLEngineFilterLayer.java:200)
at
org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doCloseSend(SSLEngineFilterLayer.java:213)
at
org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.doCloseSend(ProtocolStack.java:784)
at
org.jenkinsci.remoting.protocol.ApplicationLayer.doCloseWrite(ApplicationLayer.java:173)
at
org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer$ByteBufferCommandTransport.closeWrite(ChannelApplicationLayer.java:314)
at hudson.remoting.Channel.close(Channel.java:1452)
at hudson.remoting.Channel.close(Channel.java:1405)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:847)
at hudson.slaves.SlaveComputer.kill(SlaveComputer.java:814)
at hudson.model.AbstractCIBase.killComputer(AbstractCIBase.java:89)
at jenkins.model.Jenkins.access$2100(Jenkins.java:312)
at jenkins.model.Jenkins$19.run(Jenkins.java:3464)
at hudson.model.Queue._withLock(Queue.java:1379)
at hudson.model.Queue.withLock(Queue.java:1256)
at jenkins.model.Jenkins._cleanUpDisconnectComputers(Jenkins.java:3458)
at jenkins.model.Jenkins.cleanUp(Jenkins.java:3336)
at hudson.WebAppMain.contextDestroyed(WebAppMain.java:379)
at
org.apache.catalina.core.StandardContext.listenerStop(StandardContext.java:4732)
at
org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5396)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at
org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1400)
at
org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1389)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at
org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:976)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at
org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1400)
at
org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1389)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
at
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
at
org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:976)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at
org.apache.catalina.core.StandardService.stopInternal(StandardService.java:473)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at
org.apache.catalina.core.StandardServer.stopInternal(StandardServer.java:994)
at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
at org.apache.catalina.startup.Catalina.stop(Catalina.java:706)
at org.apache.catalina.startup.Catalina.start(Catalina.java:668)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:344)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:475)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-2 is offline; cannot locate JDK 1.8 (latest)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
