Hi, Is the warning that you pasted actually getting thrown as an exception? Or just being logged to the console?
If it's possible, you might try updating to the most recent release candidate client from Kudu 1.7. It contains a number of bug fixes for the Java client and also improves error reporting a lot so could make troubleshooting much easier. You can find the Kudu 1.7.0rc2 artifacts that we're currently voting on here: https://repository.apache.org/content/repositories/orgapachekudu-1019/ If you're able to test it out and report back that would also be nice to report on the dev@ mailing list VOTE thread. -Todd On Sun, Mar 18, 2018 at 11:55 PM, Dun Rainer <[email protected]> wrote: > Hi: > > I use kudu api in spark application ,after a few hours of running. An > exception occurs when close kudu client. my kudu version is 1.3.1 and spark > is 2.2.1. > > init kudu code : > val client= new KuduClient.KuduClientBuilder(env.masterURL) > .defaultSocketReadTimeoutMs(DEFAULT_SLEEP) > .defaultOperationTimeoutMs(DEFAULT_SLEEP) > .build > > var session = client.newSession() > session.setFlushMode(SessionConfiguration.FlushMode.AUTO_FLUSH_ > BACKGROUND) > session.setMutationBufferSpace(_MUTU_BUFFER_SIZE) > session.setFlushInterval(_FLUSH_INTERVAL) > session.setIgnoreAllDuplicateRows(ignoreDuplicateRows) > > Close kudu client code: > > if (client != null) { > client.shutdown() > } > > > > Exception message : > WARN client.ConnectToCluster: Error receiving a response from: > bi-hd24:7051 > > org.apache.kudu.client.RecoverableException: [Peer master-bi-hd24:7051] > Connection closed > at org.apache.kudu.client.TabletClient.cleanup(TabletClient.java:655) > at > org.apache.kudu.client.TabletClient.channelClosed(TabletClient.java:615) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88) > at > org.apache.kudu.client.TabletClient.handleUpstream(TabletClient.java:601) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) > at > org.apache.kudu.client.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler.channelClosed(ReadTimeoutHandler.java:176) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) > at > org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:60) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) > at > org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:493) > at > org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameDecoder.channelClosed(FrameDecoder.java:371) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireChannelClosed(Channels.java:468) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels$6.run(Channels.java:457) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.ChannelRunnableWrapper.run(ChannelRunnableWrapper.java:40) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) > at > org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > at > org.apache.kudu.client.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > at > org.apache.kudu.client.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > > > Thanks > > Rainerdun > > > > > -- Todd Lipcon Software Engineer, Cloudera
