???????????? rebuild in the new DC always failed
Jeff?? it's already start sending files??and if i only rebuild one node??it's ok??more than one node??it will fail. thanks -- -- ??: Jeff Jirsa <jji...@gmail.com> : 2017??12??17?? 09:32 ??: user <user@cassandra.apache.org> : ???? rebuild in the new DC always failed That NPE in gossip is probably a missing endpointstate, which is probably fixed by the gossip patch (#13700) in 2.1.19 I??m not sure it??s related to the rebuild failing - I??m not actually sure if that??s a server failure or jmx timing out. Do you see logs on the servers indicating that it was ever invoked? Did it calculate a streaming plan? Did it start sending files? -- Jeff Jirsa On Dec 16, 2017, at 4:56 PM, Peng Xiao <2535...@qq.com> wrote: Hi Jeff, This is the only informaiton we found from system.log <2e06f...@9f7caf6b.d1c0355a.jpg> Thanks -- -- ??: "Jeff Jirsa";<jji...@gmail.com>; : 2017??12??17??(??) 8:13 ??: "user"<user@cassandra.apache.org>; : Re: rebuild in the new DC always failed What??s the rest of the stack beneath the null pointer exception? -- Jeff Jirsa > On Dec 16, 2017, at 4:11 PM, Peng Xiao <2535...@qq.com> wrote: > > Hi there, > > We need to rebuild a new DC,but the stream is always failed with the > following errors. > we are using C* 2.1.18.Could anyone please advise? > > error: null > -- StackTrace -- > java.io.EOFException > at java.io.DataInputStream.readByte(DataInputStream.java:267) > at > sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222) > at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161) > at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) > at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown > Source) > at > javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020) > at > javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298) > at com.sun.proxy.$Proxy8.rebuild(Unknown Source) > at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057) > at > org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825) > at > org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292) > at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206) > > in the source side,the error is: > > ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - > Exception in thread Thread[GossipStage:217,5,main] > java.lang.NullPointerException: null > > Thanks - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org For additional commands, e-mail: user-h...@cassandra.apache.org
Re: 回复： rebuild in the new DC always failed
That NPE in gossip is probably a missing endpointstate, which is probably fixed by the gossip patch (#13700) in 2.1.19 I’m not sure it’s related to the rebuild failing - I’m not actually sure if that’s a server failure or jmx timing out. Do you see logs on the servers indicating that it was ever invoked? Did it calculate a streaming plan? Did it start sending files? -- Jeff Jirsa > On Dec 16, 2017, at 4:56 PM, Peng Xiao <2535...@qq.com> wrote: > > Hi Jeff, > This is the only informaiton we found from system.log > <2e06f...@9f7caf6b.d1c0355a.jpg> > > Thanks > -- 原始邮件 -- > 发件人: "Jeff Jirsa";<jji...@gmail.com>; > 发送时间: 2017年12月17日(星期天) 上午8:13 > 收件人: "user"<user@cassandra.apache.org>; > 主题: Re: rebuild in the new DC always failed > > What’s the rest of the stack beneath the null pointer exception? > > -- > Jeff Jirsa > > > > On Dec 16, 2017, at 4:11 PM, Peng Xiao <2535...@qq.com> wrote: > > > > Hi there, > > > > We need to rebuild a new DC,but the stream is always failed with the > > following errors. > > we are using C* 2.1.18.Could anyone please advise? > > > > error: null > > -- StackTrace -- > > java.io.EOFException > > at java.io.DataInputStream.readByte(DataInputStream.java:267) > > at > > sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222) > > at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161) > > at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) > > at > > javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown Source) > > at > > javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020) > > at > > javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298) > > at com.sun.proxy.$Proxy8.rebuild(Unknown Source) > > at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057) > > at > > org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825) > > at > > org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292) > > at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206) > > > > in the source side,the error is: > > > > ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - > > Exception in thread Thread[GossipStage:217,5,main] > > java.lang.NullPointerException: null > > > > Thanks > > - > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > For additional commands, e-mail: user-h...@cassandra.apache.org
?????? rebuild in the new DC always failed
Hi Jeff, This is the only informaiton we found from system.log Thanks -- -- ??: "Jeff Jirsa";<jji...@gmail.com>; : 2017??12??17??(??) 8:13 ??: "user"<user@cassandra.apache.org>; : Re: rebuild in the new DC always failed What??s the rest of the stack beneath the null pointer exception? -- Jeff Jirsa > On Dec 16, 2017, at 4:11 PM, Peng Xiao <2535...@qq.com> wrote: > > Hi there, > > We need to rebuild a new DC,but the stream is always failed with the > following errors. > we are using C* 2.1.18.Could anyone please advise? > > error: null > -- StackTrace -- > java.io.EOFException > at java.io.DataInputStream.readByte(DataInputStream.java:267) > at > sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222) > at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161) > at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) > at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown > Source) > at > javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020) > at > javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298) > at com.sun.proxy.$Proxy8.rebuild(Unknown Source) > at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057) > at > org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825) > at > org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292) > at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206) > > in the source side,the error is: > > ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - > Exception in thread Thread[GossipStage:217,5,main] > java.lang.NullPointerException: null > > Thanks - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org For additional commands, e-mail: user-h...@cassandra.apache.org
Re: rebuild in the new DC always failed
What’s the rest of the stack beneath the null pointer exception? -- Jeff Jirsa > On Dec 16, 2017, at 4:11 PM, Peng Xiao <2535...@qq.com> wrote: > > Hi there, > > We need to rebuild a new DC,but the stream is always failed with the > following errors. > we are using C* 2.1.18.Could anyone please advise? > > error: null > -- StackTrace -- > java.io.EOFException > at java.io.DataInputStream.readByte(DataInputStream.java:267) > at > sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222) > at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161) > at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) > at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown > Source) > at > javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020) > at > javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298) > at com.sun.proxy.$Proxy8.rebuild(Unknown Source) > at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057) > at > org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825) > at > org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292) > at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206) > > in the source side,the error is: > > ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - > Exception in thread Thread[GossipStage:217,5,main] > java.lang.NullPointerException: null > > Thanks - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org For additional commands, e-mail: user-h...@cassandra.apache.org
rebuild in the new DC always failed
Hi there, We need to rebuild a new DC,but the stream is always failed with the following errors. we are using C* 2.1.18.Could anyone please advise? error: null -- StackTrace -- java.io.EOFException at java.io.DataInputStream.readByte(DataInputStream.java:267) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020) at javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298) at com.sun.proxy.$Proxy8.rebuild(Unknown Source) at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057) at org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825) at org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292) at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206) in the source side,the error is: ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - Exception in thread Thread[GossipStage:217,5,main] java.lang.NullPointerException: null Thanks
