Jialin Qiao created IOTDB-3376:
----------------------------------

             Summary: Can't start ConfigNode consensus group
                 Key: IOTDB-3376
                 URL: https://issues.apache.org/jira/browse/IOTDB-3376
             Project: Apache IoTDB
          Issue Type: Bug
    Affects Versions: 0.14.0-SNAPSHOT
            Reporter: Jialin Qiao
         Attachments: iotdb-confignode1.properties, 
iotdb-confignode2.properties, iotdb-confignode3.properties, 
iotdb-engine1.properties, iotdb-engine2.properties, iotdb-engine3.properties

Start 3 confignode 3 datanode, in the second confignode(not the seednode), Meet:

 
{code:java}
2022-06-02 11:29:22,507 [main] ERROR 
o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-0 Exception class 
org.apache.thrift.TException, message Error in calling method 
recv_applyConfigNode 
2022-06-02 11:29:22,507 [main] ERROR 
o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-1 Exception class 
org.apache.thrift.TException, message Error in calling method receiveBase 
2022-06-02 11:29:22,507 [main] ERROR 
o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-2 Exception class 
org.apache.thrift.transport.TTransportException, message 
java.net.SocketTimeoutException: Read timed out 
2022-06-02 11:29:22,508 [main] ERROR 
o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-3 Exception class 
java.net.SocketTimeoutException, message Read timed out 
2022-06-02 11:29:22,508 [main] ERROR 
o.a.i.c.c.s.SyncThriftClientWithErrorHandler:80 - root cause message Read timed 
out, LocalizedMessage Read timed out, 
java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
        at 
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:176)
        at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
        at 
org.apache.iotdb.rpc.TElasticFramedTransport.readFrame(TElasticFramedTransport.java:112)
        at 
org.apache.iotdb.rpc.TElasticFramedTransport.read(TElasticFramedTransport.java:107)
        at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
        at 
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:463)
        at 
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:361)
        at 
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:244)
        at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$receiveBase$83(<generated>)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
        at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.receiveBase(<generated>)
        at 
org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.recv_applyConfigNode(ConfigIService.java:662)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$recv_applyConfigNode$74(<generated>)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
        at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.recv_applyConfigNode(<generated>)
        at 
org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.applyConfigNode(ConfigIService.java:649)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$applyConfigNode$12(<generated>)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
        at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.applyConfigNode(<generated>)
        at 
org.apache.iotdb.confignode.client.SyncConfigNodeClientPool.applyConfigNode(SyncConfigNodeClientPool.java:75)
        at 
org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:116)
        at 
org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
        at 
org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
        at 
org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
        at 
org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
        at 
org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
        at 
org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
        at 
org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
2022-06-02 11:29:22,509 [main] WARN  o.a.i.c.c.SyncConfigNodeClientPool:77 - 
Apply ConfigNode failed, retrying... 
org.apache.thrift.TException: Error in calling method applyConfigNode
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.applyConfigNode(<generated>)
        at 
org.apache.iotdb.confignode.client.SyncConfigNodeClientPool.applyConfigNode(SyncConfigNodeClientPool.java:75)
        at 
org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:116)
        at 
org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
        at 
org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
        at 
org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
        at 
org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
        at 
org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
        at 
org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
        at 
org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
Caused by: org.apache.thrift.TException: Error in calling method 
recv_applyConfigNode
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.recv_applyConfigNode(<generated>)
        at 
org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.applyConfigNode(ConfigIService.java:649)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$applyConfigNode$12(<generated>)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
        at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
        ... 12 common frames omitted
Caused by: org.apache.thrift.TException: Error in calling method receiveBase
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.receiveBase(<generated>)
        at 
org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.recv_applyConfigNode(ConfigIService.java:662)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$recv_applyConfigNode$74(<generated>)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
        at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
        ... 18 common frames omitted
Caused by: org.apache.thrift.transport.TTransportException: 
java.net.SocketTimeoutException: Read timed out
        at 
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:178)
        at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
        at 
org.apache.iotdb.rpc.TElasticFramedTransport.readFrame(TElasticFramedTransport.java:112)
        at 
org.apache.iotdb.rpc.TElasticFramedTransport.read(TElasticFramedTransport.java:107)
        at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
        at 
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:463)
        at 
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:361)
        at 
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:244)
        at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$receiveBase$83(<generated>)
        at 
org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
        at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
        at 
org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
        ... 24 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
        at 
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:176)
        ... 36 common frames omitted
2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.c.SyncConfigNodeClientPool:81 - 
Apply ConfigNode failed 
2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.m.ConsensusManager:122 - All retry 
failed. 
2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.s.ConfigNode:60 - Can't start 
ConfigNode consensus group! 
java.io.IOException: Apply ConfigNode failed:
        at 
org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:123)
        at 
org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
        at 
org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
        at 
org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
        at 
org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
        at 
org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
        at 
org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
        at 
org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
2022-06-02 11:29:22,612 [main] INFO  o.a.i.c.s.ConfigNode:124 - Deactivating 
IoTDB-ConfigNode... 
2022-06-02 11:29:22,612 [main] INFO  o.a.i.c.s.RegisterManager:67 - deregister 
all service. 
Exception in thread "main" java.lang.ExceptionInInitializerError
        at 
org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
        at 
org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
        at 
org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
        at 
org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
Caused by: java.lang.NullPointerException
        at 
org.apache.iotdb.confignode.service.ConfigNode.deactivate(ConfigNode.java:127)
        at 
org.apache.iotdb.confignode.service.ConfigNode.stop(ConfigNode.java:132)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:62)
        at 
org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
        at 
org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
        ... 4 more {code}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to