Keith Wall created QPID-6102:
--------------------------------

             Summary: Client connection closure whilst HA transitioning state 
can lead to unexpected Broker shutdown
                 Key: QPID-6102
                 URL: https://issues.apache.org/jira/browse/QPID-6102
             Project: Qpid
          Issue Type: Bug
          Components: Java Broker
    Affects Versions: 0.31
            Reporter: Keith Wall


Whilst testing the transfer master operation whilst the group was underload I 
ran into the following exception causing unexpected  shutdown of the previous 
Master.

# Bring up a group of four
# Organise for a publisher/consumer on separate connections steadily consuming 
messages.
# Use transfer master to move the mastership from one node to another.
# Following exception observed on the node from which the mastership was being 
moved.


{noformat}
########################################################################
#
# Unhandled Exception com.sleepycat.je.rep.MasterReplicaTransitionException: 
(JE 5.0.97) Environment must be closed, caused by: 
com.sleepycat.je.rep.MasterReplicaTransitionException: Environment invalid 
because of previous exception: (JE 5.0.97) 
mars(4):/home/keith/trunk/qpid/qpid/java/systests/target/qpid-broker/0.32-SNAPSHOT/work4/mars/config
 com.sleepycat.je.rep.stream.MasterStatus$MasterSyncException: Master change. 
Node master id: mars(4) Group master id: earth(3) MASTER_TO_REPLICA_TRANSITION: 
This node was a master and must reinitialize internal state to become a 
replica. The application must close and reopen all Environment handles. 
Environment is invalid and must be closed. in Thread IoReceiver - 
/192.168.0.1:55912
#
# Exiting
#
########################################################################
com.sleepycat.je.rep.MasterReplicaTransitionException: (JE 5.0.97) Environment 
must be closed, caused by: 
com.sleepycat.je.rep.MasterReplicaTransitionException: Environment invalid 
because of previous exception: (JE 5.0.97) 
mars(4):/home/keith/trunk/qpid/qpid/java/systests/target/qpid-broker/0.32-SNAPSHOT/work4/mars/config
 com.sleepycat.je.rep.stream.MasterStatus$MasterSyncException: Master change. 
Node master id: mars(4) Group master id: earth(3) MASTER_TO_REPLICA_TRANSITION: 
This node was a master and must reinitialize internal state to become a 
replica. The application must close and reopen all Environment handles. 
Environment is invalid and must be closed.
        at 
com.sleepycat.je.rep.MasterReplicaTransitionException.wrapSelf(MasterReplicaTransitionException.java:50)
        at 
com.sleepycat.je.dbi.EnvironmentImpl.checkIfInvalid(EnvironmentImpl.java:1594)
        at com.sleepycat.je.Environment.checkEnv(Environment.java:2225)
        at 
com.sleepycat.je.Environment.beginTransactionInternal(Environment.java:1348)
        at com.sleepycat.je.Environment.beginTransaction(Environment.java:1319)
        at 
org.apache.qpid.server.store.berkeleydb.AbstractBDBMessageStore.removeMessage(AbstractBDBMessageStore.java:376)
        at 
org.apache.qpid.server.store.berkeleydb.AbstractBDBMessageStore$StoredBDBMessage.remove(AbstractBDBMessageStore.java:1436)
        at 
org.apache.qpid.server.message.AbstractServerMessageImpl.decrementReference(AbstractServerMessageImpl.java:101)
        at 
org.apache.qpid.server.message.AbstractServerMessageImpl.access$500(AbstractServerMessageImpl.java:37)
        at 
org.apache.qpid.server.message.AbstractServerMessageImpl$Reference.release(AbstractServerMessageImpl.java:275)
        at 
org.apache.qpid.server.exchange.AbstractExchange$2.onRollback(AbstractExchange.java:571)
        at 
org.apache.qpid.server.txn.LocalTransaction.doRollbackActions(LocalTransaction.java:270)
        at 
org.apache.qpid.server.txn.LocalTransaction.rollback(LocalTransaction.java:374)
        at 
org.apache.qpid.server.protocol.v0_8.AMQChannel.close(AMQChannel.java:739)
        at 
org.apache.qpid.server.protocol.v0_8.AMQChannel.close(AMQChannel.java:715)
        at 
org.apache.qpid.server.protocol.v0_8.AMQProtocolEngine.closeAllChannels(AMQProtocolEngine.java:942)
        at 
org.apache.qpid.server.protocol.v0_8.AMQProtocolEngine.closeSession(AMQProtocolEngine.java:981)
        at 
org.apache.qpid.server.protocol.v0_8.AMQProtocolEngine$3.run(AMQProtocolEngine.java:1035)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:356)
        at 
org.apache.qpid.server.protocol.v0_8.AMQProtocolEngine.runAsSubject(AMQProtocolEngine.java:223)
        at 
org.apache.qpid.server.protocol.v0_8.AMQProtocolEngine.closeSession(AMQProtocolEngine.java:1030)
        at 
org.apache.qpid.server.protocol.v0_8.AMQProtocolEngine.closed(AMQProtocolEngine.java:1299)
        at 
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.closed(MultiVersionProtocolEngine.java:117)
        at 
org.apache.qpid.transport.network.io.IoReceiver.run(IoReceiver.java:222)
        at java.lang.Thread.run(Thread.java:745)
Caused by: com.sleepycat.je.rep.MasterReplicaTransitionException: Environment 
invalid because of previous exception: (JE 5.0.97) 
mars(4):/home/keith/trunk/qpid/qpid/java/systests/target/qpid-broker/0.32-SNAPSHOT/work4/mars/config
 com.sleepycat.je.rep.stream.MasterStatus$MasterSyncException: Master change. 
Node master id: mars(4) Group master id: earth(3) MASTER_TO_REPLICA_TRANSITION: 
This node was a master and must reinitialize internal state to become a 
replica. The application must close and reopen all Environment handles. 
Environment is invalid and must be closed.
        at 
com.sleepycat.je.rep.impl.node.FeederManager.runFeeders(FeederManager.java:458)
        at com.sleepycat.je.rep.impl.node.RepNode.run(RepNode.java:1463)
Caused by: com.sleepycat.je.rep.stream.MasterStatus$MasterSyncException: Master 
change. Node master id: mars(4) Group master id: earth(3)
        at 
com.sleepycat.je.rep.stream.MasterStatus.assertSync(MasterStatus.java:107)
        at 
com.sleepycat.je.rep.impl.node.FeederManager.runFeeders(FeederManager.java:390)
        ... 1 more
{noformat}






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to