Interesting. I restarted Server 2 in the ensemble and the problem cleared itself.
-JZ On 10/21/11 4:34 PM, "Jordan Zimmerman" <[email protected]> wrote: >FYI - I turned on DEBUG and here's more log info: > >2011-10-21 23:33:06,732 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@510] - id: 3, proposed id: 3, >zxid: 12885265585, proposed zxid: 12885265585 >2011-10-21 23:33:06,732 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@727] - Adding vote: From = 3, >Proposed leader = 3, Porposed zxid = 12885265585, Proposed epoch = 1 >2011-10-21 23:33:06,734 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:06,735 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 1 (n.leader), 8589935532 >(n.zxid), 3 (n.round), LEADING (n.state), 1 (n.sid), LOOKING (my state) >2011-10-21 23:33:08,336 - DEBUG >[QuorumPeer:/0.0.0.0:2181:QuorumCnxManager@414] - Queue size: 0 >2011-10-21 23:33:08,336 - INFO >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@697] - Notification time out: >3200 >2011-10-21 23:33:08,336 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 1 >2011-10-21 23:33:08,337 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 2 >2011-10-21 23:33:08,337 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:08,337 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 3 (n.leader), 12885265585 >(n.zxid), 1 (n.round), LOOKING (n.state), 3 (n.sid), LOOKING (my state) >2011-10-21 23:33:08,337 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@510] - id: 3, proposed id: 3, >zxid: 12885265585, proposed zxid: 12885265585 >2011-10-21 23:33:08,337 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@727] - Adding vote: From = 3, >Proposed leader = 3, Porposed zxid = 12885265585, Proposed epoch = 1 >2011-10-21 23:33:08,339 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:08,339 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 1 (n.leader), 8589935532 >(n.zxid), 3 (n.round), LEADING (n.state), 1 (n.sid), LOOKING (my state) >2011-10-21 23:33:11,540 - DEBUG >[QuorumPeer:/0.0.0.0:2181:QuorumCnxManager@414] - Queue size: 0 >2011-10-21 23:33:11,540 - INFO >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@697] - Notification time out: >6400 >2011-10-21 23:33:11,540 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 1 >2011-10-21 23:33:11,541 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 2 >2011-10-21 23:33:11,541 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:11,541 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 3 (n.leader), 12885265585 >(n.zxid), 1 (n.round), LOOKING (n.state), 3 (n.sid), LOOKING (my state) >2011-10-21 23:33:11,541 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@510] - id: 3, proposed id: 3, >zxid: 12885265585, proposed zxid: 12885265585 >2011-10-21 23:33:11,541 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@727] - Adding vote: From = 3, >Proposed leader = 3, Porposed zxid = 12885265585, Proposed epoch = 1 >2011-10-21 23:33:11,543 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:11,544 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 1 (n.leader), 8589935532 >(n.zxid), 3 (n.round), LEADING (n.state), 1 (n.sid), LOOKING (my state) >2011-10-21 23:33:17,945 - DEBUG >[QuorumPeer:/0.0.0.0:2181:QuorumCnxManager@414] - Queue size: 0 >2011-10-21 23:33:17,945 - INFO >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@697] - Notification time out: >12800 >2011-10-21 23:33:17,945 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 1 >2011-10-21 23:33:17,946 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 2 >2011-10-21 23:33:17,946 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:17,946 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 3 (n.leader), 12885265585 >(n.zxid), 1 (n.round), LOOKING (n.state), 3 (n.sid), LOOKING (my state) >2011-10-21 23:33:17,946 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@510] - id: 3, proposed id: 3, >zxid: 12885265585, proposed zxid: 12885265585 >2011-10-21 23:33:17,946 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@727] - Adding vote: From = 3, >Proposed leader = 3, Porposed zxid = 12885265585, Proposed epoch = 1 >2011-10-21 23:33:17,948 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:17,948 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 1 (n.leader), 8589935532 >(n.zxid), 3 (n.round), LEADING (n.state), 1 (n.sid), LOOKING (my state) >2011-10-21 23:33:30,750 - DEBUG >[QuorumPeer:/0.0.0.0:2181:QuorumCnxManager@414] - Queue size: 0 >2011-10-21 23:33:30,750 - INFO >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@697] - Notification time out: >25600 >2011-10-21 23:33:30,750 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 1 >2011-10-21 23:33:30,750 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 2 >2011-10-21 23:33:30,751 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:30,751 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 3 (n.leader), 12885265585 >(n.zxid), 1 (n.round), LOOKING (n.state), 3 (n.sid), LOOKING (my state) >2011-10-21 23:33:30,751 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@510] - id: 3, proposed id: 3, >zxid: 12885265585, proposed zxid: 12885265585 >2011-10-21 23:33:30,751 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@727] - Adding vote: From = 3, >Proposed leader = 3, Porposed zxid = 12885265585, Proposed epoch = 1 >2011-10-21 23:33:30,753 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:30,753 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 1 (n.leader), 8589935532 >(n.zxid), 3 (n.round), LEADING (n.state), 1 (n.sid), LOOKING (my state) >2011-10-21 23:33:56,357 - DEBUG >[QuorumPeer:/0.0.0.0:2181:QuorumCnxManager@414] - Queue size: 0 >2011-10-21 23:33:56,357 - INFO >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@697] - Notification time out: >51200 >2011-10-21 23:33:56,358 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 1 >2011-10-21 23:33:56,358 - DEBUG [WorkerSender Thread:QuorumCnxManager@389] >- There is a connection already for server 2 >2011-10-21 23:33:56,358 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:56,358 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 3 (n.leader), 12885265585 >(n.zxid), 1 (n.round), LOOKING (n.state), 3 (n.sid), LOOKING (my state) >2011-10-21 23:33:56,358 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@510] - id: 3, proposed id: 3, >zxid: 12885265585, proposed zxid: 12885265585 >2011-10-21 23:33:56,359 - DEBUG >[QuorumPeer:/0.0.0.0:2181:FastLeaderElection@727] - Adding vote: From = 3, >Proposed leader = 3, Porposed zxid = 12885265585, Proposed epoch = 1 >2011-10-21 23:33:56,360 - DEBUG [WorkerReceiver >Thread:FastLeaderElection$Messenger$WorkerReceiver@214] - Receive new >notification message. My id = 3 >2011-10-21 23:33:56,360 - INFO [WorkerReceiver >Thread:FastLeaderElection@496] - Notification: 1 (n.leader), 8589935532 >(n.zxid), 3 (n.round), LEADING (n.state), 1 (n.sid), LOOKING (my state) >(END) > > >
