Did you add more boxes or any other topology change. Also can you check the message queue for all nodes and see if there are any pending state transitions
On Mon, Mar 7, 2016 at 1:49 PM, Varun Sharma <[email protected]> wrote: > Hi, > > We are seeing a situation where the external view and the current states > are going out of sync. We see the following message in the logs. We are > using a simple ONLINE-OFFLINE state factory with a replication factor of 3. > > [Thread-8] (MessageSelectionStage.java:198) INFO *Reach upper_bound: 3, > not send message: b6fcc1dd-49d8-4649-b7ee-0dda187460d8*, > {CREATE_TIMESTAMP=1457386198983, ClusterEventName=idealStateChange, > FROM_STATE=OFFLINE, MSG_ID=b6fcc1dd-49d8-4649-b7ee-0dda187460d8, > MSG_STATE=new, MSG_TYPE=STATE_TRANSITION, > PARTITION_NAME=$terrapin$data$recommendation_derived_user_interest_joins$1456941421231$964, > RESOURCE_NAME=$terrapin$data$recommendation_derived_user_interest_joins$1456941421231, > SRC_NAME=terrapinmainoffline-a01-namenode-001.ec2.pin220.com_9090, > SRC_SESSION_ID=5523daf62c1855f, STATE_MODEL_DEF=OnlineOffline, > STATE_MODEL_FACTORY_NAME=DEFAULT, > TGT_NAME=terrapinmainoffline-a01-datanode-fa4e1645, > TGT_SESSION_ID=251013475ac44f9, TO_STATE=ONLINE}{}{} > > Thanks > > Varun >
