Guys, We need to add data loss detection to our product so users can get notified in case rebalancing has not fully finished and any data is lost due to nodes crash.
Let me explain. Whenever data node joins or leaves topology rebalancing happens. Nodes load partitions belonging to them on current topology version from current partitions' owners. Node always knows whether partition is loaded properly or not. So, if partition is loaded properly, new node mark it as "valid". If partition is not loaded properly (all owners failed) node fires local event, e.g. EVT_CACHE_REBALANCE_PART_LOADED and outputs warning to the logs. Does anyone have comments or questions? --Yakov
