> Given the inherent over head in total order protocols, I think we > should work to limit the messages passed over the protocol, to only > the absolute minimum to make our cluster work reliably. > Specifically, I think this is only the distributed lock. For state > replication we can use a much more efficient tcp or udp based protocol.
As I said, if your workload has low data sharing (e.g. session replication), you should not use totem. It's designed for systems where _each_ processor needs _most_ of the messages.
