BTW after HAMA-642 <https://issues.apache.org/jira/browse/HAMA-642> I will redesign our messaging system to being completely disk based with caching. I will formulate a followup issue for this. However I plan to get rid of the RPC anyway, I think it is more efficient to stream the messages from disk over network to the other host via NIO (we can later replace it with netty). Also this saves us the time to do the checkpointing, because this can be combined with it pretty well. RPC requires the whole bundle to be in RAM, which is totally bad. Will follow with more details later.
2012/9/19 Thomas Jungblut <[email protected]>: > What is more memory efficient? > > Am 19.09.2012 08:23 schrieb "Edward J. Yoon" <[email protected]>: > >> Let's change the default value of RPC in hama-default.xml to Hadoop RPC. I >> am testing Hadoop RPC and Avro RPC on 4 racks cluster. Avro RPC is criminal. >> There's no significant performance difference. >> >> -- >> Best Regards, Edward J. Yoon >> @eddieyoon >> >
