I don't think protobuf are slower than writable actually, they do really
well in speed. I actually wrote some rpc code in C++ for protocolbuffers
and some swig wrappers to have clients in java. A simple c++ server can
easily handle about 20k qps in that setup and this is just with a naive
imple
did you build it on top of zmq? i really don't see the need for people
reinventing the low level rcp stuff over and over again. zmq comes with
baked in request-response, pub-sub, and pipeline (distributed processing)
communication. once you rely on protobuf + zmq for the rpc is it trivial to
add cl
Hi,
Am trying to bring high availability in namenode(in hadoop cluster) for
small setup.
So the idea is to keep one extra namenode and use terracotta to replicate
the log(in memory details-jvm) from primary datacode to standby namenode, if
primary goes down secondary can take the primary role.
N
Gokul,
Terracotta is a fascinating framework which might be a bit of an overshot for a
small setup as well as adding another level of complexity in the form
Terracotta framework.
Quite interesting approach for NN's HA is Jini (aka ASF River) along with
JavaSpaces for the distributed storage of th
Cos,
Am planning to implement this idea in bigger cluster but first i want
to get confidence in small cluster. I do read about terracotta and
inspired by this idea.
-gokul
On Fri, Sep 23, 2011 at 11:57 PM, Konstantin Boudnik wrote:
> Gokul,
>
> Terracotta is a fascinating framework which might
Is there any reason not to just use something as simple as drbd (which is baked
into vanilla linux)? Unless you are already paying terracotta for their
software there are plenty of HA setups that are supported through the use of
drbd and a virtual ip.
Matt
-Original Message-
From: Goku
Dear:
Hi,glad to meet you.
I am a beginner of Hadoop.
Yestory I saw the HDFS-1840 ,which said:
In DFSClient, when there are files opened for write, a LeaseChecker thread is
started for updating the leases periodically. However, it never terminates when
when all writing files are closed.
B
