Isn't node failure core to the problem of partitioning because your
partitioning of data will have to change as the cluster membership is
changing, and data is going to have to migrate - right?
Anyway, I'll take a look at your Wiki and see if I can contribute in
some way. Thanks!
David
On Feb 26, 2009, at 2:41 PM, Ben Browning <ben...@gmail.com> wrote:
On Thu, Feb 26, 2009 at 5:16 PM, David Van Couvering
<david.vancouver...@gmail.com> wrote:
This us great! Are you going to put some functional and design
docs on the
Wiki? This seems pretty important to get right and could save you
a lot of
time getting feedback from the community on your overall approach.
Yes, that sounds like a good idea. I'll find a place on the wiki to
document my thoughts as well as the opinions of others expressed
previously on the mailing list.
Just for example, a discussion of your hashing mechanism would be
great, and
how you handle repartitioning on node failure, etc.
Initially I'm just concentrating on partitioning the data. Gracefully
handling node failures will be a step after that and I haven't put a
lot of effort into that piece yet. Any ideas are welcome, and I know
there are some threads that at least touched on that topic before.