Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread André Fiedler
Facebook Messaging – HBase Comes of Agehttp://facility9.com/2010/11/18/facebook-messaging-hbase-comes-of-age http://facility9.com/2010/11/18/facebook-messaging-hbase-comes-of-age 2010/11/21 David Boxenhorn da...@lookin2.com Eventual consistency is not good enough for instant messaging. On

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Edward Capriolo
On Sun, Nov 21, 2010 at 12:10 PM, André Fiedler fiedler.an...@googlemail.com wrote: Facebook Messaging – HBase Comes of Age http://facility9.com/2010/11/18/facebook-messaging-hbase-comes-of-age 2010/11/21 David Boxenhorn da...@lookin2.com Eventual consistency is not good enough for instant

(newbie) ColumnFamilyOutputFormat only writes one column (per key)

2010-11-21 Thread mck
(I'm new here so forgive any mistakes or mis-presumptions...) I've set up a cassandra-0.7.0-beta3 and populated it with thrift-serialised objects via a scribe server. This seems a great way to get thrift beans out of the application asap and have then sitting in cassandra for later processing. I

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Aaron Morton
I've been using "Tunable Consistency" when explaining Cassandra to people as well. I've also started pointing out the different Consistency models of the standard Transaction Isolation Levels of an ACID compliant DB, as well as "eventually consistent" async replication like MYSQL / Couch DBI've

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Eric Evans
On Sun, 2010-11-21 at 11:32 -0500, Simon Reavely wrote: As a cassandra user I think the key sentence for this community is: We found Cassandra's eventual consistency model to be a difficult pattern to reconcile for our new Messages infrastructure. In my experience, we needed strong

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Jake Luciani
+1 Ed On Nov 21, 2010, at 12:13 PM, Edward Capriolo edlinuxg...@gmail.com wrote: On Sun, Nov 21, 2010 at 12:10 PM, André Fiedler fiedler.an...@googlemail.com wrote: Facebook Messaging – HBase Comes of Age http://facility9.com/2010/11/18/facebook-messaging-hbase-comes-of-age

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Edward Ribeiro
Also I believe saying HBASE is consistent is not true. This can happen: Write to region server. - Region Server acknowledges client- write to WAL - region server fails = write lost I wonder how facebook will reconcile that. :) Are you sure about that? Client writes to WAL before ack user?

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Todd Lipcon
On Sun, Nov 21, 2010 at 2:06 PM, Edward Ribeiro edward.ribe...@gmail.comwrote: Also I believe saying HBASE is consistent is not true. This can happen: Write to region server. - Region Server acknowledges client- write to WAL - region server fails = write lost I wonder how facebook will

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Dave Viner
I don't know the details of operation of HBase, so I can't speak on that point. But, I do know that Facebook hired Jonathan Grey, former CTO of Streamy, who is a huge HBase contributor. Streamy ended in Mar 2010 - although I'm not sure when he went to work for Facebook. He presented on HBase at

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Jonathan Ellis
On Sun, Nov 21, 2010 at 6:16 PM, Todd Lipcon t...@lipcon.org wrote: [only jumping in because info was requested - those who know me know that I think Cassandra is a very interesting architecture and a better fit for many applications than HBase] Hey Todd! Good to see you de-lurk! In the

Re: Facebook messaging and choice of HBase over Cassandra - what can we learn?

2010-11-21 Thread Todd Lipcon
On Sun, Nov 21, 2010 at 6:25 PM, Jonathan Ellis jbel...@gmail.com wrote: On Sun, Nov 21, 2010 at 6:16 PM, Todd Lipcon t...@lipcon.org wrote: [only jumping in because info was requested - those who know me know that I think Cassandra is a very interesting architecture and a better fit for