They also use the column oriented database Apache Cassandra which is also supported as storage backend by Gora. I can, much like Apache CouchDB, scale very well.
http://cassandra.apache.org/ http://couchdb.apache.org/ On Tuesday 26 October 2010 14:11:12 Andrzej Bialecki wrote: > On 2010-10-26 14:02, xiao yang wrote: > > Hi, Andrzej > > > > Great, I'll definitely try Nutch 2.0! > > As far as I know, Facebook is still using MySQL for storage. I believe > > the its data scale will exceed 100K. Do you have any clues how they > > solve the problem? > > By partitioning the database. There was a talk on the Facebook > architecture at the Lucene Revolution conference, and I remember that > there was a diagram that described their design - see > lucenerevolution.com for more details. -- Markus Jelsma - CTO - Openindex http://www.linkedin.com/in/markus17 050-8536600 / 06-50258350
