Hadoop is used extensively in Nutch systems. We have cluster over over
125 nodes processing indexes of over 125 million pages.
Dennis Kubes
11 Nov. wrote:
Hi buddies,
I have been tracking hadoop project for a while, and I think I'm a big
fun of hadoop:)
To my point of view, hadoop is not mature enough to be used in realworld
heavy weight application yet, for example, to build PB level search engine.
So I'm here to ask, as Yahoo is one of the key supporter of Hadoop project,
does there exist any heavy weight, realworld, applications purely based on
hadoop from Yahoo? Or Yahoo have some secret features to make hadoop more
realistic in real applications.
Acturally, we are going to build a environment of 1000 nodes based on
hadoop technology before 2009. That's a tuff job, right?