Do you know if Nutch can handle something this large??
Dan
----- Original Message -----
From: "Byron Miller" <[EMAIL PROTECTED]>
To: <[email protected]>
Sent: Thursday, January 05, 2006 4:20 PM
Subject: Re: please disregard last post....
Yes and no. It's my personal belief that when you
read they run the search engine on 40 servers that is
40 query servers. I doubt they have a 2billion page
index/db/analysis/processing and spidering on just 40
servers but prove me wrong :)
-byron
--- Dan Segel <[EMAIL PROTECTED]> wrote:
correct post:
I am looking to be able to have an engine the size
of gigablast.com, I understand they run EVERYTHING
on just 40 servers! Can this software do that, and
what are the server specifications needed.
Dan
