Laurent Laborde wrote:
>
> On Fri, Dec 26, 2008 at 8:51 AM, buddha1021 <[email protected]> wrote:
>> thank you very much!!!
>> but ,in this condition,how many bandwiths (whitch would be used for nutch
>> to
>> access to the internet for people to search! and also for nutch to fetch
>> pages!) would be required?
>> --
>> View this message in context:
>> http://www.nabble.com/the-question-of-the-nutch%27s-ability%21-tp21171116p21172476.html
>> Sent from the Nutch - User mailing list archive at Nabble.com.
>
> Using 1000 thread to fetch the internet, it used 5Mb/s bandwidth.
> But, it was at home with a 100Mb/s fiber optic, not in a datacenter.
> Higher ping slown down the queries (and so the used bandwidth).
> I hadn't a local dns cache (that also mean slower query).
>
> CPU (2.4Ghz quadcore) wasn't the bottleneck.
> You can easily test that just running the tutorial on hadoop webiste/wiki
> :)
>
> --
> F4FQM
> Kerunix Flan
> Laurent Laborde
>
>
................................................................................................
thank you very much for your advice!
--
View this message in context:
http://www.nabble.com/the-question-of-the-nutch%27s-ability%21-tp21171116p21172639.html
Sent from the Nutch - User mailing list archive at Nabble.com.
