I'm up to 110 million urls on a Dual Xeon with 2 gigs of memory and while it just takes a while for analysis it does complete without error.
What OS/Platform are you trying and what JVM do you use? -byron --- Massimo Miccoli <[EMAIL PROTECTED]> wrote: > > Ciao, > > > First, my compliments for the Nutch code. > > My name is massimo and I follow the nutch project > from the > firts day. I have test any new patched release > (CVS). Now I > want try the NutchFs. I have many boxes and disk and > many > > problem with webdb on LinkAnalisys when the db have > about > 40.000.000 of urls, also with a dula xeon server and > 8 GB of > ram. So ther is a a solution by modify the nutch bin > file to > integrate the distribute version of webdb? > > Many thanks, > > > > Massimo > > > > > ------------------------------------------------------- > This SF.Net email is sponsored by Sleepycat Software > Learn developer strategies Cisco, Motorola, Ericsson > & Lucent use to deliver > higher performing products faster, at low TCO. > http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3 > _______________________________________________ > Nutch-general mailing list > [EMAIL PROTECTED] > https://lists.sourceforge.net/lists/listinfo/nutch-general ------------------------------------------------------- This SF.Net email is sponsored by Sleepycat Software Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver higher performing products faster, at low TCO. http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3 _______________________________________________ Nutch-general mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-general
