Hi Benny, That's not realistic with Nutch, which was really designed for larger and longer "fetch jobs" (more URLs).
Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ----- Original Message ---- > From: Benny Lipsicas <[EMAIL PROTECTED]> > To: [email protected] > Sent: Wednesday, June 11, 2008 3:32:44 AM > Subject: Fast indexing? > > Greetings, > > I have been playing with nutch for an application that requires rather > quick indexing of a relatively small amount of data: indexing the first > level of 10 straight-forward urls (no regex). > > On my very basic 0.5G Ram PC with nutch running in default form on > Windows (using Cygwin) this has never taken less than a minute to complete. > > Assuming nutch will run on a more appropriate infrastructure - does > anyone know how faster can I expect it to run? Is 1 sec or less a > realistic result? > > Benny
