I just meant (b) index www.htdig.org using "robotstxt_name: master-htdig" From a fresh install, just add "robots..." to your htdig.conf file, and then rundig.
(The 700MB was getting confused with the test I did on my department's site. htdig.org only gives 400MB :) Cheers, Lachlan On Thu, 29 May 2003 13:41, Jim Cole wrote: > On Wednesday, May 28, 2003, at 04:22 AM, Lachlan Andrew wrote: > > Excellent news! Are you in a position to run the "big" dig at > > some stage? (The database file is about 700MB.) > > Sorry. What is the "big" dig? I suspect I can give that a shot once > I figure out what it is :) I will pull a fresh copy of the code > from CVS before starting another test. > > Jim ------------------------------------------------------- This SF.net email is sponsored by: eBay Get office equipment for less on eBay! http://adfarm.mediaplex.com/ad/ck/711-11697-6916-5 _______________________________________________ htdig-dev mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/htdig-dev
