How do I know if all of my urls got crawled. I ran the stat command and it gave a lot hits and pages but I don't think I got too deep into them. I ran a depth of 5 and I had 7 urls in the file...can I jus scan my entire domain instead of putting the urls in the file?
andy ------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_idv37&alloc_id865&op=click _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
