Hi all, I need to restrict my crawling to pages on a particular set of urls.
i.e. http://www.myweb1.com/<allpages> http://www.myweb2.com/<allpages> ... Is there a simple way of doing this? Thanks, Skip This e-mail is only intended for the person(s) to whom it is addressed and may contain confidential information. Aspect Group does not accept responsibility for any loss or damage caused by this email or any attachments. Unless clearly stated to the contrary, any opinions or comments are personal to the writer and are not made on behalf of Aspect Group. If you have received this e-mail in error, please notify us immediately at [EMAIL PROTECTED] and then delete this message from your system. Please do not copy it or use it for any purposes, or disclose its contents to any other person. Thank you for your co-operation. Aspect Group is the business name of Aspect Internet Holdings Limited, Aspect Technologies Limited and Nettec Solutions Limited. ------------------------------------------------------- This SF.net email is sponsored by: The Robotic Monkeys at ThinkGeek For a limited time only, get FREE Ground shipping on all orders of $35 or more. Hurry up and shop folks, this offer expires April 30th! http://www.thinkgeek.com/freeshipping/?cpg=12297 _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
