please see the mailing list archive there are 2 different ways to do that.
One is to use the plugin system and the regular expression filter plugin.
But there is as well something similar without the plugin system.
HTH Stefan
Am 23.04.2004 um 14:44 schrieb Skip McCrystal:
Hi all,
I need to restrict my crawling to pages on a particular set of urls.
i.e. http://www.myweb1.com/<allpages> http://www.myweb2.com/<allpages> ...
Is there a simple way of doing this?
Thanks,
Skip
This e-mail is only intended for the person(s) to whom it is addressed and
may contain confidential information. Aspect Group does not accept
responsibility for any loss or damage caused by this email or any
attachments. Unless clearly stated to the contrary, any opinions or comments
are personal to the writer and are not made on behalf of Aspect Group. If
you have received this e-mail in error, please notify us immediately at
[EMAIL PROTECTED] and then delete this message from your system. Please
do not copy it or use it for any purposes, or disclose its contents to any
other person. Thank you for your co-operation.
Aspect Group is the business name of Aspect Internet Holdings Limited,
Aspect Technologies Limited and Nettec Solutions Limited.
------------------------------------------------------- This SF.net email is sponsored by: The Robotic Monkeys at ThinkGeek For a limited time only, get FREE Ground shipping on all orders of $35 or more. Hurry up and shop folks, this offer expires April 30th! http://www.thinkgeek.com/freeshipping/?cpg=12297 _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
--------------------------------------------------------------- open technology: http://www.media-style.com open source: http://www.weta-group.net open discussion: http://www.text-mining.org
------------------------------------------------------- This SF.net email is sponsored by: The Robotic Monkeys at ThinkGeek For a limited time only, get FREE Ground shipping on all orders of $35 or more. Hurry up and shop folks, this offer expires April 30th! http://www.thinkgeek.com/freeshipping/?cpg=12297 _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
