Applied. Thanks.
Doug
Andy Hedges wrote:
I noticed that files with the rtf extension are being filtered by the regex templates. So I have produced this patch to remove them. If someone could commit this then that would be great.
Thanks,
Andy
Index: conf/crawl-urlfilter.txt.template =================================================================== RCS file: /cvsroot/nutch/nutch/conf/crawl-urlfilter.txt.template,v retrieving revision 1.3 diff -u -r1.3 crawl-urlfilter.txt.template --- conf/crawl-urlfilter.txt.template 16 Jun 2004 17:31:30 -0000 1.3 +++ conf/crawl-urlfilter.txt.template 2 Oct 2004 08:31:53 -0000 @@ -12,7 +12,7 @@ -^(file|ftp|mailto):
# skip image and other suffixes we can't yet parse
--\.(gif|GIF|jpg|JPG|ico|ICO|css|sit|eps|wmf|rtf|zip|ppt|mpg|xls|gz|rpm|tgz|mov|MOV|exe)$
+-\.(gif|GIF|jpg|JPG|ico|ICO|css|sit|eps|wmf|zip|ppt|mpg|xls|gz|rpm|tgz|mov|MOV|exe)$
# skip URLs containing certain characters as probable queries, etc. [EMAIL PROTECTED] Index: conf/regex-urlfilter.txt.template =================================================================== RCS file: /cvsroot/nutch/nutch/conf/regex-urlfilter.txt.template,v retrieving revision 1.3 diff -u -r1.3 regex-urlfilter.txt.template --- conf/regex-urlfilter.txt.template 16 Jun 2004 17:31:30 -0000 1.3 +++ conf/regex-urlfilter.txt.template 2 Oct 2004 08:31:53 -0000 @@ -10,7 +10,7 @@ -^(file|ftp|mailto):
# skip image and other suffixes we can't yet parse
--\.(gif|GIF|jpg|JPG|ico|ICO|css|sit|eps|wmf|rtf|zip|ppt|mpg|xls|gz|rpm|tgz|mov|MOV|exe)$
+-\.(gif|GIF|jpg|JPG|ico|ICO|css|sit|eps|wmf|zip|ppt|mpg|xls|gz|rpm|tgz|mov|MOV|exe)$
# skip URLs containing certain characters as probable queries, etc. [EMAIL PROTECTED]
------------------------------------------------------- This SF.net email is sponsored by: IT Product Guide on ITManagersJournal Use IT products in your business? Tell us what you think of them. Give us Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more http://productguide.itmanagersjournal.com/guidepromo.tmpl _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
------------------------------------------------------- This SF.net email is sponsored by: IT Product Guide on ITManagersJournal Use IT products in your business? Tell us what you think of them. Give us Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more http://productguide.itmanagersjournal.com/guidepromo.tmpl _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
