I was doing a search and noticed that a 'png' file was indexed. I checked the crawl-urlfilter.txt and it had the following line preventing the index of a png file: -\.(gif|GIF|jpg|JPG|ico|ICO|css|sit|eps|wmf|zip|ppt|mpg|xls|gz|rpm|tgz|mov|MOV|exe|png)$
I then looked at regex-urlfilter.txt, and the line was similar, but lacked the 'png' definition. So apparently the recrawl was indexing the png files. The original regex-urlfilter.txt line is below: -\.(gif|GIF|jpg|JPG|ico|ICO|css|sit|eps|wmf|zip|ppt|mpg|xls|gz|rpm|tgz|mov|MOV|exe)$ It needs to be modified in trunk to match the line from crawl-urlfilter.txt. Matt ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
