Hi, I'm interested in using Nutch to crawl certain websites looking for only a specific file type, in my case I'm looking for any url that ends with a *.ics construct. I don't need to "parse" the ics files, I just need to know all the .ics files that exist. A list of links would be great.
Can Nutch be configured to do this? Thanks! Pete [email protected]
