Or check http://www.crawl-anywhere.com/
Very customizable crawler. -- View this message in context: http://lucene.472066.n3.nabble.com/what-s-the-status-of-droids-project-http-incubator-apache-org-droids-tp3277367p3277698.html Sent from the Solr - User mailing list archive at Nabble.com.
