On Sep 7, 2012, at 2:42am, hugo.ma wrote: > Thanks. > > I was looking for a easy solution for parsing very large sitemaps. > I think nutch 2.0 dont have support for site maps.
There's code in crawler-commons for sitemap parsing. See http://code.google.com/p/crawler-commons/ and also https://issues.apache.org/jira/browse/NUTCH-1465 -- Ken -------------------------------------------- http://about.me/kkrugler +1 530-210-6378 -------------------------- Ken Krugler http://www.scaleunlimited.com custom big data solutions & training Hadoop, Cascading, Mahout & Solr
