Nutch doesn't make use of sitemaps currently. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ---- > From: consultas <[email protected]> > To: [email protected] > Sent: Friday, February 27, 2009 12:34:30 PM > Subject: sitemaps > > From a response of a previous post of mine, I have noticed that a lot of > sites, > in the robots.txt, states, also, their sitemaps adress. This, of course is > to > make them more "indexable" by Google. Does Nutch intend to make use of this > kind of sitemaps to increase its own ability to index? > > Thanks
