>From a response of a previous post of mine, I have noticed that a lot of >sites, in the robots.txt, states, also, their sitemaps adress. This, of >course is to make them more "indexable" by Google. Does Nutch intend to make >use of this kind of sitemaps to increase its own ability to index?
Thanks
