o, I think, Nutch is behind some other search engines, an Nutch is a big
hope to put the open software in its own place, comparinwith some
monopolists search engines. I think someone should not strugle against
something that is currently done, just becauks it was not done about four
years ago. Why not to implement a plugin, or something, to cope with this
new reality?
----- Original Message -----
From: "Otis Gospodnetic" <[email protected]>
To: <[email protected]>
Sent: Friday, February 27, 2009 3:12 PM
Subject: Re: sitemaps
Nutch doesn't make use of sitemaps currently.
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ----
From: consultas <[email protected]>
To: [email protected]
Sent: Friday, February 27, 2009 12:34:30 PM
Subject: sitemaps
From a response of a previous post of mine, I have noticed that a lot of
sites,
in the robots.txt, states, also, their sitemaps adress. This, of course
is to
make them more "indexable" by Google. Does Nutch intend to make use of
this
kind of sitemaps to increase its own ability to index?
Thanks
--------------------------------------------------------------------------------
No virus found in this incoming message.
Checked by AVG - www.avg.com
Version: 8.0.237 / Virus Database: 270.11.3/1975 - Release Date: 02/27/09
07:05:00
