On Mon, Jul 19, 2010 at 10:52:26AM -0400, Blanco, Jose wrote:
> I was looking over the dspace stats code to see if it had anything to remove 
> counts from crawlers and I don't see anything in there.  I just wanted to 
> make sure that is the case.

Would that be the Solr-based stat. code new in 1.6?  In 1.6.0 there is
a file called config/spiders.txt to contain a list of crawler IP
addresses.  This was changed in a later point release to use multiple
files found in config/spiders.  There's also a list of update URLs for
spider lists configured in dspace.cfg as solr.spiderips.urls.

There isn't much documentation, though.  We need to correct that.

-- 
Mark H. Wood, Lead System Programmer   [email protected]
Balance your desire for bells and whistles with the reality that only a 
little more than 2 percent of world population has broadband.
        -- Ledford and Tyler, _Google Analytics 2.0_

Attachment: pgp6dCu6GtV7A.pgp
Description: PGP signature

------------------------------------------------------------------------------
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Reply via email to