Jeff:
What I am using is a robots.txt file that I put in the dspace webapps
directory in tomcat. I think it's working (at least we haven't
crashed lately). If you're interested in seeing my robots.txt file,
I can send it to you.
At 01:09 PM 1/14/2009, Jeffrey Trimble wrote:
Is there something simple I can place in the jsp that will prohibit
the crawlers from
using my server resources?
TIA,
Jeff
Jeffrey Trimble
Systems Librarian
Maag Library
Youngstown State University
330-941-2483 (Office)
<mailto:[email protected]>[email protected]
http://www.maag.ysu.edu
<http://digital.maag.ysu.edu>http://digital.maag.ysu.edu
------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech
***************************
George Kozak
Digital Library Information Technology
501 Olin Library
Cornell University
607-255-8924
***************************
[email protected]
------------------------------------------------------------------------------
This SF.net email is sponsored by:
SourcForge Community
SourceForge wants to tell your story.
http://p.sf.net/sfu/sf-spreadtheword
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech
