GPO knows that many institutions have automated URL checkers
> that run against the PURL server. Please be aware that the
PURL restoration process is severely slowed by checkers repeatedly hitting the PURL server.
Presumably if there are any parties running automated tools which neglect to check robots.txt those institutions are going to be named and shamed and/or permanently filtered?
cheers stuart -- Stuart Yeates http://www.nzetc.org/ New Zealand Electronic Text Centre http://researcharchive.vuw.ac.nz/ Institutional Repository
