my paster.log is full of errors relating to a googlebot trying to access a library file.

I noticed a robots.txt file in the static folder configured as such.

User-agent: *
Disallow: /

I thought this would stop all bots accessing all files. Should this be configured differently?


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:


Reply via email to