On Sat, Apr 29, 2017 at 04:23:50PM -0400, Richard Hipp wrote:
> You can further allow users to see hyperlinks without first logging in
> as anonymous by going to Admin/Users and editing the "anonymous" user
> to give that user "hyperlink" privilege. If you do that, though, your
> site will become infected by robots who will download every historical
> tarball, ZIP archive, "annotation", and diff, sucking up all your
> bandwidth and CPU cycles. A robots.txt file will not help - the
> offending bots all ignore robots.txt. Perhaps you can keep the bots
> at bay by setting up a bandwidth-limiting proxy of some kind.
Something like
if ($http_user_agent ~*
(360Spider|80legs|App3leWebKit|Baiduspider|EasouSpider)) {
return 403;
}
from my nginx.conf is a great help :)
Joerg
_______________________________________________
fossil-users mailing list
fossil-users@lists.fossil-scm.org
http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users
