Hi guys,
Yandex, which ignores robots.txt, has been indexing my site.
I tried to block on httpd.conf with these configurations below but didn't
work.
SetEnvIfNoCase User-Agent "^YandexBot*" bad_bot
<Directory />
Order Allow,Deny
Allow from all
Deny from env=bad_bot
</Directory>
How can I try to block it on modsecurity ?
->> apache log:
199.21.99.86 - - [18/Feb/2013:11:20:37 -0300] "GET / HTTP/1.1" *200* 8663
"-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
199.21.99.86 - - [18/Feb/2013:11:21:29 -0300] "GET
/files_on_my_server/abc.pdf HTTP/1.1" *200 *97637 "-" "Mozilla/5.0
(compatible; YandexBot/3.0; +http://yandex.com/bots)"
many thanks!
_______________________________________________
Owasp-modsecurity-core-rule-set mailing list
Owasp-modsecurity-core-rule-set@lists.owasp.org
https://lists.owasp.org/mailman/listinfo/owasp-modsecurity-core-rule-set
