Hi Theodoros: On Thu, 24 Jun 2010, Theodoros Theodoropoulos wrote: > Probably, this is also a way to deny access to crawlers that don't > respect robots.txt :)
On CDS we have seen some malicious bots to fake user agent to look like regular MSIE browser, so sometimes we resort to blocking them via iptables, like: # iptables -I INPUT -p TCP -i eth0 -s 1.2.3.4 -j DROP Best regards -- Tibor Simko
