Googlebot searching for .../bin/en.jsp

2014-05-20 Thread Rabin Yasharzadehe
I have installed fail2ban on one of my servers, and created a set of rules to block some request the (from my point of view) looks like probing attempts. One of the rules is to block on site, any request to *.jsp which i don't have on this server. Today i got a mail about a blocked IP which

Re: Googlebot searching for .../bin/en.jsp

2014-05-20 Thread shimi
On Tue, May 20, 2014 at 10:15 AM, Rabin Yasharzadehe ra...@rabin.io wrote: I have installed fail2ban on one of my servers, and created a set of rules to block some request the (from my point of view) looks like probing attempts. One of the rules is to block on site, any request to *.jsp

Re: Googlebot searching for .../bin/en.jsp

2014-05-20 Thread Rabin Yasharzadehe
Good point, thank you. *-- Rabin* On Tue, May 20, 2014 at 10:23 AM, shimi linux...@shimi.net wrote: On Tue, May 20, 2014 at 10:15 AM, Rabin Yasharzadehe ra...@rabin.iowrote: I have installed fail2ban on one of my servers, and created a set of rules to block some request the (from my point

Re: Googlebot searching for .../bin/en.jsp

2014-05-20 Thread E.S. Rosenberg
Re:all - didn't notice it was linux-il host 66.249.79.57 57.79.249.66.in-addr.arpa domain name pointer crawl-66-249-79-57.googlebot.com. This suggests that it is indeed googlebot, why should they put GCE on googlebot hosts, way too high a risk of resulting in blocked bots. I would guess that

Re: Googlebot searching for .../bin/en.jsp

2014-05-20 Thread Rabin Yasharzadehe
After searching the access log as well, i found out the reference to our server came from one our older sites, after grepping the entire site i found out that we actually do have links to *.jsp urls :( Thank you. *--Rabin* On Wed, May 21, 2014 at 12:55 AM, E.S. Rosenberg e...@g.jct.ac.il