[PHP] Detecting massive web hits

2013-04-12 Thread Angela Barone
Does anyone know if there's a ready-made script that detects if someone 
hits multiple web pages within seconds of each other and then can temporarily 
ban them by IP from accessing our site?

Looking through the logs, I see someone/something hit each and every 
page of a site I work on within only a few seconds of each other.  I seriously 
doubt they are a customer. ;)

I'd appreciate any insights.

Thank you,
Angela
--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php



Re: [PHP] Detecting massive web hits

2013-04-12 Thread Samuel Lopes Grigolato
I don't know exactly how search engine spiders work, but just be cautious
to not block these users, they aren't customers but they may bring you
some =).

Again, I don't know if this is your case, but the possibility sparked on my
mind anyway.

Cheers.


On Fri, Apr 12, 2013 at 12:23 PM, Angela Barone ang...@italian-getaways.com
 wrote:

 Does anyone know if there's a ready-made script that detects if
 someone hits multiple web pages within seconds of each other and then can
 temporarily ban them by IP from accessing our site?

 Looking through the logs, I see someone/something hit each and
 every page of a site I work on within only a few seconds of each other.  I
 seriously doubt they are a customer. ;)

 I'd appreciate any insights.

 Thank you,
 Angela
 --
 PHP General Mailing List (http://www.php.net/)
 To unsubscribe, visit: http://www.php.net/unsub.php




Re: [PHP] Detecting massive web hits

2013-04-12 Thread Sebastian Krebs
Nginx has builtin support for this and I assume, that there is something
similar for Apache. I don't think PHP is the right tool.
Am 12.04.2013 17:24 schrieb Angela Barone ang...@italian-getaways.com:

 Does anyone know if there's a ready-made script that detects if
 someone hits multiple web pages within seconds of each other and then can
 temporarily ban them by IP from accessing our site?

 Looking through the logs, I see someone/something hit each and
 every page of a site I work on within only a few seconds of each other.  I
 seriously doubt they are a customer. ;)

 I'd appreciate any insights.

 Thank you,
 Angela
 --
 PHP General Mailing List (http://www.php.net/)
 To unsubscribe, visit: http://www.php.net/unsub.php




Re: [PHP] Detecting massive web hits

2013-04-12 Thread Frank Arensmeier
12 apr 2013 kl. 17.23 skrev Angela Barone:

   Does anyone know if there's a ready-made script that detects if someone 
 hits multiple web pages within seconds of each other and then can temporarily 
 ban them by IP from accessing our site?
 
   Looking through the logs, I see someone/something hit each and every 
 page of a site I work on within only a few seconds of each other.  I 
 seriously doubt they are a customer. ;)
 
   I'd appreciate any insights.
 
 Thank you,
 Angela
 --
 PHP General Mailing List (http://www.php.net/)
 To unsubscribe, visit: http://www.php.net/unsub.php
 

Maybe Fail2ban is what you are looking for?
http://www.fail2ban.org/wiki/index.php/Main_Page

/frank
--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php



Re: [PHP] Detecting massive web hits

2013-04-12 Thread Matijn Woudt
On Fri, Apr 12, 2013 at 5:23 PM, Angela Barone
ang...@italian-getaways.comwrote:

 Does anyone know if there's a ready-made script that detects if
 someone hits multiple web pages within seconds of each other and then can
 temporarily ban them by IP from accessing our site?

 Looking through the logs, I see someone/something hit each and
 every page of a site I work on within only a few seconds of each other.  I
 seriously doubt they are a customer. ;)

 I'd appreciate any insights.

 Thank you,
 Angela


Just to be sure, are you sure it is not a spider? (Google, Bing, etc) You
can detect with the user agent.
If it is, you can most likely switch some settings.

- Matijn