[PHP] page suck attack
Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] page suck attack
Search engines indexing your site? On Wed, May 21, 2008 at 11:54 AM, robert [EMAIL PROTECTED] wrote: Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] page suck attack
On Wed, May 21, 2008 at 11:54 AM, robert [EMAIL PROTECTED] wrote: Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php Are you talking about a DOS attack? (Denial of Service) -- this is usually where your site is flooded with hits and you can't get to it because its overloaded. -- -Dan Joseph www.canishosting.com - Plans start @ $1.99/month. Reseller plans and Dedicated servers available. Build a man a fire, and he will be warm for the rest of the day. Light a man on fire, and will be warm for the rest of his life.
Re: [PHP] page suck attack
One thing you might want to check for before blocking it is looking in the logs and checking to see if it is one of the search engines that is grabbing your URL's... Which I would think you actually want :) On May 21, 2008, at 11:54 AM, robert wrote: Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- Jason Pruim Raoset Inc. Technology Manager MQC Specialist 3251 132nd ave Holland, MI, 49424-9337 www.raoset.com [EMAIL PROTECTED] -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] page suck attack
Hmmm, sounds like a search engine scan, Google or Yahoo Slurpy? Do a reverse lookup on the requesting IP. I would think the goal would be to get this increased? You can stop it (or control it a bit) by placing a robots.txt file in the root directory, then telling the robot which paths not to follow (you can google for how to do this). Warren -Original Message- From: robert [mailto:[EMAIL PROTECTED] Sent: Wednesday, May 21, 2008 8:54 AM To: PHP Subject: [PHP] page suck attack Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] page suck attack
Not that i can tell. Yahoo and google have a signature: googlebot and slurp. both of them also check my site over a span of days. that's all good. The others come from regular isps as far as their IP tells me and the hits are within milliseconds. On May 21, 2008, at 8:57 AM, Gavin M. Roy wrote: Search engines indexing your site? On Wed, May 21, 2008 at 11:54 AM, robert [EMAIL PROTECTED] wrote: Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RES: [PHP] page suck attack
Perhaps someone is accessing your website with some prefetching tool? I'm not sure, but I think Fasterfox does that. Atenciosamente, www.softpartech.com.br Thiago Henrique Pojda Desenvolvimento Web +55 41 3033-7676 [EMAIL PROTECTED] Excelência em Softwares Financeiros -Mensagem original- De: robert [mailto:[EMAIL PROTECTED] Enviada em: quarta-feira, 21 de maio de 2008 13:05 Para: PHP Assunto: Re: [PHP] page suck attack Not that i can tell. Yahoo and google have a signature: googlebot and slurp. both of them also check my site over a span of days. that's all good. The others come from regular isps as far as their IP tells me and the hits are within milliseconds. On May 21, 2008, at 8:57 AM, Gavin M. Roy wrote: Search engines indexing your site? On Wed, May 21, 2008 at 11:54 AM, robert [EMAIL PROTECTED] wrote: Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] page suck attack
Can you check your logs and look at the user agent for what's making the connections? Could it just be a search engine crawler indexing your pages? You can control access, usually, via a robots.txt exclusion file. If it's someone else mirroring your site for some reason, some programs that do this will obey robots.txt settings. If it's happening a lot and degrading the performance of your web server, then it may be a DOS (denial of service) attack. By the basic description you gave, it doesn't sound like an attack. -TG - Original Message - From: robert [EMAIL PROTECTED] To: PHP php-general@lists.php.net Date: Wed, 21 May 2008 08:54:20 -0700 Subject: [PHP] page suck attack Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: RES: [PHP] page suck attack
Cool! yes Fasterfox could be it. If anyone cares, it also gave me some clues to what I was looking for: offline browsing. Certainly better keywords than page suck :) thank you everyone! On May 21, 2008, at 10:02 AM, Thiago Pojda wrote: Perhaps someone is accessing your website with some prefetching tool? I'm not sure, but I think Fasterfox does that. Atenciosamente, www.softpartech.com.br Thiago Henrique Pojda Desenvolvimento Web +55 41 3033-7676 [EMAIL PROTECTED] Excelência em Softwares Financeiros -Mensagem original- De: robert [mailto:[EMAIL PROTECTED] Enviada em: quarta-feira, 21 de maio de 2008 13:05 Para: PHP Assunto: Re: [PHP] page suck attack Not that i can tell. Yahoo and google have a signature: googlebot and slurp. both of them also check my site over a span of days. that's all good. The others come from regular isps as far as their IP tells me and the hits are within milliseconds. On May 21, 2008, at 8:57 AM, Gavin M. Roy wrote: Search engines indexing your site? On Wed, May 21, 2008 at 11:54 AM, robert [EMAIL PROTECTED] wrote: Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] page suck attack
robert wrote: Not that i can tell. Yahoo and google have a signature: googlebot and slurp. both of them also check my site over a span of days. that's all good. The others come from regular isps as far as their IP tells me and the hits are within milliseconds. Hi, Are the URL's legit? Or are there URL's being called that cause 404 errors? Since there are bots out there scanning for vulnerable paths, like phpMyAdmin, phpBB, cgi-bin exploits etc. -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: RES: [PHP] page suck attack
On Wed, May 21, 2008 at 8:51 PM, robert [EMAIL PROTECTED] wrote: Cool! yes Fasterfox could be it. If anyone cares, it also gave me some clues to what I was looking for: offline browsing. Certainly better keywords than page suck :) thank you everyone! Well, site rippers is a more suitable name today, as most people are on fast DSL/cable connections so no need for offline browsing. Those days are gone.. sigh! Is your site content-heavy? It could be someone trying to download your site's content to use for whatever reason it might be, or it might be just a script kiddie trying enjoying his time. Anyway you should it take it seriously and investigate the information available at your hand about the source and cause of these actions. Here's a nice tutorial on how to deal with these scripts by blocking them through the use of robots.txt and .htaccess. It's a part of a series so you'd better start from the first part. Regards, Usamah
Re: RES: [PHP] page suck attack
Sorry, the link: http://www.javascriptkit.com/howto/htaccess13.shtml Usamah On Thu, May 22, 2008 at 1:15 AM, Usamah M. Ali [EMAIL PROTECTED] wrote: On Wed, May 21, 2008 at 8:51 PM, robert [EMAIL PROTECTED] wrote: Cool! yes Fasterfox could be it. If anyone cares, it also gave me some clues to what I was looking for: offline browsing. Certainly better keywords than page suck :) thank you everyone! Well, site rippers is a more suitable name today, as most people are on fast DSL/cable connections so no need for offline browsing. Those days are gone.. sigh! Is your site content-heavy? It could be someone trying to download your site's content to use for whatever reason it might be, or it might be just a script kiddie trying enjoying his time. Anyway you should it take it seriously and investigate the information available at your hand about the source and cause of these actions. Here's a nice tutorial on how to deal with these scripts by blocking them through the use of robots.txt and .htaccess. It's a part of a series so you'd better start from the first part. Regards, Usamah
Re: [PHP] page suck attack
robert wrote: Hi Every so often my site is attacked in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to research it to know my options. thank you robert Each of our websites get a page sucked about every 5 seconds from Google alone. Sometimes seems a little aggressive but I'd rather they be indexing our websites than not. Other spiders are usually more moderate in my experience. I usually make sure my robots.txt blocks downloading css, scripting, images, and files by spiders so at least all they're getting is the HTML content that is actually useful. -- Michael McGlothlin Southwest Plumbing Supply smime.p7s Description: S/MIME Cryptographic Signature
