On Sep 6, 2017 4:09 PM, "Ken Fallon" <[email protected]> wrote: http://www.webhostingtalk.com/showthread.php?t=924727
That thread is so funny. People really don't bother to read the full tread before they post, do they? - Using robots.txt didn't help, so here's how I detect and redirect that bot. - Dude use robots.txt - IP block! - I redirected instead. - Dude you really should be using robots txt. - Here's how I IP block! :-D Some people seem to believe that text file has magical powers. I didn't get this part: > One more thing: it identifies as client, not as bot !! Google and Yahoo identified as bots ! What are they talking about? Is there anything aside from the user agent that indicates what the client is? -- /c
_______________________________________________ Hpr mailing list [email protected] http://hackerpublicradio.org/mailman/listinfo/hpr_hackerpublicradio.org
