> -----Original Message----- > From: Matt Mahoney via AGI [mailto:[email protected]] > > On Tue, Oct 7, 2014 at 7:00 PM, John Rose via AGI <[email protected]> wrote: > > Have you ever seen a CAPTHA when doing Google queries? > > No, but I haven't written a program to send it millions of queries either. You > should try it and see what happens. >
You can lazily send Google queries from a single IP and crawl the results. You can lazily send Google millions of queries spread across thousands of IP's per minute even in bursts and crawl the results. If you originate millions of queries from a single IP or have some overly obvious correlators across your queries, or burst too much, you get throttled (in various ways). That's what happens. > I noticed once when I posted a lot of website links on Facebook, it started > sending me CAPTCHAs. They obviously have software to detect bot-like > behavior. Years ago when I taught a network programming class, one of my > assignments was for students to write a SMTP client in Java. I tested their > programs by using them to connect to Yahoo's servers to send me an email. As I > did this I probably triggered some intrusion detection software because Yahoo > started asking for my password a lot more often than usual. > It's all really about bots fighting over the non-bots (humans), there's literally silent wars being raged amongst the larger internet organizations, like developing a thick skin and an immune system over time is what you have to do in terms of isolating systems from bots. CAPTCHAs get more and more cryptic the next step in the game is to physically prove your human identity biometrically. Interesting though, what's a big differentiator between bots and humans? We have p-consciousness :) Is that the ultimate differentiator? John ------------------------------------------- AGI Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/21088071-f452e424 Modify Your Subscription: https://www.listbox.com/member/?member_id=21088071&id_secret=21088071-58d57657 Powered by Listbox: http://www.listbox.com
