[This is all somewhat off-topic] > Well, this is interesting... > > I think Yahoo also have this kind of functions, sometimes ago, I have > a spider to check for the stock's price, and Yahoo blocked me for > spiding one hour later... > > funny?
We use Yahoo! Financial site to get stock prices (they provide an old-school style 'web service' for this very purpose) for a client project and we've never been shut down. If you are writing spiders you should play nice with others' servers. I can't think of any reason that a stock quote checker would have to check the price often enough to get shut down within an hour. Too many requests from a single IP is considered a Denial-of-Service attack. Interestingly when MSN re-engineered their spider a couple years ago it was doing exactly that. For some reason whenever they re-built the spider code it appeared that it would hit the same sites (chosen at random from the Net). Thus some poor webmasters were getting hundreds of thousands of requests from the spider every day. Of course they've resolved that since then. -- Jeremy Wadsack Seven Simple Machines +------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +------------------------------------------------------------------------
