On the TODO list: http://groups.google.com/group/twitter-development-talk/browse_thread/thread/515733c625904ed8/
Another reason to to screen scrape is that building an entire HTML page uses a lot more resources then just returning XML/json. On Tue, Feb 9, 2010 at 10:19, Orian Marx (@orian) <or...@orianmarx.com>wrote: > Agree that scrapping is a bad idea. The question is, why has this > particular piece of data (list counts) been available on twitter.com > since the lists rollout but exists nowhere in the API. It seems like > an oversight, which is why developers are trying to be helpful by > logging issues in the issue tracker. There's really no excuse for the > fact that no one from Twitter has responded to the logged issue at > all, and it was logged almost immediately after the rollout. > > On Feb 9, 1:10 pm, Cameron Kaiser <spec...@floodgap.com> wrote: > > > Why would my IP get banned - the API allows developers to retrieve > > > almost every piece of data from user's twitter profiles so developers > > > don't need to scrape. I think if it's a closed site and they want to > > > protect content, then I can understand IP banning but if it's an open > > > system like Twitter, I don't see any reason why my IP would get > > > banned. > > > > > Maybe someone from the Twitter Platform team can chime in, especially > > > since I only scrape for list counts every 4-6 hours on a small set of > > > users for my application. > > > > That's probably why they haven't noticed you (yet). However, screen > > scraping gets around rate limiting and other controls Twitter places on > > the API. That's not exactly considered socially agreeable, and it's not > > fair on other API consumers. It's also against TOS. > > > > https://twitter.com/tos > > > > -- > > ------------------------------------ personal: > http://www.cameronkaiser.com/-- > > Cameron Kaiser * Floodgap Systems *www.floodgap.com* > ckai...@floodgap.com > > -- It would have been funnier if I didn't have to think. -- Ashley Mills > ------ > -- Abraham Williams | Community Advocate | http://abrah.am Project | Out Loud | http://outloud.labs.poseurtech.com This email is: [ ] shareable [x] ask first [ ] private.
