[twitter-dev] Re: statuses/friends page count?
I'm experiencing the same issue with implu. With 14,408 follows, I should go up to page 145. However, the last page of data is 101 and 102 onwards returns nothing. http://twitter.com/statuses/friends/implu.xml?page=102 The following call does seem to return all the friends/ids however. http://twitter.com/friends/ids/implu.xml Any thoughts? On Jul 10, 10:47 am, Karthik Murugan fermis...@gmail.com wrote: It's also possible, that some intermediate pages return empty result set. Try this,http://twitter.com/statuses/followers.json?id=billcrosbypage=124 This profile has 44K followers and some of the intermediate pages return empty result sets. Not sure why, but my obvious guess is that all the followers in this page are suspended. So, empty result set doesn't mean that you are done with the traversal. I've modified my scripts to crawl N number of pages, where N is (number of followers/100). Total number of followers can be retrieved by users/show - Karthik On Jul 6, 11:31 pm, Doug Williams d...@twitter.com wrote: Duane,Yes, you will get an empty result set if you step off the end: doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=43; | grep /user | wc -l 100 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=44; | grep /user | wc -l 17 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=45; | grep /user | wc -l 0 Thanks, Doug -- Do you follow me?http://twitter.com/dougw On Mon, Jul 6, 2009 at 10:32 AM, Duane Roelands duane.roela...@gmail.comwrote: Do you ever get an empty response set? I was experimenting with the pagination and I found that if you request page 20 (for example) for someone who only has one page of friends, you simply get the page 1 response set. On Jul 6, 1:09 pm, Doug Williams d...@twitter.com wrote: You should either page throughstatuses/friendsuntil you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug
[twitter-dev] Re: statuses/friends page count?
Just as aside, does anyone know if each call to a new page counts against the API limit? On Jul 24, 8:08 am, st...@implu.com st...@implu.com wrote: I'm experiencing the same issue with implu. With 14,408 follows, I should go up to page 145. However, the last page of data is 101 and 102 onwards returns nothing. http://twitter.com/statuses/friends/implu.xml?page=102 The following call does seem to return all the friends/ids however. http://twitter.com/friends/ids/implu.xml Any thoughts? On Jul 10, 10:47 am, Karthik Murugan fermis...@gmail.com wrote: It's also possible, that some intermediate pages return empty result set. Try this,http://twitter.com/statuses/followers.json?id=billcrosbypage=124 This profile has 44K followers and some of the intermediate pages return empty result sets. Not sure why, but my obvious guess is that all the followers in this page are suspended. So, empty result set doesn't mean that you are done with the traversal. I've modified my scripts to crawl N number of pages, where N is (number of followers/100). Total number of followers can be retrieved by users/show - Karthik On Jul 6, 11:31 pm, Doug Williams d...@twitter.com wrote: Duane,Yes, you will get an empty result set if you step off the end: doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=43; | grep /user | wc -l 100 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=44; | grep /user | wc -l 17 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=45; | grep /user | wc -l 0 Thanks, Doug -- Do you follow me?http://twitter.com/dougw On Mon, Jul 6, 2009 at 10:32 AM, Duane Roelands duane.roela...@gmail.comwrote: Do you ever get an empty response set? I was experimenting with the pagination and I found that if you request page 20 (for example) for someone who only has one page of friends, you simply get the page 1 response set. On Jul 6, 1:09 pm, Doug Williams d...@twitter.com wrote: You should either page throughstatuses/friendsuntil you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug
[twitter-dev] Re: statuses/friends page count?
yes, each page request counts against the API limit On Fri, Jul 24, 2009 at 10:25 PM, Joseph northwest...@gmail.com wrote: Just as aside, does anyone know if each call to a new page counts against the API limit? On Jul 24, 8:08 am, st...@implu.com st...@implu.com wrote: I'm experiencing the same issue with implu. With 14,408 follows, I should go up to page 145. However, the last page of data is 101 and 102 onwards returns nothing. http://twitter.com/statuses/friends/implu.xml?page=102 The following call does seem to return all the friends/ids however. http://twitter.com/friends/ids/implu.xml Any thoughts? On Jul 10, 10:47 am, Karthik Murugan fermis...@gmail.com wrote: It's also possible, that some intermediate pages return empty result set. Try this, http://twitter.com/statuses/followers.json?id=billcrosbypage=124 This profile has 44K followers and some of the intermediate pages return empty result sets. Not sure why, but my obvious guess is that all the followers in this page are suspended. So, empty result set doesn't mean that you are done with the traversal. I've modified my scripts to crawl N number of pages, where N is (number of followers/100). Total number of followers can be retrieved by users/show - Karthik On Jul 6, 11:31 pm, Doug Williams d...@twitter.com wrote: Duane,Yes, you will get an empty result set if you step off the end: doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=43; | grep /user | wc -l 100 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=44; | grep /user | wc -l 17 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=45; | grep /user | wc -l 0 Thanks, Doug -- Do you follow me?http://twitter.com/dougw On Mon, Jul 6, 2009 at 10:32 AM, Duane Roelands duane.roela...@gmail.comwrote: Do you ever get an empty response set? I was experimenting with the pagination and I found that if you request page 20 (for example) for someone who only has one page of friends, you simply get the page 1 response set. On Jul 6, 1:09 pm, Doug Williams d...@twitter.com wrote: You should either page throughstatuses/friendsuntil you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug
[twitter-dev] Re: statuses/friends page count?
The API removes suspended accounts lazily at read time which is why you may receive incomplete pages (less users than the count parameter specifies). We are still working to report correct follower numbers in a timely matter which was the reason for last night's maintenance work (see http://status.twitter.com). Thanks, Doug On Fri, Jul 24, 2009 at 11:31 AM, Karthik Muruganfermis...@gmail.com wrote: yes, each page request counts against the API limit On Fri, Jul 24, 2009 at 10:25 PM, Joseph northwest...@gmail.com wrote: Just as aside, does anyone know if each call to a new page counts against the API limit? On Jul 24, 8:08 am, st...@implu.com st...@implu.com wrote: I'm experiencing the same issue with implu. With 14,408 follows, I should go up to page 145. However, the last page of data is 101 and 102 onwards returns nothing. http://twitter.com/statuses/friends/implu.xml?page=102 The following call does seem to return all the friends/ids however. http://twitter.com/friends/ids/implu.xml Any thoughts? On Jul 10, 10:47 am, Karthik Murugan fermis...@gmail.com wrote: It's also possible, that some intermediate pages return empty result set. Try this,http://twitter.com/statuses/followers.json?id=billcrosbypage=124 This profile has 44K followers and some of the intermediate pages return empty result sets. Not sure why, but my obvious guess is that all the followers in this page are suspended. So, empty result set doesn't mean that you are done with the traversal. I've modified my scripts to crawl N number of pages, where N is (number of followers/100). Total number of followers can be retrieved by users/show - Karthik On Jul 6, 11:31 pm, Doug Williams d...@twitter.com wrote: Duane,Yes, you will get an empty result set if you step off the end: doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=43; | grep /user | wc -l 100 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=44; | grep /user | wc -l 17 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=45; | grep /user | wc -l 0 Thanks, Doug -- Do you follow me?http://twitter.com/dougw On Mon, Jul 6, 2009 at 10:32 AM, Duane Roelands duane.roela...@gmail.comwrote: Do you ever get an empty response set? I was experimenting with the pagination and I found that if you request page 20 (for example) for someone who only has one page of friends, you simply get the page 1 response set. On Jul 6, 1:09 pm, Doug Williams d...@twitter.com wrote: You should either page throughstatuses/friendsuntil you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug
[twitter-dev] Re: statuses/friends page count?
I suspect this lazy updating of the summary data (follower counts) explains why people keep saying I used Twitter Karma, and all of a sudden I lost hundreds of followers! :-) On 7/24/09 4:39 PM, Doug Williams wrote: The API removes suspended accounts lazily at read time which is why you may receive incomplete pages (less users than the count parameter specifies). We are still working to report correct follower numbers in a timely matter which was the reason for last night's maintenance work (see http://status.twitter.com). -- Dossy Shiobara | do...@panoptic.com | http://dossy.org/ Panoptic Computer Network | http://panoptic.com/ He realized the fastest way to change is to laugh at your own folly -- then you can let go and quickly move on. (p. 70)
[twitter-dev] Re: statuses/friends page count?
On Jul 6, 9:09 pm, Doug Williams d...@twitter.com wrote: You should either page through statuses/friends until you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Ok, thank you, so it's the 'official' method. But I am still curious, can't all friends on a page be filtered out? -- Dmitriy V'jukov
[twitter-dev] Re: statuses/friends page count?
It's also possible, that some intermediate pages return empty result set. Try this, http://twitter.com/statuses/followers.json?id=billcrosbypage=124 This profile has 44K followers and some of the intermediate pages return empty result sets. Not sure why, but my obvious guess is that all the followers in this page are suspended. So, empty result set doesn't mean that you are done with the traversal. I've modified my scripts to crawl N number of pages, where N is (number of followers/100). Total number of followers can be retrieved by users/show - Karthik On Jul 6, 11:31 pm, Doug Williams d...@twitter.com wrote: Duane,Yes, you will get an empty result set if you step off the end: doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=43; | grep /user | wc -l 100 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=44; | grep /user | wc -l 17 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=45; | grep /user | wc -l 0 Thanks, Doug -- Do you follow me?http://twitter.com/dougw On Mon, Jul 6, 2009 at 10:32 AM, Duane Roelands duane.roela...@gmail.comwrote: Do you ever get an empty response set? I was experimenting with the pagination and I found that if you request page 20 (for example) for someone who only has one page of friends, you simply get the page 1 response set. On Jul 6, 1:09 pm, Doug Williams d...@twitter.com wrote: You should either page through statuses/friends until you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug
[twitter-dev] Re: statuses/friends page count?
You should either page through statuses/friends until you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug On Mon, Jul 6, 2009 at 1:39 AM, Dmitriy Vyukov dvyu...@gmail.com wrote: Hi! It's unclear how I must determine how many pages retrieve via statuses/ friends. First guess was to fetch until I will retrieve page with 0 friends. However documentation says that there can be arbitrary number of friends per page because of the filtered out friends. So I guess I can receive page with 0 friends just because there are all filtered out. Or you will handle such case internally and never send me a page with 0 friends? What is the official way? Also my bet that pages start at 1, but I think it's worth adding into docs. Thank you. -- Dmitriy V'jukov
[twitter-dev] Re: statuses/friends page count?
Do you ever get an empty response set? I was experimenting with the pagination and I found that if you request page 20 (for example) for someone who only has one page of friends, you simply get the page 1 response set. On Jul 6, 1:09 pm, Doug Williams d...@twitter.com wrote: You should either page through statuses/friends until you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug
[twitter-dev] Re: statuses/friends page count?
Duane,Yes, you will get an empty result set if you step off the end: doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=43; | grep /user | wc -l 100 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=44; | grep /user | wc -l 17 doug-williamss-macbook-pro:~ igudo$ curl -u dougw:PASSWORD http://twitter.com/statuses/followers.xml?count=100page=45; | grep /user | wc -l 0 Thanks, Doug -- Do you follow me? http://twitter.com/dougw On Mon, Jul 6, 2009 at 10:32 AM, Duane Roelands duane.roela...@gmail.comwrote: Do you ever get an empty response set? I was experimenting with the pagination and I found that if you request page 20 (for example) for someone who only has one page of friends, you simply get the page 1 response set. On Jul 6, 1:09 pm, Doug Williams d...@twitter.com wrote: You should either page through statuses/friends until you get an empty response set or use statuses/show to get the number of friends expected and intelligently page to the end of the list. Thanks, Doug
