[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
I find if you take it as the rule and not the exception it's much easier to plan. Seems that way lately with Twitter. :-) FWIW, I know you hate hearing this, but Facebook's API pushes changes into a beta staging environment every Tuesday, notifies developers of the changes as they update it, and takes feedback before they end up pushing changes out live. Hopefully Twitter is working on something similar. In the meantime, can there be a rule of no changes at the end of the week? Also, any word on lifting follow limits temporarily? Jesse On Sat, Sep 5, 2009 at 12:24 PM, Dewald Pretorius wrote: > > Ain't it a heap of fun to spend one's long weekend answering support > requests from agitated users, due to something you haven't done? LOL > > You're not alone in that boat. > > Dewald > > On Sep 5, 3:10 pm, PJB wrote: > > Why on EARTH must you guys consistently break things before every > > major holiday weekend?!? >
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Ain't it a heap of fun to spend one's long weekend answering support requests from agitated users, due to something you haven't done? LOL You're not alone in that boat. Dewald On Sep 5, 3:10 pm, PJB wrote: > Why on EARTH must you guys consistently break things before every > major holiday weekend?!?
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Actually, before yesterday, Twitter's friends_ids/followers_ids calls were pretty close to being accurate. Now, with this new fix, they are totally off from what is displayed on Twitter.com. So, whatever "fix" was made yesterday, has broken the accuracy of the count (where accuracy == matching the number on Twitter.com). On Sep 5, 8:26 am, Dewald Pretorius wrote: > All the time. I have given up on expecting consistency between summary > numbers and the actual detail data. > > Twitter has to do so much data replication for performance reasons, I > think it's extremely tough to keep everything in sync. > > It's like the discrepancies in search results and site rankings > between different Google data centers. > > Another summary number that messed up is the Direct Message count in > the Twitter sidebar. If you delete a large number of DMs via the API, > that number remains incorrect forever. My own has been showing 26 for > 4 months now, and in that time I have never had more than 3 DMs in my > Inbox. I've also seen some of the deleted DMs just "magically" > reappear again. > > Dewald > > On Sep 5, 11:52 am, Rudifa wrote: > > > Hello > > > I am seeing right now (14:45 UTC) discrepancy between the list of my > > followers as reported by my home page at Twitter.com (which is > > correct) and the list reported by the API - which seems to be several > > days old (it includes several followers that I blocked recently). > > > Is anyone else seeing this? > >
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
It seems as though you fixed one thing, and broke something else in the process. A large number of our users are complaining that the f/f counts (that we compute from friends_ids() for example) are woefully off (in the order of several thousand) from the counts displayed on Twitter.com. Before yesterday, it wasn't like this. The counts from friends_ids/ followers_ids were usually quite accurate; now they are totally inaccurate. Why on EARTH must you guys consistently break things before every major holiday weekend?!? On Sep 5, 6:55 am, John Kalucki wrote: > Thanks to the efforts of many working late into a Friday night, we > deployed a fix for this issue starting at about 11pm PDT. The fix was > verified as working in production at about 12:05am PDT. > > -John Kaluckihttp://twitter.com/jkalucki > Services, Twitter Inc. > > On Sep 5, 5:36 am, Dewald Pretorius wrote: > > > John, > > > Just so we know, is this 5,000 thing going to be fixed over the > > weekend, or will we have to wait until Tuesday? > > > Dewald > > > On Sep 5, 12:35 am, John Kalucki wrote: > > > > We're aware of the problem with the following API not returning more > > > than 5,000 followers. Apparently this call has recently been > > > unreliable was often timing out and returning 503s. A change to fix > > > the 503s limited the results to 5000 followers prematurely. We're > > > going to get this back to the >5000 followers, but with 503's state as > > > soon as we can, but we're fighting several fires at once tonight. > > > > More in a few minutes. > > > > -John > > > > On Sep 4, 7:56 pm, Dewald Pretorius wrote: > > > > > Not only do the social graph calls now suddenly, without any prior > > > > warning of announcement, return only 5,000 ids, it is messed up even > > > > when you do the paging as per the API documentation. > > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > > > the follower ids with &page, you get only 12,017 entries. > > > > > This is highly frustrating, and it has now completely screwed up my > > > > follower processing. It does not help that Twitter has rolled out > > > > something into production without any kind of testing, right before a > > > > weekend. > > > > > Dewald > >
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
John, thanks for spending time on this. Any chance we can get a lift on the follow limits for a temporary time so I can catch up a few users that were affected by this? Or, if you want to do it on a per-user basis I can send you the names of the users. Jesse On Sat, Sep 5, 2009 at 7:55 AM, John Kalucki wrote: > > Thanks to the efforts of many working late into a Friday night, we > deployed a fix for this issue starting at about 11pm PDT. The fix was > verified as working in production at about 12:05am PDT. > > -John Kalucki > http://twitter.com/jkalucki > Services, Twitter Inc. > > On Sep 5, 5:36 am, Dewald Pretorius wrote: > > John, > > > > Just so we know, is this 5,000 thing going to be fixed over the > > weekend, or will we have to wait until Tuesday? > > > > Dewald > > > > On Sep 5, 12:35 am, John Kalucki wrote: > > > > > We're aware of the problem with the following API not returning more > > > than 5,000 followers. Apparently this call has recently been > > > unreliable was often timing out and returning 503s. A change to fix > > > the 503s limited the results to 5000 followers prematurely. We're > > > going to get this back to the >5000 followers, but with 503's state as > > > soon as we can, but we're fighting several fires at once tonight. > > > > > More in a few minutes. > > > > > -John > > > > > On Sep 4, 7:56 pm, Dewald Pretorius wrote: > > > > > > Not only do the social graph calls now suddenly, without any prior > > > > warning of announcement, return only 5,000 ids, it is messed up even > > > > when you do the paging as per the API documentation. > > > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > > > the follower ids with &page, you get only 12,017 entries. > > > > > > This is highly frustrating, and it has now completely screwed up my > > > > follower processing. It does not help that Twitter has rolled out > > > > something into production without any kind of testing, right before a > > > > weekend. > > > > > > Dewald >
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
All the time. I have given up on expecting consistency between summary numbers and the actual detail data. Twitter has to do so much data replication for performance reasons, I think it's extremely tough to keep everything in sync. It's like the discrepancies in search results and site rankings between different Google data centers. Another summary number that messed up is the Direct Message count in the Twitter sidebar. If you delete a large number of DMs via the API, that number remains incorrect forever. My own has been showing 26 for 4 months now, and in that time I have never had more than 3 DMs in my Inbox. I've also seen some of the deleted DMs just "magically" reappear again. Dewald On Sep 5, 11:52 am, Rudifa wrote: > Hello > > I am seeing right now (14:45 UTC) discrepancy between the list of my > followers as reported by my home page at Twitter.com (which is > correct) and the list reported by the API - which seems to be several > days old (it includes several followers that I blocked recently). > > Is anyone else seeing this?
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Hello I am seeing right now (14:45 UTC) discrepancy between the list of my followers as reported by my home page at Twitter.com (which is correct) and the list reported by the API - which seems to be several days old (it includes several followers that I blocked recently). Is anyone else seeing this? On Sep 5, 4:09 pm, Dewald Pretorius wrote: > Awesome. Thanks John, and also to everyone who made this happen. > > Dewald > > On Sep 5, 10:55 am, John Kalucki wrote: > > > Thanks to the efforts of many working late into a Friday night, we > > deployed a fix for this issue starting at about 11pm PDT. The fix was > > verified as working in production at about 12:05am PDT. > > > -John Kaluckihttp://twitter.com/jkalucki > > Services, Twitter Inc. > > > On Sep 5, 5:36 am, Dewald Pretorius wrote: > > > > John, > > > > Just so we know, is this 5,000 thing going to be fixed over the > > > weekend, or will we have to wait until Tuesday? > > > > Dewald > > > > On Sep 5, 12:35 am, John Kalucki wrote: > > > > > We're aware of the problem with the following API not returning more > > > > than 5,000 followers. Apparently this call has recently been > > > > unreliable was often timing out and returning 503s. A change to fix > > > > the 503s limited the results to 5000 followers prematurely. We're > > > > going to get this back to the >5000 followers, but with 503's state as > > > > soon as we can, but we're fighting several fires at once tonight. > > > > > More in a few minutes. > > > > > -John > > > > > On Sep 4, 7:56 pm, Dewald Pretorius wrote: > > > > > > Not only do the social graph calls now suddenly, without any prior > > > > > warning of announcement, return only 5,000 ids, it is messed up even > > > > > when you do the paging as per the API documentation. > > > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > > > > the follower ids with &page, you get only 12,017 entries. > > > > > > This is highly frustrating, and it has now completely screwed up my > > > > > follower processing. It does not help that Twitter has rolled out > > > > > something into production without any kind of testing, right before a > > > > > weekend. > > > > > > Dewald
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Awesome. Thanks John, and also to everyone who made this happen. Dewald On Sep 5, 10:55 am, John Kalucki wrote: > Thanks to the efforts of many working late into a Friday night, we > deployed a fix for this issue starting at about 11pm PDT. The fix was > verified as working in production at about 12:05am PDT. > > -John Kaluckihttp://twitter.com/jkalucki > Services, Twitter Inc. > > On Sep 5, 5:36 am, Dewald Pretorius wrote: > > > John, > > > Just so we know, is this 5,000 thing going to be fixed over the > > weekend, or will we have to wait until Tuesday? > > > Dewald > > > On Sep 5, 12:35 am, John Kalucki wrote: > > > > We're aware of the problem with the following API not returning more > > > than 5,000 followers. Apparently this call has recently been > > > unreliable was often timing out and returning 503s. A change to fix > > > the 503s limited the results to 5000 followers prematurely. We're > > > going to get this back to the >5000 followers, but with 503's state as > > > soon as we can, but we're fighting several fires at once tonight. > > > > More in a few minutes. > > > > -John > > > > On Sep 4, 7:56 pm, Dewald Pretorius wrote: > > > > > Not only do the social graph calls now suddenly, without any prior > > > > warning of announcement, return only 5,000 ids, it is messed up even > > > > when you do the paging as per the API documentation. > > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > > > the follower ids with &page, you get only 12,017 entries. > > > > > This is highly frustrating, and it has now completely screwed up my > > > > follower processing. It does not help that Twitter has rolled out > > > > something into production without any kind of testing, right before a > > > > weekend. > > > > > Dewald
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Thanks to the efforts of many working late into a Friday night, we deployed a fix for this issue starting at about 11pm PDT. The fix was verified as working in production at about 12:05am PDT. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Sep 5, 5:36 am, Dewald Pretorius wrote: > John, > > Just so we know, is this 5,000 thing going to be fixed over the > weekend, or will we have to wait until Tuesday? > > Dewald > > On Sep 5, 12:35 am, John Kalucki wrote: > > > We're aware of the problem with the following API not returning more > > than 5,000 followers. Apparently this call has recently been > > unreliable was often timing out and returning 503s. A change to fix > > the 503s limited the results to 5000 followers prematurely. We're > > going to get this back to the >5000 followers, but with 503's state as > > soon as we can, but we're fighting several fires at once tonight. > > > More in a few minutes. > > > -John > > > On Sep 4, 7:56 pm, Dewald Pretorius wrote: > > > > Not only do the social graph calls now suddenly, without any prior > > > warning of announcement, return only 5,000 ids, it is messed up even > > > when you do the paging as per the API documentation. > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > > the follower ids with &page, you get only 12,017 entries. > > > > This is highly frustrating, and it has now completely screwed up my > > > follower processing. It does not help that Twitter has rolled out > > > something into production without any kind of testing, right before a > > > weekend. > > > > Dewald
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Using Twitter4J, and what I've been seeing is last night, getFollowersIDs(), including suspended. This AM, the filtering of suspended accounts seems to be working again. On the other hand, getFollowersStatuses() doesn't seem to be filtering out the suspended accounts. pg On Sep 5, 7:36 am, Dewald Pretorius wrote: > John, > > Just so we know, is this 5,000 thing going to be fixed over the > weekend, or will we have to wait until Tuesday? > > Dewald > > On Sep 5, 12:35 am, John Kalucki wrote: > > > We're aware of the problem with the following API not returning more > > than 5,000 followers. Apparently this call has recently been > > unreliable was often timing out and returning 503s. A change to fix > > the 503s limited the results to 5000 followers prematurely. We're > > going to get this back to the >5000 followers, but with 503's state as > > soon as we can, but we're fighting several fires at once tonight. > > > More in a few minutes. > > > -John > > > On Sep 4, 7:56 pm, Dewald Pretorius wrote: > > > > Not only do the social graph calls now suddenly, without any prior > > > warning of announcement, return only 5,000 ids, it is messed up even > > > when you do the paging as per the API documentation. > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > > the follower ids with &page, you get only 12,017 entries. > > > > This is highly frustrating, and it has now completely screwed up my > > > follower processing. It does not help that Twitter has rolled out > > > something into production without any kind of testing, right before a > > > weekend. > > > > Dewald
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
John, Just so we know, is this 5,000 thing going to be fixed over the weekend, or will we have to wait until Tuesday? Dewald On Sep 5, 12:35 am, John Kalucki wrote: > We're aware of the problem with the following API not returning more > than 5,000 followers. Apparently this call has recently been > unreliable was often timing out and returning 503s. A change to fix > the 503s limited the results to 5000 followers prematurely. We're > going to get this back to the >5000 followers, but with 503's state as > soon as we can, but we're fighting several fires at once tonight. > > More in a few minutes. > > -John > > On Sep 4, 7:56 pm, Dewald Pretorius wrote: > > > Not only do the social graph calls now suddenly, without any prior > > warning of announcement, return only 5,000 ids, it is messed up even > > when you do the paging as per the API documentation. > > > Case in point. @socialoomph has 16,598 followers. If you page through > > the follower ids with &page, you get only 12,017 entries. > > > This is highly frustrating, and it has now completely screwed up my > > follower processing. It does not help that Twitter has rolled out > > something into production without any kind of testing, right before a > > weekend. > > > Dewald
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Can Twitter remove the following per hour limit for a little bit after they fix this (at least for whitelisted IPs and/or OAuth)? This has caused us, and I'm sure many other apps to pre-emptively unfollow people that they were not supposed to. This is a BIG problem! I completely agree with Dewald's frustrations. If the limits can be removed after this for at least a short bit so we can make it back up to those users affected it would be sincerely appreciated. Jesse On Fri, Sep 4, 2009 at 8:56 PM, Dewald Pretorius wrote: > > Not only do the social graph calls now suddenly, without any prior > warning of announcement, return only 5,000 ids, it is messed up even > when you do the paging as per the API documentation. > > Case in point. @socialoomph has 16,598 followers. If you page through > the follower ids with &page, you get only 12,017 entries. > > This is highly frustrating, and it has now completely screwed up my > follower processing. It does not help that Twitter has rolled out > something into production without any kind of testing, right before a > weekend. > > Dewald >
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
Several months ago there were multiple subtle problems with consistency in following lists. We've since rolled to a new system that have numerous constraints in place to prevent duplicates and provide much stronger consistency guarantees. There is, however, a known issue around pagination. You may see some jitter as you page through a long list -- off by one errors. We're working to fix this to make pagination completely solid. If you are seeing duplicates that aren't on a page boundary, please let us know. -John On Sep 4, 8:42 pm, Howard Siegel wrote: > There have been times when a friend or follower id has been reported > multiple times. Did you check to see if any of the friend or follower ids > that you get back were duplicates? > > - h > > On Fri, Sep 4, 2009 at 20:17, Dewald Pretorius wrote: > > > For @dewaldp I get, via the API social graph methods with paging: > > Friends: 764 , Followers: 3,977. > > > While on my web profile the numbers are: Friends: 747 , Followers: > > 3,911. > > > On Sep 4, 11:56 pm, Dewald Pretorius wrote: > > > Not only do the social graph calls now suddenly, without any prior > > > warning of announcement, return only 5,000 ids, it is messed up even > > > when you do the paging as per the API documentation. > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > > the follower ids with &page, you get only 12,017 entries. > > > > This is highly frustrating, and it has now completely screwed up my > > > follower processing. It does not help that Twitter has rolled out > > > something into production without any kind of testing, right before a > > > weekend. > > > > Dewald
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
There have been times when a friend or follower id has been reported multiple times. Did you check to see if any of the friend or follower ids that you get back were duplicates? - h On Fri, Sep 4, 2009 at 20:17, Dewald Pretorius wrote: > > For @dewaldp I get, via the API social graph methods with paging: > Friends: 764 , Followers: 3,977. > > While on my web profile the numbers are: Friends: 747 , Followers: > 3,911. > > On Sep 4, 11:56 pm, Dewald Pretorius wrote: > > Not only do the social graph calls now suddenly, without any prior > > warning of announcement, return only 5,000 ids, it is messed up even > > when you do the paging as per the API documentation. > > > > Case in point. @socialoomph has 16,598 followers. If you page through > > the follower ids with &page, you get only 12,017 entries. > > > > This is highly frustrating, and it has now completely screwed up my > > follower processing. It does not help that Twitter has rolled out > > something into production without any kind of testing, right before a > > weekend. > > > > Dewald >
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
We're aware of the problem with the following API not returning more than 5,000 followers. Apparently this call has recently been unreliable was often timing out and returning 503s. A change to fix the 503s limited the results to 5000 followers prematurely. We're going to get this back to the >5000 followers, but with 503's state as soon as we can, but we're fighting several fires at once tonight. More in a few minutes. -John On Sep 4, 7:56 pm, Dewald Pretorius wrote: > Not only do the social graph calls now suddenly, without any prior > warning of announcement, return only 5,000 ids, it is messed up even > when you do the paging as per the API documentation. > > Case in point. @socialoomph has 16,598 followers. If you page through > the follower ids with &page, you get only 12,017 entries. > > This is highly frustrating, and it has now completely screwed up my > follower processing. It does not help that Twitter has rolled out > something into production without any kind of testing, right before a > weekend. > > Dewald
[twitter-dev] Re: Followers & Friends IDs Are Seriously MESSED Up!
For @dewaldp I get, via the API social graph methods with paging: Friends: 764 , Followers: 3,977. While on my web profile the numbers are: Friends: 747 , Followers: 3,911. On Sep 4, 11:56 pm, Dewald Pretorius wrote: > Not only do the social graph calls now suddenly, without any prior > warning of announcement, return only 5,000 ids, it is messed up even > when you do the paging as per the API documentation. > > Case in point. @socialoomph has 16,598 followers. If you page through > the follower ids with &page, you get only 12,017 entries. > > This is highly frustrating, and it has now completely screwed up my > follower processing. It does not help that Twitter has rolled out > something into production without any kind of testing, right before a > weekend. > > Dewald
