I cheated horribly. My app calls a PHP file on another server and the PHP file does a Curl. Was really easy to setup, because I just used the Twitter API PHP example, and added some security on the PHP so that only Appengine could hit it, and only if it new the rotating secret.
-brandon From: [email protected] [mailto:[email protected]] On Behalf Of Nischal Shetty Sent: Thursday, April 07, 2011 10:42 PM To: [email protected] Subject: Re: [google-appengine] Being rate limited at twitter due to some rogue app on GAE, can u shift my app to different ip range? Sigh :( Long day ahead for me. What proxy did you use? Have you documented your experience (of setting up a proxy) somewhere? Can you point me to something I can use? -N On 8 April 2011 11:08, Brandon Wirtz <[email protected]> wrote: Been there, argued with Ev about why this was worth having someone fix, resolved issue using a proxy. Down side is the proxy will likely cost you by the gig transferred and you have to pay the appengine price for traffic as well, so your costs go up, but it resolves the issue. Plus in a world where IP's are now in limited supply buying an IP somewhere is worth doing if you rely on API's from others. From: [email protected] [mailto:[email protected]] On Behalf Of Nischal Shetty Sent: Thursday, April 07, 2011 10:33 PM To: [email protected] Subject: Re: [google-appengine] Being rate limited at twitter due to some rogue app on GAE, can u shift my app to different ip range? Yes, they aren't whitelisting apps based on id and that sucks. I'm not using the search API, I'm making use of authenticated API calls against each user and it has been working well (my app makes thousands of reqs per hour). There actually is no rate limit on the calls I make (they are posts not get and twitter puts limits on gets). But, the twitter API team said that at times when there are excessive requests, they block these calls as well. I'm guessing there's some other app that is making a lot of post requests that are similar to mine. I don't know how to get over this. Right now I'm trying to move these calls over to some other server, been working on it. But, I love the appengine, I want to be here :( Is there no way you can make my app use some other ip range, that might help. -N On 8 April 2011 10:17, Nick Johnson (Google) <[email protected]> wrote: Hi Nischal, Are you using the search API, or one of the other APIs? The Search API doesn't require authentication, and so is limited by IP range. The most likely explanation is not a single badly behaving app - it's simply that there are a lot of App Engine apps that want to communicate with Twitter. This is a problem with any service that doesn't have dedicated IPs for each customer - and that's only going to get worse with the exhaustion of the IPv4 address space, unfortunately. We provide the App ID in the referer header so services like Twitter can distinguish requests from different apps for the purpose of ratelimiting and abuse detection, but Twitter haven't implemented anything to break apps out on this basis. -Nick Johnson On Fri, Apr 8, 2011 at 11:33 AM, nischalshetty <[email protected]> wrote: Hi, My app has been facing limit issues with the twitter API and under regular circumstances this should not have happened. I've been in talks with the twitter API team from the last 36 hours and they checked things on their end. They say that the most probable cause is some app on the same ip range as my app which might be making a lot of requests causing my app to be rate limited in the process. I don't know what a quick solution to this is but I might have to move away from appengine because my app is unusable right now. My app has been running from the last 1 year on the appengine and has 200k+ users. I need your help :( My app id is "justunfollow" . Is there any way you can move it to a different ip range? -Nischal -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected] <mailto:google-appengine%[email protected]> . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected] <mailto:google-appengine%[email protected]> . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- -Nischal +91-9920240474 twitter: NischalShetty <http://twitter.com/nischalshetty> facebook: Nischal <http://facebook.com/nischal> <http://www.justunfollow.com/> Description: Description: Image removed by sender. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected] <mailto:google-appengine%[email protected]> . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected] <mailto:google-appengine%[email protected]> . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- -Nischal +91-9920240474 twitter: NischalShetty <http://twitter.com/nischalshetty> facebook: Nischal <http://facebook.com/nischal> <http://www.justunfollow.com/> Description: Image removed by sender. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
<<image001.jpg>>
<<image002.jpg>>
