[twitter-dev] Search Api limit

2011-06-24 Thread Alessandro
Hi

I'm using the search api (for example:
http://search.twitter.com/search.rss?q=%23juventusrpp=100page=4)
I read here: http://search.twitter.com/api/ this:

We do not rate limit the search API under ordinary circumstances,
however we have put measures in place to limit the abuse of our API.
If you find yourself encountering these limits, please contact us and
describe your app's requirements.

The limit seems random: sometimes I do 150 requests sometimes 300,
generally, after 5 minutes I can do other requests.

I was wondering if is it possible do more requests

-- 
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


Re: [twitter-dev] Search Api limit

2011-06-24 Thread Matt Harris
Hi Alessandro,

We've produced a small guide on using search that explains the search rate
limits a little more.

You can find the page here:
https://dev.twitter.com/pages/using_search

In it we say:

The Rate Limits for the Search API are not the same as for the REST API.
When using the Search API you are not restricted by a certain number of API
requests per hour, but instead by the complexity and frequency.

As requests to the Search API are anonymous, the rate limit is measured
against the requesting client IP.

To prevent abuse the rate limit for Search is not published. If you are rate
limited, the Search API will respond with an HTTP 420 Error. {error:You
have been rate limited. Enhance your calm.}.


I hope that explains what is going on,
@themattharris https://twitter.com/intent/follow?screen_name=themattharris
Developer Advocate, Twitter



On Fri, Jun 24, 2011 at 2:08 AM, Alessandro alessandro.marrone...@gmail.com
 wrote:

 Hi

 I'm using the search api (for example:
 http://search.twitter.com/search.rss?q=%23juventusrpp=100page=4)
 I read here: http://search.twitter.com/api/ this:

 We do not rate limit the search API under ordinary circumstances,
 however we have put measures in place to limit the abuse of our API.
 If you find yourself encountering these limits, please contact us and
 describe your app's requirements.

 The limit seems random: sometimes I do 150 requests sometimes 300,
 generally, after 5 minutes I can do other requests.

 I was wondering if is it possible do more requests

 --
 Twitter developer documentation and resources: https://dev.twitter.com/doc
 API updates via Twitter: https://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 https://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 https://groups.google.com/forum/#!forum/twitter-development-talk


-- 
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


Re: [twitter-dev] search api limit

2011-05-19 Thread Alex Feinberg
Hi, Max,

First of all, this is just from personal experience with my own application,
so, take it with all the necessary grains of salt about rate limits changing
based on traffic and time of day, your searches being different from mine,
etc, etc.

My experience has been that I tend not to run into trouble if I can stay
under 20 search API requests per minute, and that if I do go over, I'm
typically only rate-limited for a few minutes. So, if you can either reduce
the frequency of your search calls to every 15 seconds instead of every 10,
or can tolerate a few of them failing once in a while, you should be fine.

You mention four different CPU's -- are they searching for different things?
If so, you might consider just having one CPU do a single search request
every 10 seconds, stringing the four original searches together with OR's --
I've had great success using this method to batch what would've been up to
50 different searches into a single API call.

You mention an art installation -- if your problem is that you've got the
software to put interesting twitter-driven graphics on one monitor with one
CPU, but your installation needs four monitors, so, it's easiest to just run
the same software on four different CPU's, I'd say this is exactly the kind
of scenario where Twitter would encourage you to make more efficient use of
the API calls. Were I in your shoes, I'd think about setting up one master
server, which would run a script to search Twitter every 10 seconds and dump
the resulting JSON into a flat file. The master would also be running Apache
to serve that flat file up over HTTP, and any number of slave machines
showing interesting graphics could hit your master server instead of
Twitter. Other than changing what URL they hit for data, you wouldn't have
to change the show-interesting-graphics code at all, since the master would
be serving up the exact same data the slaves would've gotten from Twitter
directly.

Best of luck,
-Alex

On Thu, May 19, 2011 at 6:26 AM, Max maxdo...@googlemail.com wrote:

 Hello, for an art installation i will be having 4 cpus running the
 search twitter query (search.twitter.com) . because the rate limit is
 not made public, if you could authorize my proposed request frequency.
 if i have each computer (on the same IP adress) calling the search api
 every 10 seconds, that comes to 1440 calls per hour (from the same Ip
 adress) whilst also simultaneously running the sample stream (on each
 cpu) . would this be allowed?

 it would be between June 16th and June 24th,  continuously during day
 time hours.

 thanks alot.

 max

 maxdo...@gmail.com

 --
 Twitter developer documentation and resources: https://dev.twitter.com/doc
 API updates via Twitter: https://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 https://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 https://groups.google.com/forum/#!forum/twitter-development-talk




-- 

Alex Feinberg
CTO, Trak.ly
http://trak.ly/

-- 
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk


Re: [twitter-dev] search api limit

2011-05-19 Thread Arnaud Meunier
Hey Max,

That looks pretty extreme! What's your use case? Why would you need to make
that much queries? Are you going to use the Search API or the website? If
you're using the API, Did you consider using the Streaming API
statuses/filter method with the track parameter?
http://dev.twitter.com/pages/streaming_api_methods#statuses-filter

All the best,
Arnaud / @rno http://twitter.com/rno



On Thu, May 19, 2011 at 6:26 AM, Max maxdo...@googlemail.com wrote:

 Hello, for an art installation i will be having 4 cpus running the
 search twitter query (search.twitter.com) . because the rate limit is
 not made public, if you could authorize my proposed request frequency.
 if i have each computer (on the same IP adress) calling the search api
 every 10 seconds, that comes to 1440 calls per hour (from the same Ip
 adress) whilst also simultaneously running the sample stream (on each
 cpu) . would this be allowed?

 it would be between June 16th and June 24th,  continuously during day
 time hours.

 thanks alot.

 max

 maxdo...@gmail.com

 --
 Twitter developer documentation and resources: https://dev.twitter.com/doc
 API updates via Twitter: https://twitter.com/twitterapi
 Issues/Enhancements Tracker:
 https://code.google.com/p/twitter-api/issues/list
 Change your membership to this group:
 https://groups.google.com/forum/#!forum/twitter-development-talk


-- 
Twitter developer documentation and resources: https://dev.twitter.com/doc
API updates via Twitter: https://twitter.com/twitterapi
Issues/Enhancements Tracker: https://code.google.com/p/twitter-api/issues/list
Change your membership to this group: 
https://groups.google.com/forum/#!forum/twitter-development-talk