[twitter-dev] Search API cache HELP

2009-09-04 Thread pxpilot

From time to time some new Tweets would not be included in the query
result, it seems like cache on the query on twitter side but it
doesn't make any sense.
For example right now 
http://search.twitter.com/search.atom?q=+nyfw+OR+%23nyfw+from%3AThisThatBeautyrpp=20
does not include the last 2 tweets that meet the search criteria.
If I change the query to 
http://search.twitter.com/search.atom?q=+nyfw+from%3AThisThatBeautyrpp=20
it will include those tweets but later this query may have the same
issue with newer tweets not returned.
I have tried many: including/excluding the rpp param, including/
excluding the page=1 param, adding some random number at the end of
the query to override local caching, etc. however nothing works.

Ideas?


[twitter-dev] Re: Search API Rate Limiting and Performance

2009-09-04 Thread pxpilot

Search API will rock if it would only be reliable

what we see looks to be some sort of a funky cache,  a query (atom)
can be missing some latest tweets and then after a while they show up,
if you tweak the query you can see 'em.

you ever seen this problem?
also what did you do special with user agent?

On Sep 2, 12:12 pm, Amitab hiamita...@gmail.com wrote:
 I have exchanged emails with Twitter on this and I believe they are
 working on it.

 We use search extensively atwww.Twaller.com. The errors in search
 that we are seing is as follows:

 (1) HTTP status code: 403
      Message:The request is understood, but it has been refused.  An
 accompanying error message will explain why.

 (2)HTTP status code: 503
 Message:Service Unavailable: The Twitter servers are up, but
 overloaded with requests. Try again later. The search and trend
 methods use this to indicate when you are being rate limited.

 (3) HTTP status code: -1
 Message:Read timed out

 These errors are becoming more and more frequent lately.

 /Amitab

 On Sep 1, 5:41 pm, Dewald Pretorius dpr...@gmail.com wrote:

  Twitter team, can you please do something about the performance and
  rate limiting of the Search API.

  It is becoming completely unworkable. I have jumped through all the
  hoops, with unique User Agents, sleeping my scripts in-between API
  calls, and yet the rate limiting is just becoming more severe, and the
  performance is just becoming slower and slower.

  Please help. A lot of us are using Search to provide services, and I
  am sure it is not only my service that is hurting very much under the
  present circumstances.

  Dewald


[twitter-dev] search.twitter atom cache

2009-08-30 Thread pxpilot

Hi,
my web application shows tweets based on atom search result, my
parameters include a search term and a list of users to include.

example: http://search.twitter.com/search.atom?q=[SEARCH TERM]+from%3A
[USER-1]+OR+from%3A[USER-2]+OR+from%3A[USER-3]rpp=100

The first time I run it everything is great, however if i run it again
i get the same results even if new tweets that qualify to the search
are posted. if i tweak the search URL (add a user or such) i get the
new tweet.

It seems there's a cache on the query but how do i get rid of it?