Hi Everyone,
I've been running my script as a cron task (every 15 minutes) since
last evening. So far I've got about 1375 results logged, out of which
973 are duplicates (meaning "stale" entries)...a staggering  70.7076%
or approximately 71%. This is way more than expected..so a shout out
to the development team - Is there anyway to solve this problem, get
around it ?
@Diego, thanks a lot for confirming what I found. Also I tried
querying frequently like you suggested, and yes I do hit "good"
results more frequently. I didn't get the idea of the least
significant decimal - are u referring to the geocode?

@twitter dev team
I do agree with Diego, there is got to be a way of getting "good"
search results without finding ways to "trick" the API. Even with a
cache, I see no reason why I should be getting results from over 6
hours ago for my search query.

Regards,
Elroy

On Nov 28, 10:16 pm, dbasch <dba...@gmail.com> wrote:
> Hi Elroy,
>
> I tried your query from python several times within the same minute.
> After running the query several times in a row I start getting fresh
> results and they remain fresh for a while. I tried changing the least
> significant decimal to make it a different query and I get stale
> results immediately. Switching back yields fresh results.
>
> This to me suggests that there may be two search tiers: one for low-
> frequency queries that probably searches a subset of tweets, and
> another one for frequent ones that searches everything and has an LRU
> cache of important queries. It seems that we can force queries into
> the LRU cache of the "good" tier by querying frequently enough. When I
> stop querying for three minutes or so I see the old results again. The
> question for the search team is how to have your query treated as an
> "important" one without abusing the API.
>
> Diego
>
> Diego
>
> On Nov 28, 1:18 pm, enygmatic <enygma...@gmail.com> wrote:
>
> > I got some requests to post the query that I am using:
> > here is the query 
> > :http://search.twitter.com/search.atom?geocode=19.017656%2C72.856178%2...
> > Do correct me if I am not querying or using the API correctly. (Should
> > have been my first question actually :) )
>
> > Also here is a sample of the output from my ruby script. It will give
> > you an idea of the "stale" results that I am getting. The script was
> > run at approximately 21:37 IST.  As you can see, I'm getting tweets
> > all the way back to 14:00 hours in the afternoon. I'm pretty sure
> > there are more tweets for my location. I'm querying for tweets
> > originating out of Mumbai, and by querying through twitter search I
> > have noticed that there are at least 40-50 tweets posted every 2
> > minutes or so.
> > Output follows: Date-Day-Hour-Minute-Tweet-User-Hashtags(csv, if any)-
> > source of tweet (All date/time info below is in IST)
> > 2009-11-28      Saturday        21      27     �...@abhishek_rai I too am 
> > huge fan of
> > quizzing.. do let me kno if u find anythin interesting. ty
> > Shakti_Shetty (Shakti Shetty)           web
> > 2009-11-28      Saturday        21      21     �...@surubhi hallow darlin, 
> > 'm fine doin
> > great...how about u?    dacku87 (darshan thacker)               mobile web
> > 2009-11-28      Saturday        20      40      powai mocha so full of 
> > people, smaloe
> > conversations and music..       sumagambs (Sumit Singh Gambhir)         web
> > 2009-11-28      Saturday        20      25     �...@thetruboy idk we'll 
> > see. Ari should be home
> > by then ronniebaby010 (Princess)                UberTwitter
> > 2009-11-28      Saturday        19      54      friends do look 
> > upwww.clickthehorror.com-
> > the website for my new film distirbuted by PNC has been launched -
> > look 4ward to feedbacks ....    sangeethsivan (sangeeth sivan)          web
> > 2009-11-28      Saturday        19      54      I'm guessing @Netra and 
> > @prolificd are the
> > two few Twitterers who've had multi-city tweetups. How cool is that.
> > National figures!       b50 (Bombay Addict)             Tweetie
> > 2009-11-28      Saturday        19      36      RT: Trupti's Blog: What 
> > Commercial Floor
> > Mats Offer: One of the best ways to keep any p..http://bit.ly/6sZWJg
> > #blog   MishraNatty (Natasha Mishra)    blog    twitterfeed
> > 2009-11-28      Saturday        19      09     �...@mattyza when launched 
> > back in 2005, the
> > Xbox 360 was available in Core and Pro. Now it's Arcade and Elite.
> > Same difference!        aalaap (Aalaap Ghag)            Tweetie
> > 2009-11-28      Saturday        19      05      Profit with Google, Twitter 
> > &amp; affiliate
> > marketinghttp://snipurl.com/tet1r Tiifani_Lurid (Tiifani Lurid)
> > API
> > 2009-11-28      Saturday        18      35      Just voted OOiZiT.com  for 
> > Best Online Music
> > Labelhttp://mashable.com/owa#openwebawardsankit_9oct (Ankit
> > Khandelwal)     openwebawards   Mashable Connect
> > 2009-11-28      Saturday        18      35     �...@reginafetalvero HAHA. 
> > YUHH. Gift ko
> > ah? :&quot;&gt; Jhoriiliee (Jorylie Cando)              web
> > 2009-11-28      Saturday        18      24     �...@tweet_words JAGGERY 
> > PALM       gannirules
> > (gaanish)               Snaptu
> > 2009-11-28      Saturday        17      34     �...@karan_talwar pls post 
> > that if you get an
> > answer. champbox (champbox)             Tweets60
> > 2009-11-28      Saturday        17      34      Just Got Home! :) Wee. Had 
> > FUN tonight! :)
> > HBD kathy! Sayang wala si Beb, complete na sana.        Jhoriiliee (Jorylie
> > Cando)          web
> > 2009-11-28      Saturday        17      34      I'm listening to Kurbaan: 
> > Kurbaan Hua
> > (Soundtrack) - @Spinlet kmadvani (Kunal M Advani)               API
> > 2009-11-28      Saturday        17      03      Eastern Province Under-19s 
> > 322/7 &amp; 185/5
> > v South Western Districts Under-19s 92/10 &amp; 152/10 *: Eastern
> > Province..http://bit.ly/4rS1iAvenky888(venkatesh iyer)
> > twitterfeed
> > 2009-11-28      Saturday        16      52      Hey tweeps......Rocket 
> > Singh picshttp://www.yashrajfilms.com/microsites/rocketsingh/fullpage.html
> > check them out! ShazahnPadamsee (Shazahn Padamsee)              web
> > 2009-11-28      Saturday        16      08      Started IE assignment   
> > jyotiswaroopr (Jyoti
> > Swaroop Repaka)         Digsby
> > 2009-11-28      Saturday        15      24     �...@paulaabdul Love you 
> > more than anything in
> > this world. Thanks for being a huge part of my life. &lt;3  LuvPaula
> > (Anahita Abdul Cowell)          web
> > 2009-11-28      Saturday        15      18     �...@richa_august84 fan of 
> > purane hindi gaane,
> > hmm? me too!!   sonali_k (sonali_k)             web
> > 2009-11-28      Saturday        14      54      Fruits and Vegetables for 
> > energyzing the
> > Solar Plexus Chakra:http://bit.ly/4NQV9M     AnamikaS (Anamika S)           
> >  web
> > 2009-11-28      Saturday        14      52      I'm off to read and then 
> > sleep. Don't dare
> > disturb my slumber.     eyemanut87 (Moo)                Snaptu
> > 2009-11-28      Saturday        14      52      White House gate-crashers 
> > met Obama, PM:
> > American couple Michaele and Tareq Salahi, who gate-crashed into a
> > State D...http://bit.ly/5TH6k5RediffNews(Rediff News)
> > twitterfeed
> > 2009-11-28      Saturday        14      45     �...@subutcher Good Morning. 
> > Have wonderful
> > ahead :)        nikhilwad1 (Nikhil Wad)         UberTwitter
> > 2009-11-28      Saturday        14      41     �...@venkatananth hey! 1- 
> > was standing at the
> > bar. 2-liked the music. Very interesting. But had to leave cos friend
> > had an early mrng flight :(     wanderblah (wanderblah)         dabr

Reply via email to