Basha, Paging for a given query is limited to 1500 tweets. If you goal is to get every single tweet for a given query, you are going to have to get creative as that is not what the search system was optimized to do.
Doug Williams Twitter API Support http://twitter.com/dougw On Tue, Mar 17, 2009 at 9:24 AM, Basha Shaik <basha.neteli...@gmail.com> wrote: > Thank you Very much. > > I tried by Giving Since and Until. i am getting only 1500(100 per page for > 15 pages). But my query has more than 1500 tweets in the given date > range(between Since and Until) how can i get other tweets. Should i Split > the Date range and Submit two Requests? or is there any other solution. > > Also if for a Single day i have more than 1500 tweets for my search query. > how can i get all the search queries. > > > > Regards, > > Mahaboob Basha Shaik > www.netelixir.com > Making Search Work > > > On Tue, Mar 17, 2009 at 12:54 PM, Doug Williams <d...@twitter.com> wrote: >> >> Basha, >> You can always run a query and turn it into JSON or Atom format by >> adding the appropriate extension. >> >> To avoid IP blacklisting with the Search API, simply be judicious with >> your queries. As stated in the documentation, the default limit is >> liberal. If you start hitting the limiter, slow your application's >> search routine and do what you can to avoid it again. If you truly >> feel that you have a case warranting whitelisting after this has >> happened please contact me off list to discuss. >> >> As for OAuth basics please consult the FAQ [1] and search the forums. >> There has been quite a bit of discussion in the past. We're here for >> any questions you have after that introduction. >> >> [1] - http://apiwiki.twitter.com/OAuth-FAQ >> >> Doug Williams >> Twitter API Support >> http://twitter.com/dougw >> >> >> >> On Tue, Mar 17, 2009 at 3:21 AM, Basha Shaik <basha.neteli...@gmail.com> >> wrote: >> > Thank you very Much I tried. Its working. >> > >> > Can I pass date with hours and minutes in search for until and since >> > parameters? Does this Since and until belong to search api? >> > >> > Also I need all the parameters(Complete list of parameters) which we can >> > pass in request url(Such as rpp,page,since_id,since,until...). the >> > Documentation in http://apiwiki.twitter.com/Search+API+Documentation is >> > not >> > providing all. >> > >> > Also i need to know about the number of requests i can make using the >> > API. >> > I have a Web Application that runs a lot of queries on the twitter >> > search >> > JSON Api. I use methods mainly for searching. I heard that if number of >> > queries are more than my IP will be banned what should i do to avoid >> > this. >> > >> > Also can you give me information about OAuth and basic Auth and how this >> > are >> > useful. I am new to this forum and i am just starting the development of >> > Application So my questions might look silly. I am Sorry for all the >> > silly >> > questions. But please answer my questions. >> > >> > >> > >> > >> > Doug Williams >> > Regards, >> > >> > Mahaboob Basha Shaik >> > www.netelixir.com >> > Making Search Work >> > >> > >> > On Mon, Mar 16, 2009 at 3:26 PM, Doug Williams <d...@twitter.com> wrote: >> >> >> >> Have you found the 'since' and 'until' parameters that are found in >> >> advanced search? >> >> >> >> For example: >> >> >> >> http://search.twitter.com/search?q=twitter&since=2009-03-09&until=2009-03-11 >> >> >> >> Thanks, >> >> Doug Williams >> >> Twitter API Support >> >> http://twitter.com/dougw >> >> >> >> On Mar 16, 10:13 am, Basha Shaik <basha.neteli...@gmail.com> wrote: >> >> > HI, >> >> > Which means if i have latest 1500 tweets between march 12th to >> >> > current >> >> > time. >> >> > Then there is no way of getting tweets Updated on 11th march. If I >> >> > need >> >> > tweets of 11th march what should I Do? >> >> > >> >> > My Requirement is When I submit a Search Term(Which is Given by the >> >> > User) by >> >> > Giving Date Range. I need to Get all the tweets in that Date Range >> >> > for >> >> > that >> >> > Search Term. But With the Restriction of 1500 tweets my requirement >> >> > cannot >> >> > be fulfilled. Can you Suggest me any Solution. >> >> > >> >> > Regards, >> >> > >> >> > Mahaboob Basha Shaikwww.netelixir.com >> >> > Making Search Work >> >> > >> >> > On Mon, Mar 16, 2009 at 2:00 PM, Doug Williams <d...@twitter.com> >> >> > wrote: >> >> > > Hi, >> >> > > At any given time, you only have access to the latest 1500 tweets >> >> > > for >> >> > > the >> >> > > reasons explained above. >> >> > >> >> > > Doug Williams >> >> > > Twitter API Support >> >> > >http://twitter.com/dougw >> >> > >> >> > > On Mon, Mar 16, 2009 at 9:58 AM, Basha Shaik >> >> > > <basha.neteli...@gmail.com>wrote: >> >> > >> >> > >> What if I want to get the second latest 1500 tweets? >> >> > >> >> > >> Regards, >> >> > >> >> > >> Mahaboob Basha Shaik >> >> > >>www.netelixir.com >> >> > >> Making Search Work >> >> > >> >> > >> On Mon, Mar 16, 2009 at 1:49 PM, Doug Williams <d...@twitter.com> >> >> > >> wrote: >> >> > >> >> > >>> The number of tweets you are able to retrieve is artificially >> >> > >>> limited for >> >> > >>> performance reasons. As you can tell, 1500 is the limit. >> >> > >> >> > >>> Arbitrary retrieval would cause too many disk look ups which >> >> > >>> would >> >> > >>> adversely affect performance of the entire system. Limiting the >> >> > >>> number of >> >> > >>> results available allows most queries to utilize memory caches. >> >> > >> >> > >>> Thanks >> >> > >>> Doug Williams >> >> > >>> Twitter API Support >> >> > >>>http://twitter.com/dougw >> >> > >> >> > >>> On Mon, Mar 16, 2009 at 9:26 AM, basha >> >> > >>> <basha.neteli...@gmail.com>wrote: >> >> > >> >> > >>>> I submitted my request with 100 RPP and 15 pages. then i am >> >> > >>>> getting >> >> > >>>> 1500 tweets. but when I tried using since_id 1312101395 along >> >> > >>>> with >> >> > >>>> RPP >> >> > >>>> and Pages I am getting only latest 1500 tweets. How can I get >> >> > >>>> tweets >> >> > >>>> which were present before the latest 1500 tweets >> >> > >>>> (1501,1502,1503,..............). >> >> > >>>> Overall i want a mechanism where i can get all the tweets >> >> > >>>> irrespective >> >> > >>>> of the number greater or less than 1500. please tell me the >> >> > >>>> mechanism. >> >> > >>>> i am codeing the above in java. >> > > >
