I am a college student working on a project that requires me to
capture all (or as many as possible) retweets and store them in a
database. I currently have a script setup to search for "RT" and
return 100 results per page.
What I have discovered is that sometimes, the results are a random
sample of the results. Other times, it will actually return all the
I know this because when the results are correct, it will return about
30-40 tweets that match my search result in each second. So the time
difference between the top tweet and bottom tweet is about 3 seconds.
This seems to be correct.
Other times.. it will return about 1-2 tweet each second and show me
about 1 minute worth of tweets.
Can someone tell me why the API will sometimes randomly display all
the tweets and sometimes display only a select few?