Hi Eric,

Like Francis and Darnelle said, Twitter's primary free search API is limited to 
the last 7 days of activity. The so called "Standard" search API is what twarc 
uses to gather data when you `twarc search …`

However a couple years ago Twitter added the Premium Search API [1] which is a 
hybrid approach that lets you search two endpoints (30 day and full archive), 
and is engineered to move you from collecting data for free to paying Twitter 
as you (inevitably) want to gather more.

From your email it sounds like you want to use the Full Archive endpoint? We 
have had this on the Documenting the Now roadmap to add premium support to 
twarc but haven't quite got around to it yet.

I went ahead and created a GitHub issue for you to track our progress [2]. It 
actually shouldn't be too difficult to add, so if you have a present need let 
us know so we can prioritize it higher.

//Ed

PS. As Francis mentioned twint gets around Twitter's API constraints by 
scraping Twitter's search results web page. Scraping comes with its own set of 
complexities, the biggest one is that Twitter actively work to prevent it, 
which (in my experience) can make twint a bit unpredictable to use at times.

[1] https://developer.twitter.com/en/docs/tweets/search/overview/premium
[2] https://github.com/DocNow/twarc/issues/326

Reply via email to