Re: [twitter-dev] Re: Recommended ways to demultiplex the search stream with thousands of searches

2010-04-19 Thread John Kalucki
In brief: Take all of your search terms and put them into a HashTable that maps from keyword to subscriber. Tokenize each tweet's text field and apply each token to the HashTable, sending the Tweet on to all subscribers. Each subscriber can do a generational deduplication to avoid getting each

Re: [twitter-dev] Re: Recommended ways to demultiplex the search stream with thousands of searches

2010-04-19 Thread John Kalucki
You have to do some sort of post-processing with the Streaming API, yes. On Mon, Apr 19, 2010 at 2:41 PM, Jeffrey Greenberg jeffreygreenb...@gmail.com wrote: Just to clarify: if i have thousands of boolean searches that map to the current search capability, and If I want to map all or some of