[twitter-dev] Streaming API -- filtering with punctuation
Hey guys, Is it at all possible, in some way or another to specify a filter with a period? I've been working on an image streaming service and up till now I have been just filtering on: twitpic,yfrog,pic However, we'd also like to stream in links from ow.ly, but I would have to filter on ow to make this happen, which would return a lot of unnecessary tweets which is a load on the streaming service and my daemon. Thanks! Peter To unsubscribe from this group, send email to twitter-development-talk+unsubscribegooglegroups.com or reply to this email with the words REMOVE ME as the subject.
Re: [twitter-dev] Streaming API -- filtering with punctuation
The combinatorics don't work out here until we offer boolean AND. Tokens are thrown against a HashMap to determine delivery. It's not really feasible to also throw arbitrary combinations of tokens against the HashMap. If we ever support AND, then you could search for ow AND ly. You'll have to over-request and filter on your end. -John Kalucki http://twitter.com/jkalucki Infrastructure, Twitter Inc. On Fri, Mar 26, 2010 at 8:34 AM, Peter Kieltyka peter.kielt...@nulayer.comwrote: Hey guys, Is it at all possible, in some way or another to specify a filter with a period? I've been working on an image streaming service and up till now I have been just filtering on: twitpic,yfrog,pic However, we'd also like to stream in links from ow.ly, but I would have to filter on ow to make this happen, which would return a lot of unnecessary tweets which is a load on the streaming service and my daemon. Thanks! Peter To unsubscribe from this group, send email to twitter-development-talk+ unsubscribegooglegroups.com or reply to this email with the words REMOVE ME as the subject. To unsubscribe from this group, send email to twitter-development-talk+unsubscribegooglegroups.com or reply to this email with the words REMOVE ME as the subject.
Re: [twitter-dev] Streaming API -- filtering with punctuation
On 03/26/2010 10:32 AM, John Kalucki wrote: The combinatorics don't work out here until we offer boolean AND. Tokens are thrown against a HashMap to determine delivery. It's not really feasible to also throw arbitrary combinations of tokens against the HashMap. If we ever support AND, then you could search for ow AND ly. You'll have to over-request and filter on your end. This may have to wait till Chirp, but as long as we're on the subject of filtering at the consumer end, how good is *Cassandra* at that sort of filtering, relative to all the other databases, NoSQL and traditional ACID-compliant RDBMS? And how good is Cassandra relative to Hadoop? I've been thinking PostgreSQL in my designs, mostly because it's the one I know best, it's solid as a rock and I have friends who will disown me if I use MySQL. ;-) But using the same DB as Twitter has an appeal to it just because you *do* use it. And, of course, because NoSQL databases are cool and geeky. ;-) To unsubscribe from this group, send email to twitter-development-talk+unsubscribegooglegroups.com or reply to this email with the words REMOVE ME as the subject.
Re: [twitter-dev] Streaming API -- filtering with punctuation
You really shouldn't pick your systems based on what Twitter uses unless all else is the same. Our requirements are radically different from yours. I'd encourage you to use the same libraries though -- for example, if we're using Gson to parse JSON, you are unlikely to run into additional complications. On Fri, Mar 26, 2010 at 10:41 AM, M. Edward (Ed) Borasky zzn...@gmail.comwrote: On 03/26/2010 10:32 AM, John Kalucki wrote: The combinatorics don't work out here until we offer boolean AND. Tokens are thrown against a HashMap to determine delivery. It's not really feasible to also throw arbitrary combinations of tokens against the HashMap. If we ever support AND, then you could search for ow AND ly. You'll have to over-request and filter on your end. This may have to wait till Chirp, but as long as we're on the subject of filtering at the consumer end, how good is *Cassandra* at that sort of filtering, relative to all the other databases, NoSQL and traditional ACID-compliant RDBMS? And how good is Cassandra relative to Hadoop? I've been thinking PostgreSQL in my designs, mostly because it's the one I know best, it's solid as a rock and I have friends who will disown me if I use MySQL. ;-) But using the same DB as Twitter has an appeal to it just because you *do* use it. And, of course, because NoSQL databases are cool and geeky. ;-) To unsubscribe from this group, send email to twitter-development-talk+ unsubscribegooglegroups.com or reply to this email with the words REMOVE ME as the subject. To unsubscribe from this group, send email to twitter-development-talk+unsubscribegooglegroups.com or reply to this email with the words REMOVE ME as the subject.
