[twitter-dev] Re: Twitter Data Dumps?

2009-10-26 Thread futureboy

Is there a way to filter based on some criteria? In particular, I want
the service to only return tweets that are geo-enabled, i.e. geo is
not null.

Right now I'm opening a connection to 
http://stream.twitter.com/1/statuses/sample.json
and it works fine, but I was hoping I could have some additional query
string like http://stream.twitter.com/1/statuses/sample.json?filter=geo.
Obviously, I can filter this out after I've received any tweet, but I
would imagine I'd get much more results if I asked the service to only
serve up geo-enabled tweets.

Thanks,
futureboy

On Oct 25, 5:43 pm, futureboy future...@gmail.com wrote:
 Hey everyone, thanks for the feedback, I'm receiving tons of data from
 the streaming API, very exciting!

 On Oct 21, 10:26 pm, futureboy future...@gmail.com wrote:



  Hi folks, I'm interested in doing some of my own twitterdatamining
  and I was curious if Twitter posts anydatasets covering 24 hour
  periods, or perhaps even longer intervals. For instance I'd love to
  have a full dump of all tweets over the month when Michael Jackson
  died, but even 24 hourdumpswould be great. The format seems super
  simple, just a timestamp, a username, and the message. Multiply that
  by a few million records/day or whatever Twitter now experiences.

  Obviously this would be a decent amount ofdataalthough compression
  should certainly help. Does Twitter provide suchdatasets anywhere?
  If so, where and how can I access them?


[twitter-dev] Re: Twitter Data Dumps?

2009-10-25 Thread futureboy

Hey everyone, thanks for the feedback, I'm receiving tons of data from
the streaming API, very exciting!

On Oct 21, 10:26 pm, futureboy future...@gmail.com wrote:
 Hi folks, I'm interested in doing some of my own twitterdatamining
 and I was curious if Twitter posts anydatasets covering 24 hour
 periods, or perhaps even longer intervals. For instance I'd love to
 have a full dump of all tweets over the month when Michael Jackson
 died, but even 24 hourdumpswould be great. The format seems super
 simple, just a timestamp, a username, and the message. Multiply that
 by a few million records/day or whatever Twitter now experiences.

 Obviously this would be a decent amount ofdataalthough compression
 should certainly help. Does Twitter provide suchdatasets anywhere?
 If so, where and how can I access them?


[twitter-dev] Twitter Data Dumps?

2009-10-21 Thread futureboy

Hi folks, I'm interested in doing some of my own twitter data mining
and I was curious if Twitter posts any data sets covering 24 hour
periods, or perhaps even longer intervals. For instance I'd love to
have a full dump of all tweets over the month when Michael Jackson
died, but even 24 hour dumps would be great. The format seems super
simple, just a timestamp, a username, and the message. Multiply that
by a few million records/day or whatever Twitter now experiences.

Obviously this would be a decent amount of data although compression
should certainly help. Does Twitter provide such data sets anywhere?
If so, where and how can I access them?