Hi folks, I'm interested in doing some of my own twitter data mining and I was curious if Twitter posts any data sets covering 24 hour periods, or perhaps even longer intervals. For instance I'd love to have a full dump of all tweets over the month when Michael Jackson died, but even 24 hour dumps would be great. The format seems super simple, just a timestamp, a username, and the message. Multiply that by a few million records/day or whatever Twitter now experiences.
Obviously this would be a decent amount of data although compression should certainly help. Does Twitter provide such data sets anywhere? If so, where and how can I access them?