[twitter-dev] Sample Stream API - Fault tolerance with redundancy

2010-01-19 Thread Santiago Perez
Hi, I'm currently using the statuses/sample streaming API to store the sample tweets for later processing by different applications that mine the data. It is crucial for my applications to avoid data losses as much as possible. Since the API consumer and the applications all run in the cloud, a

[twitter-dev] Re: Max tweet ID? Planning which datatype to use

2009-12-03 Thread Santiago Perez
At Flaptor we use a CharField(max_length=20) which is big enough and seems reasonable since it is usually obtained from and used in urls. If you're interested in having a sorted index with the ids then you would have to look into bigger integer data types or add 0 padding behavior to your field.