Re: [twitter-dev] Re: Retrieving new tweets for 40-60 thousand users

2010-07-23 Thread John Kalucki
You cannot open 300,000 streams. First, you don't have auth tokens for all
of your user's followings. Second, that would be against the access policy.

Instead, you can perform this following with elevated access via the
'shadow' role on stream.twitter.com. This will allow you to follow 80,000
public accounts on a single stream. Read the section of the doc 'Updating
Filter Predicates'
http://dev.twitter.com/pages/streaming_api_concepts#updating-filter-predicates
.

If you also wish to follow protected accounts, you'll have to wait for a
future product offering.

-John Kalucki
http://twitter.com/jkalucki


On Fri, Jul 23, 2010 at 12:24 AM, PBro  wrote:

> Hi,
>
> Thanks for the info.
> We are going to limit the number of friends you can follow to 5
> friends per user.
> So we wil need max 60.000 * 5 = 300.000 streams.
> We are gonna look into the access levels.
>
> Thanks again everybody for the info.
>
> Patrick
>
> On Jul 21, 12:06 pm, Pascal Jürgens
>  wrote:
> > Patrick,
> >
> > given this explanation, you will need a lot of streams.
> >
> > 60k users with an average of 100 friends (low estimate)
> > Let's guess that every user shares 50% of the friends with others
> >
> > This gives us: 60.000 * 100 *.5 = 3 million
> >
> > In order to track 3 million users with the follow stream, you need:
> >
> > the biggest role for this ("birddog") allows following 400.000 users
> > (http://dev.twitter.com/pages/streaming_api_methods)
> >
> > SO:
> >
> > You will need at least eight highest-level tracking privileges.
> >
> > Pascal
> >
> > On 21.Jul2010, at 11:51, PBro wrote:
> >
> > > The situation is:
> > > We have 60k users all with their own twitter account, so not a single
> > > account with 60k followers.
> > > Those 60k users all have people they follow and we want to give the
> > > user a message when someone they are following posted a tweet.
> > > Hope this clarify things a bit.
> > > I will have a look into the streaming api.
> >
> > > Patrick
>


Re: [twitter-dev] Re: Retrieving new tweets for 40-60 thousand users

2010-07-21 Thread Pascal Jürgens
Patrick,

given this explanation, you will need a lot of streams.

60k users with an average of 100 friends (low estimate)
Let's guess that every user shares 50% of the friends with others

This gives us: 60.000 * 100 *.5 = 3 million

In order to track 3 million users with the follow stream, you need:

the biggest role for this ("birddog") allows following 400.000 users
(http://dev.twitter.com/pages/streaming_api_methods)

SO:

You will need at least eight highest-level tracking privileges.


Pascal


On 21.Jul2010, at 11:51, PBro wrote:

> The situation is:
> We have 60k users all with their own twitter account, so not a single
> account with 60k followers.
> Those 60k users all have people they follow and we want to give the
> user a message when someone they are following posted a tweet.
> Hope this clarify things a bit.
> I will have a look into the streaming api.
> 
> Patrick