Re: [twitter-dev] Twitter stream shuts off every 60 seconds

2011-02-27 Thread John Kalucki
It sounds like you have multiple connections on the same account. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Fri, Feb 25, 2011 at 2:20 PM, jon bloob...@gmail.com wrote: Hi, If I try: curl -d @tracking http://stream.twitter.com/1/statuses/filter.json - uUsername:Password

Re: [twitter-dev] Streaming API access level limit

2011-02-27 Thread John Kalucki
Are you specifying the IDs in the URL or in a POST parameter? There's a limit to the URL length that we'll parse, but we'll take huge POST parameters. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Feb 22, 2011 at 11:22 PM, aquajach aquaj...@gmail.com wrote: Hi, Just

Re: [twitter-dev] Streaming API limits...

2011-02-27 Thread John Kalucki
This is documented in painful detail here: http://dev.twitter.com/pages/streaming_api_concepts#updating-filter-predicates . If you connect a second time, you should get a TCP Close or Reset on the first connection. It sounds like your client library isn't detecting the connection close. -John

[twitter-dev] Site Streams Beta - Endpoint change to sitestream.twitter.com

2011-02-22 Thread John Kalucki
Please change your Site Streams beta clients to point to sitestream.twitter.com and not to betastream.twitter.com. We'll continue to support betastream.twitter.com for several weeks. This is more of a clean-up step. Thanks, -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter

[twitter-dev] Re: Site Streams Beta - Endpoint change to sitestream.twitter.com

2011-02-22 Thread John Kalucki
Note that Site Streams is still in a beta test. We're just moving endpoints around for other projects. Sorry for any confusion. -John On Tue, Feb 22, 2011 at 2:15 PM, John Kalucki j...@twitter.com wrote: Please change your Site Streams beta clients to point to sitestream.twitter.com

Re: [twitter-dev] Re: Streaming API vs. Search API: no API returns 95% of intented tweets

2011-02-18 Thread John Kalucki
http://dev.twitter.com/pages/streaming_api_concepts#result-quality Search filters for relevance and is not intended as a source of all tweets. Streaming provides the complete record to all you to perform whatever post-processing you'd like. -John Kalucki http://twitter.com/jkalucki Twitter, Inc

Re: [twitter-dev] User Streams and delimited=length

2011-02-18 Thread John Kalucki
Delimited=length works with User Streams. Perhaps you have a typo. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Feb 16, 2011 at 6:00 PM, WushuJames wushuja...@gmail.com wrote: Hi, I'm playing around with User Streams. I was able to connect to https

[twitter-dev] Site Streams - Testing a new cluster

2011-02-15 Thread John Kalucki
or success, please either DM @sitestreams, mention @sitestreams, or simply reply to this thread. Please keep all of your production streams on the DNS name sitestream.twitter.com. Thanks, -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http

Re: [twitter-dev] Streaming API vs. Search API: no API returns 95% of intented tweets

2011-02-15 Thread John Kalucki
If you examine set C, do they contain matches on fields other than the Tweet text? To increase recall, search sometimes includes keywords in followed links and other techniques. Also, are you getting rate limit messages on the Streaming API? -John Kalucki http://twitter.com/jkalucki Twitter, Inc

Re: [twitter-dev] Opening sitestream with authorization only for some users issue

2011-02-15 Thread John Kalucki
. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Feb 15, 2011 at 11:52 AM, A.A.Novikov al.an.novi...@gmail.comwrote: Hi, a couple of days ago I've noticed that the implementation of a undocumented edge case changed: Let's say there are users A,B,C; users A B have authorized

[twitter-dev] Re: Streaming API maintenance: brief delivery pause and an increased likelihood for duplicate tweets

2011-02-10 Thread John Kalucki
to about two minutes. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Feb 9, 2011 at 1:15 PM, John Kalucki j...@twitter.com wrote: We are performing a maintenance activity shortly that will increase the likelihood of duplicate tweets and other messages on all Streaming APIs: User

[twitter-dev] Streaming API maintenance: brief delivery pause and an increased likelihood for duplicate tweets

2011-02-09 Thread John Kalucki
/streaming_api_concepts#quality-of-service. -John Kalucki Twitter, Inc. http://twitter.com/jkalucki -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list

[twitter-dev] Site Streams Beta Users

2011-02-05 Thread John Kalucki
expect any service interruptions, but we'd like to keep everyone's distractions to a minimum. Thank you, John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues

Re: [twitter-dev] stream_socket_client with STREAM_CLIENT_ASYNC_CONNECT yields 401

2011-01-18 Thread John Kalucki
The Phirehose library for PHP and the Twitter Streaming API is well tested and widely used. I'd start by looking at their code. -John On Sun, Jan 16, 2011 at 12:18 PM, webjay jacob.saxb...@gmail.com wrote: I should probably ask in a Php group, but I'll try here first, in case it's Twitter

Re: [twitter-dev] Streaming Site API hogs at some stage

2011-01-06 Thread John Kalucki
The approach that Tim mentions is a good backstop, but this covers for an operational situation at Twitter that almost never happens. If you are seeing this condition happen often, there's probably something else wrong somewhere. If it is on our end, I'd like to fix it, but chances are its on your

Re: [twitter-dev] Site stream unfollow event

2010-12-18 Thread John Kalucki
followers. There are awful scaling issues involved here, vectors for spammy behavior, and generally not much value for end-users in providing this data. Twitter is mostly about who you follow and what you are interested in. Who is following you is becoming less and less relevant. -John Kalucki http

Re: [twitter-dev] Sporadic 401s?

2010-12-18 Thread John Kalucki
through the holidays, and we'll get this out in the New Year. There are a number of minor goodies queued behind this deploy. We'll get there. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Fri, Dec 17, 2010 at 10:54 AM, David dtran...@gmail.com wrote: I have been getting sporadic 401s

Re: [twitter-dev] Usage of site streams in production projects.

2010-12-18 Thread John Kalucki
on changing your end. Also, keep your REST API fallback code well tested for the time being... -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Dec 16, 2010 at 1:32 PM, ||M|| cyberdo...@gmail.com wrote: Hi, Maybe this question is asked before but I was unable to find

Re: [twitter-dev] user stream best practices

2010-12-18 Thread John Kalucki
to balance this cost externalization very carefully and with all due concern for everyone's time. Our resources are limited, and our reasoning may not always be immediately obvious, but we're trying to get you as much data as possible, as efficiently as possible for everyone. -John Kalucki http

Re: [twitter-dev] Stream problems on 2010-12-17?

2010-12-18 Thread John Kalucki
Are you tracking reconnections and HTTP error codes? Sounds like you may have been churning your connection and getting banned. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Sat, Dec 18, 2010 at 7:32 AM, Frank Sorro xoo9i...@googlemail.comwrote: Hi Twitter admins and developers

Re: [twitter-dev] user stream best practices

2010-12-13 Thread John Kalucki
Roughly: If the tweet is from a following, place it in the home timeline. If the tweet refers to the user (to or from), or contains the @screenname place it in mentions If it's a message - messages. What remains is probably a track term. -John Kalucki http://twitter.com/jkalucki Twitter, Inc

Re: [twitter-dev] not getting unfollow and retweet event from User Stream

2010-12-08 Thread John Kalucki
you reproduce this case? -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Dec 8, 2010 at 12:24 AM, Yusuke Yamamoto yus...@mac.com wrote: Hi all, I'm not getting unfollow (from me) and retweet (from me) events from User Stream now. I suppose I used to be getting that sort

[twitter-dev] XML disabled on Streaming API

2010-12-06 Thread John Kalucki
As previously announced, XML has been disabled on the Streaming API. The few remaining consumers should move to JSON, and bid the year 2003 adieu. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via

Re: [twitter-dev] Streaming API firehose visibility

2010-12-03 Thread John Kalucki
Yes, where firehose is the stream of all public statuses, with some low-quality accounts removed. On Wed, Dec 1, 2010 at 3:52 PM, dburkes dbur...@gmail.com wrote: If I am using the statuses/filter streaming API, with a track= query that is not overly broad, and my client never receives any

Re: [twitter-dev] Re: Best scalable method to process mentions

2010-11-30 Thread John Kalucki
You should use Site Streams to gather mentions for a large number of users, or User Streams to gather for a single user. Otherwise you will run into API rate limits and other issues. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Nov 30, 2010 at 4:09 AM, Serdar ser

Re: [twitter-dev] User Streams count parameter

2010-11-23 Thread John Kalucki
. In the mean time, hit the REST API after a connection is established to do the backfill. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Nov 22, 2010 at 8:01 PM, Jonathon Hill jhill9...@gmail.com wrote: Per http://dev.twitter.com/pages/user_streams_suggestions: If disconnected

Re: [twitter-dev] filter.json per user connection limit

2010-11-23 Thread John Kalucki
trained not to enter their credentials into other websites, and once basic auth is turned off on the Streaming API, this option will be precluded. -John Kalucki http://twitter.com/jkalucki Twitter Inc On Sat, Nov 20, 2010 at 9:57 AM, Jason Newell newell.jas...@gmail.comwrote: The docs recommended

Re: [twitter-dev] Site Stream latency

2010-11-20 Thread John Kalucki
of symptoms. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sun, Nov 14, 2010 at 12:13 PM, N n...@h7a.org wrote: When my program makes hundreds of connections with Site Stream to observe tens of thousands of users, the latency for every status messages seems to start off like 10~30

Re: [twitter-dev] Re: Twitter + Gnip Partnership

2010-11-17 Thread John Kalucki
Every search engine, social network, blogging platform, content aggregator, and to a certain extent, every used book store and used record store... -John On Wed, Nov 17, 2010 at 1:04 PM, Dewald Pretorius dpr...@gmail.com wrote: As a business model, is there another company that takes content,

Re: [twitter-dev] Receiving streaming API tweets without id_str

2010-11-08 Thread John Kalucki
We're looking into this issue. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sat, Nov 6, 2010 at 10:08 AM, Adam Green 140...@gmail.com wrote: My error logs started showing tweets without an id_str value a few days ago. I investigated today and found that these tweets are coming

Re: [twitter-dev] Re: Exception while using count parameter of streaming api

2010-11-08 Thread John Kalucki
Shadow allows you to follow more users, but also allows you to continue to use track. There are no cases where we support count and track together. -John Kalucki http://twitter.com/jkalucki Twitter, Inc On Fri, Nov 5, 2010 at 9:41 AM, revati choudhari revati.choudh...@gmail.com wrote

Re: [twitter-dev] Receiving streaming API tweets without id_str

2010-11-08 Thread John Kalucki
This should be fixed. Again. Please let us know if this recurs. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sat, Nov 6, 2010 at 10:08 AM, Adam Green 140...@gmail.com wrote: My error logs started showing tweets without an id_str value a few days ago. I investigated today

[twitter-dev] Removing new_id from Streaming on or after Monday November 15, 2010

2010-11-05 Thread John Kalucki
as is practical. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership

[twitter-dev] 10 minute warning: Snowflake status id jump in 10 minutes: 2:00pm PDT, 14:00 UTC

2010-11-04 Thread John Kalucki
-- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group:

Re: [twitter-dev] Basic question re Snowflake/K-sorted

2010-11-04 Thread John Kalucki
This is good enough, as it's very unlikely that a tweet will be delivered with an id less than your saved maximum id. If you want to be paranoid, you can subtract a few seconds from the millisecond part of the id, but this is, in practice, unlikely to ever happen. -John Kalucki http://twitter.com

Re: [twitter-dev] Duplicate tweets showing in the stream

2010-11-04 Thread John Kalucki
I'm assuming that this is on Site Streams. It's very odd that the tweet ids and created_at timestamps are so very close together. Can you post the raw, unparsed JSON that you are receiving? Just one example would be sufficient to get started. -John Kalucki http://twitter.com/jkalucki Twitter, Inc

[twitter-dev] Site Streams Beta now allows applications to stream all of their users.

2010-11-03 Thread John Kalucki
The 100k user / 1k connection limit is no longer necessary and has been dropped. You may now connect for all of your tokens. Please limit your implementation to no more than 25 new connections per second. Follow @sitestreams for more information about this beta test. -John Kalucki http

Re: [twitter-dev] Rate limit for streaming api (tracking keyword)

2010-10-31 Thread John Kalucki
http://dev.twitter.com/pages/streaming_api_concepts#filter-limiting http://dev.twitter.com/pages/streaming_api_concepts#parsing-responses On Thu, Oct 28, 2010 at 9:55 PM, Thiago Esteves thgeste...@gmail.comwrote: Hi, I am developing an application that needs to track a keyword on twitter,

Re: [twitter-dev] De-duplicating Site Streams

2010-10-31 Thread John Kalucki
Create two in-memory hash sets of seen ids. Write ids to both. If the id is found on write, discard. Alternatively expire them every few tens of minutes to bound growth, but provide continuous coverage. -John On Tue, Oct 26, 2010 at 8:55 PM, Marc Mims marc.m...@gmail.com wrote:

[twitter-dev] Additional capacity added to stream.twitter.com and betastream.twitter.com clusters

2010-10-27 Thread John Kalucki
. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group

Re: [twitter-dev] what does K-sorted mean?

2010-10-20 Thread John Kalucki
K-sorted means roughly sorted, where no item is no more than K positions from it's totally ordered position. A sequence is k-sorted IFF, for all i,r, 1= i = r = n, i= r-k implies that a(i) = a(r). The generation scheme has to allow sufficient IDs to be generated in a non-coordinated way to cover

Re: [twitter-dev] friends list in Site Stream

2010-10-20 Thread John Kalucki
This amount of data is trivial compared to the total amount of data sent over Site Streams. The friends list per user is roughly the size of a tweet or two. We have to weigh the cost of maintaining the feature vs. the bandwidth and CPU savings. Unless the savings is significant, generally the

Re: [twitter-dev] Stream API responds with 401 when multiple keywords are used

2010-10-15 Thread John Kalucki
There's at least one OAuth library out there that doesn't encode the comma correctly. Search back in this group for details. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Thu, Oct 14, 2010 at 6:40 PM, Corey Wallis corey.wal...@flinders.edu.auwrote: Hi All, I have working code

Re: [twitter-dev] Re: No of statuses extracted by statuses/filter

2010-10-15 Thread John Kalucki
://dev.twitter.com/pages/streaming_api_concepts#parsing-responses -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Oct 14, 2010 at 12:29 PM, AA alejandro.ale...@gmail.com wrote: Thanks a lot! This is very helpful. John: You said: If you don't receive a limit message, you know

[twitter-dev] Streaming API sampling and filter limiting algorithms switched to new status id

2010-10-12 Thread John Kalucki
in the future. Overall, the results for Sample and Filter should be very similar to the previous sequentially generated status id system. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http

Re: [twitter-dev] Site Streams: Work Locally / 401 Unauthorized From EC2 (/cc @jkalucki)

2010-10-12 Thread John Kalucki
I can see what you describe in the logs. The most likely problem is that the EC2-based client isn't signing the OAuth correctly somehow. There should be nothing on our end that allows you in on one IP, but 401s you on another. -John On Tue, Oct 12, 2010 at 1:28 PM, tsmango tsma...@gmail.com

Re: [twitter-dev] Re: No of statuses extracted by statuses/filter

2010-10-12 Thread John Kalucki
If you don't receive a limit message, you know that you've received all possible tweets for the predicate. If you do receive a limit message, you know the precise proportion of tweets received and dropped. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Tue, Oct 12, 2010 at 2:36 PM

Re: [twitter-dev] Re: No of statuses extracted by statuses/filter

2010-10-12 Thread John Kalucki
Sorry. Gmail fail / Groups fail. On Tue, Oct 12, 2010 at 3:17 PM, John Kalucki j...@twitter.com wrote: If you don't receive a limit message, you know that you've received all possible tweets for the predicate. If you do receive a limit message, you know the precise proportion of tweets

Re: [twitter-dev] Re: Is authentication required to use Streaming API?

2010-10-07 Thread John Kalucki
stream.twitter.com/1/statuses/filter.json track=keyword1,keyword2 etc. -John On Thu, Oct 7, 2010 at 10:13 AM, D. Smith emai...@sharedlog.com wrote: I'm confused now. Which API should I use Streaming or Search? What I want is to monitor Twitter and every time someone uses certain words

Re: [twitter-dev] Re: Is authentication required to use Streaming API?

2010-10-07 Thread John Kalucki
Every account has default-level access. On Thu, Oct 7, 2010 at 10:26 AM, D. Smith emai...@sharedlog.com wrote: Can I use any Twitter account username/password or does the account have to be registered with Twitter API? On Oct 7, 1:18 pm, John Kalucki j...@twitter.com wrote

Re: [twitter-dev] Re: [SiteStreams] can't follow more than one user

2010-10-06 Thread John Kalucki
It might be an OAuth encoding error with the ','. Which OAuth library are you using? -John On Wed, Oct 6, 2010 at 9:34 AM, Ruben Fonseca fons...@gmail.com wrote: Hi Thomas On Oct 6, 5:20 pm, Thomas Mango tsma...@gmail.com wrote: Hey, Ruben. That's the correct URL format. Are you sure your

Re: [twitter-dev] Re: Streaming API test: Adding new_id field to statuses at 17:00 UTC Sept 29

2010-10-04 Thread John Kalucki
I dug back to Mark's email for context, but I still can't puzzle out what Mark was referring to and what you are asking for. The answer might be buried somewhere in that 74 message thread. Could you restate your question? Does the count parameter do what you need? -John Kalucki http

Re: [twitter-dev] about Rate-limit

2010-10-03 Thread John Kalucki
If you have 100k members to poll continuously, perhaps you should look into the Site Streams beta? -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sun, Oct 3, 2010 at 4:47 PM, Emre GÜLCAN emregul...@gmail.com wrote: Thanks Scott Emre GULCAN Application Developer On Mon, Oct

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-10-01 Thread John Kalucki
List modifications are streamed as social events. The lists themselves are not streamed. -John On Fri, Oct 1, 2010 at 11:01 AM, Tom van der Woerdt i...@tvdw.eu wrote: Correct. I'd like to add an additional question to this thread: what about list events? The docs say that they get sent, but

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-10-01 Thread John Kalucki
app, although I doubt that it's my code (it simply outputs all incoming data to debug). Tried with cURL but got an error about Basic Auth. Can anyone verify that there are no list events in the streams, or am I simply going blind? Tom On 10/1/10 10:57 PM, John Kalucki wrote: List

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-09-30 Thread John Kalucki
was restarted, in which case I would clear the currently cached relationship details for each user being followed by that stream and set them up again). I hope this clarifies the different situations where I'd find unfollow events useful. Thanks! On Sep 29, 11:42 pm, John Kalucki j...@twitter.com wrote

Re: [twitter-dev] twitter streams API question

2010-09-30 Thread John Kalucki
, especially for higher velocity predicates. See http://dev.twitter.com/pages/streaming_api_concepts#filter-limiting for more details` -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Sep 30, 2010 at 5:37 AM, Tom van der Woerdt i...@tvdw.eu wrote: Filter = all, just like search. Tom

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread John Kalucki
Twitter4J seems to be popular, but I don't have first-hand experience with it. -John On Thu, Sep 30, 2010 at 8:32 AM, D. Smith emai...@sharedlog.com wrote: Oh, man, I am new to Java, don't even know what Scala is... I've heard about it that it's like based on Java and it's supposed to be

Re: [twitter-dev] Re: Looking for Java class/package for Firehose

2010-09-30 Thread John Kalucki
specifically for Firehose. I must use threads to pass the jobs to and i must have some mechanism to forking and staying alive like a daemon or something like that, and ideally it would automatically handle reconnecting in case of error. On Sep 30, 11:33 am, John Kalucki j...@twitter.com

Re: [twitter-dev] Steaming API — is track lagging considerably behind real–time right now?

2010-09-29 Thread John Kalucki
The status blog will be updated shortly. -John On Wed, Sep 29, 2010 at 7:22 AM, Taylor Singletary taylorsinglet...@twitter.com wrote: Hi Ben, The Streaming API is working through a backlog now after some earlier issues. It should become more current soon. Taylor On Wed, Sep 29, 2010 at

[twitter-dev] Streaming API new_id test

2010-09-29 Thread John Kalucki
tomorrow at about the same time. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues

Re: [twitter-dev] Re: Site Streams - Unfollow Events?

2010-09-29 Thread John Kalucki
Please describe your use case for unfollows on Site Streams... -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Sep 29, 2010 at 5:09 PM, tsmango tsma...@gmail.com wrote: Ah I wasn't able to find that. It's a shame if true. Thanks for the information. On Sep 29, 6:05 pm, Tim

[twitter-dev] User Streams goes Production, Site Streams adds Home Timelines

2010-09-28 Thread John Kalucki
backwards compatibility. We recommend that you explicitly set this parameter to avoid confusion and future compatibility problems as we refine this API. John Kalucki http://twitter.com/jkalucki Mark McBride http://twitter.com/mccv Cara Meverden http://twitter.com/caramev -- Twitter developer

[twitter-dev] Re: User Streams goes Production, Site Streams adds Home Timelines

2010-09-28 Thread John Kalucki
Correction: The endpoint is https://userstream.twitter.com/2/user.json. User Streams is HTTPS only. On Tue, Sep 28, 2010 at 12:04 PM, John Kalucki j...@twitter.com wrote: User Streams = After an uneventful beta test period, the User Streams feature of the Twitter Streaming API is now

[twitter-dev] Streaming API test: Adding new_id field to statuses at 17:00 UTC Sept 29

2010-09-28 Thread John Kalucki
://groups.google.com/group/twitter-api-announce/browse_thread/thread/daf6298d0fdcbc87 http://groups.google.com/group/twitter-api-announce/browse_thread/thread/7982e3b037eeef95 -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http

Re: [twitter-dev] Re: User Streams goes Production, Site Streams adds Home Timelines

2010-09-28 Thread John Kalucki
Followings is additive to the Users. You can observe the behavior of these settings on userstream.twitter.com. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Sep 28, 2010 at 9:10 PM, Michael Ledford mledf...@gmail.com wrote: On Sep 28, 3:04 pm, John Kalucki j...@twitter.com

Re: [twitter-dev] xAuth problem with using filter streams

2010-09-27 Thread John Kalucki
The reason text was enclosed. It says 403 - Administratively Forbidden. You've been blacklisted, almost certainly for violating the API policy. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Sep 27, 2010 at 6:06 AM, Tom van der Woerdt i...@tvdw.eu wrote: Hi, The 403 error

Re: [twitter-dev] not authorized over and over again

2010-09-27 Thread John Kalucki
It sounds that, perhaps, you aren't recalculating the hash with the current timestamp. You can't re-use hashes. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Sep 27, 2010 at 3:39 PM, eMailaya a...@emailaya.com wrote: Im developing a desktop application. firstly, the user

Re: [twitter-dev] Check if I have gardenhose or spritzer access

2010-09-22 Thread John Kalucki
Until Snowflake comes out, and IDs become non-sequential, look at the status id and figure your rough sample percentage. Once Snowflake comes out, this will be somewhat more difficult. -John On Wed, Sep 22, 2010 at 4:10 PM, Lucas Vickers lucasvick...@gmail.comwrote: Hello, How can I check

Re: [twitter-dev] Re: Stream api statuses/filter no catching my hashtag

2010-09-21 Thread John Kalucki
Why are you writing your own PHP Streaming API client? It's somewhat complicated to get all the details right. The Phirehose library seems to be well received, and it's incorporated lots of fixes for corner cases. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Sep 21, 2010

Re: [twitter-dev] newbie question on rate limits

2010-09-20 Thread John Kalucki
Large companies, and anyone who wants sustained access to high-volume Twitter data, use the Streaming API. The REST API is primarily for client applications and very-small-scale integrations. Note that REST whitelisting is unlikely for use-cases that are covered by the Streaming API. -John

Re: [twitter-dev] Stream api statuses/filter no catching my hashtag

2010-09-20 Thread John Kalucki
You say you are backing off on HTTP connections. Are you connecting constantly, or just once, and staying connected for very long periods? Are you tracking the number of limit messages you are receiving? Perhaps your track search was rate limited? -John Kalucki http://twitter.com/jkalucki Twitter

Re: [twitter-dev] Filtered Streaming API, Count, and Confusing Wording in the Wiki

2010-09-20 Thread John Kalucki
Count is enabled for higher access levels with the follow parameter on the filter endpoint. Shadow, and Birddog, for example, allow the count parameter. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Mon, Sep 20, 2010 at 7:51 PM, Justin justin.carl...@gmail.com wrote: I found my

Re: [twitter-dev] Re: Twitter client to get updates

2010-09-18 Thread John Kalucki
of resources by giving unlimited service. On Sep 17, 9:30 pm, John Kalucki j...@twitter.com wrote: Look into the User Streams endpoint on the Streaming API if you are building a desktop notification service. If you are building a centralized service, you'll want Site Streams. -John

Re: [twitter-dev] 401s from http://stream.twitter.com/statuses/filter

2010-09-17 Thread John Kalucki
Streaming still supports basic auth, but User Streams and Site Streams endpoints only support OAuth. If you are getting 401s, chances are you are violating a connection policy. -John On Thu, Sep 16, 2010 at 6:27 PM, Aaron Rankin aran...@sproutsocial.comwrote: I'm seeing plenty of 401s

[twitter-dev] Policy clarification on Streaming API, User Stream and Site Stream products

2010-09-17 Thread John Kalucki
. - *Site Streams:* Allows multiplexing of multiple User Streams over a Site Stream connection. Once more than a handful of User Streams connections are opened from the same host or service, Site Streams *must be* used. The primary use case is website and other service integrations. -John

Re: [twitter-dev] Policy clarification on Streaming API, User Stream and Site Stream products

2010-09-17 Thread John Kalucki
-research.net http://twitter.com/znmeb A mathematician is a device for turning coffee into theorems. - Paul Erdos Quoting John Kalucki j...@twitter.com: Posted here: http://dev.twitter.com/pages/streaming_api There are three main Streaming products: The Streaming API, User Streams and Site

Re: [twitter-dev] Question about User Vs Site Streams, and Moving away from REST calls.

2010-09-16 Thread John Kalucki
lower than having a connection to Site Streams? That's what Justin asked, just one connection. Tom On 9/16/10 6:22 AM, John Kalucki wrote: Our intention is that User Streams and Site Streams will, shortly, offer the same data and filtering options at a similar, if not identical, QoS. I'm

Re: [twitter-dev] Re: Twitter Search/Stream API

2010-09-15 Thread John Kalucki
Also, all automated repetitive searching should be on the Streaming API. Search is intended largely for ad-hoc queries. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Wed, Sep 15, 2010 at 12:25 PM, Justin justin.carl...@gmail.com wrote: Also, from what I understand, search may

Re: [twitter-dev] Question about User Vs Site Streams, and Moving away from REST calls.

2010-09-15 Thread John Kalucki
and Site Streams via revocation of access. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Wed, Sep 15, 2010 at 12:24 PM, Justin justin.carl...@gmail.com wrote: I've successfully migrated one of my sites away from making search and mention rest calls, switched over

Re: [twitter-dev] Re: Is gardenhose being ramped up?

2010-09-13 Thread John Kalucki
. Thanks! Sanjay On Sep 13, 12:05 pm, John Kalucki j...@twitter.com wrote: We increased the Gardenhose on August 30, as announced here: http://groups.google.com/group/twitter-api-announce/browse_thread/thr... . We haven't changed the proportion since. A Streaming API application should

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-11 Thread John Kalucki
and the non-working solution. In this case, do you have access to the firehose? Can you use an existing client library? There are dozens of clients for the Streaming API out there. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Sat, Sep 11, 2010 at 12:36 AM, omri omridek...@gmail.com

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread John Kalucki
What text message does it return with the 401 error? You can still use basic auth with streaming. Does that work for you? You should use your screenname and password for basic auth. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Thu, Sep 9, 2010 at 2:48 AM, omri omridek

Re: [twitter-dev] how to apply Birddog role

2010-09-09 Thread John Kalucki
Without more details about your product, it's hard to direct you to the right Twitter product. Please detail your organization and use case to an email to a...@twitter.com. Note that we aren't granting many whitelist requests at this point, so you may have to wait for a response. -John Kalucki

Re: [twitter-dev] Re: help with accessing the streaming api

2010-09-09 Thread John Kalucki
(), code, msg, hdrs, fp) HTTPError: HTTP Error 401: Unauthorized i think i dont know which username and password to type in the header - 'Authorization' 'basic (username:password) the twitter's username? the twitter api oauth? thanks On 9 ספטמבר, 15:42, John Kalucki j

Re: [twitter-dev] Re: Retweet a listed tweet

2010-09-08 Thread John Kalucki
That is weird. It has been fixed though, but I don't know when the fix will deploy. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Wed, Sep 8, 2010 at 6:56 AM, Ken k...@cimas.ch wrote: No... just to clarify, I'm talking about the Twitter.com website. I've wondered about

[twitter-dev] User Streams Update

2010-09-08 Thread John Kalucki
to ensure that everyone has appropriate access to this API. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com

Re: [twitter-dev] User Streams Update

2010-09-08 Thread John Kalucki
As soon as an issue is clear, we tend to announce what we've learned. If I had the list of changes ready to go, I would have posted them. The current general Twitter API TOS applies to User Streams. Follow the TOS and the User Streams Implementation Suggestions... -John Kalucki http

Re: [twitter-dev] User Streams or Site Streams?

2010-09-07 Thread John Kalucki
User Streams onto a single connection. To use User Streams would consume an awful lot of resources on both ends. Site Steams does and will support Home Timelines -- but we're not ready to beta this feature just yet due to a performance issue that we're working through. -John Kalucki http

Re: [twitter-dev] Streaming API

2010-09-07 Thread John Kalucki
of their statuses, but not their timelines. This feature has been in production for over a year. If you have OAuth tokens for the users, you can use the Site Streams beta to get protected user's statuses, but currently you will also get a lot of other information for them as well. -John Kalucki http

Re: [twitter-dev] help with accessing the streaming api

2010-09-07 Thread John Kalucki
haven't provided parameters to track. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Tue, Sep 7, 2010 at 4:38 AM, omri omridek...@gmail.com wrote: def run (self): status_url = http://stream.twitter.com/1/statuses/filter.json; request = urllib2.Request(status_url) print

Re: [twitter-dev] User Streams or Site Streams?

2010-09-07 Thread John Kalucki
and open it for any users interested in it, I'm just a stand alone developer and don't have a company, is my Site Streams request acceptable? Thanks. On Tue, Sep 7, 2010 at 9:40 PM, John Kalucki j...@twitter.com wrote: This app cannot use User Streams and must only use Site Streams. User Streams

Re: [twitter-dev] Hi there

2010-09-05 Thread John Kalucki
These questions are all answered in the documentation: http://dev.twitter.com/pages/streaming_api On Sun, Sep 5, 2010 at 9:57 AM, omri omridek...@gmail.com wrote: I have a few questions regarding the streaming API : How many maximum results I have in one response? Is there a limit of

Re: [twitter-dev] Re: Hi there

2010-09-05 Thread John Kalucki
sample of approximately 10% of the Firehose. You can apply for the Gardenhose by emailing a...@twitter.com. Detail your organization and use case. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Sun, Sep 5, 2010 at 10:53 AM, Tom van der Woerdt i...@tvdw.eu wrote: Yeah, well, the idea

Re: [twitter-dev] Re: Home timeline without authentication

2010-09-04 Thread John Kalucki
This won't contain protected accounts, and would only contain tweets from the last ten minutes or so. -John Kalucki http://twitter.com/jkalucki Twitter, Inc. On Fri, Sep 3, 2010 at 10:12 PM, Karthik fermis...@gmail.com wrote: - Create a fake user that has follows the same accounts, No, I'd

Re: [twitter-dev] Are IDs globally unique? Or just unique for each object type?

2010-09-03 Thread John Kalucki
Unique for each object type. On Fri, Sep 3, 2010 at 11:09 AM, Colin Howe colintheh...@googlemail.comwrote: Are IDs globally unique? Or just unique for each object type? In other words, is it possible to have a user with the ID 7 and also a DM with the ID 7? -- Twitter developer

Re: [twitter-dev] Can we have bulk statuses/show?

2010-09-01 Thread John Kalucki
Fetching a random list of statuses is likely to include a number of statuses that are not in cache. I think accounting for them on a one-by-one basis models our cost fairly well. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Wed, Sep 1, 2010 at 8:00 AM, Jaanus jaa...@gmail.com wrote

Re: [twitter-dev] statuses/filter track and retweets

2010-09-01 Thread John Kalucki
matched term is the last word in the text. -John Kalucki http://twitter.com/jkalucki Twitter Inc. On Wed, Sep 1, 2010 at 7:02 AM, Kostya Nikolayev kostya1...@gmail.comwrote: Hi, I'm using statuses/filter?track=something streaming api. Noticed that it doesn't return native twitter retweets

Re: [twitter-dev] Re: [twitter-api-announce] Announcing Site Streams Beta

2010-09-01 Thread John Kalucki
or use the REST API as a fall-back data source. Disruptions during the beta period should be expected and masked by this fall-back. On Wed, Sep 1, 2010 at 3:21 PM, Dewald Pretorius dpr...@gmail.com wrote: John, That page still says exactly the same. On Aug 30, 5:24 pm, John Kalucki j

Re: [twitter-dev] undo retweets in stream api

2010-09-01 Thread John Kalucki
workaround, albeit often impractical, is to take the full firehose and do the correlation on your end. -John Kalucki http://twitter.com/jkalucki Infrastructure, Twitter Inc. On Tue, Jun 15, 2010 at 8:35 AM, Furkan Kuru furkank...@gmail.com wrote: Yes, the original tweet

  1   2   3   4   5   6   7   >