[twitter-dev] Re: A Twitter Query Language (TQL) ?

2009-03-24 Thread John Kalucki
With a relational streaming database, you can perform relational (SQL) queries on the public timeline or the datamining feed and get real- time results. This isn't exactly what you are looking for, but it might meet your needs. I know the folks at www.sqlstream.com have set this up. I'm sure

[twitter-dev] Re: Public Timeline Frozen

2009-05-07 Thread John Kalucki
Matt, As Doug mentioned, we're working on fixing the public timeline. I hope we can get that updating again shortly. As a workaround, you might consider an early migration to the Streaming API. The /spritzer resource should have about the same amount of data, but in an easier to consume format.

[twitter-dev] Streaming API Terms Of Service change - multiple simultaneous logins discouraged

2009-05-09 Thread John Kalucki
will attempt to balance ease-of-use, resource consumption and abuse prevention. -John Kalucki - Services, Twitter Inc. http://twitter.com/jkalucki Important Alpha Test Note: The Streaming API (aka Hosebird) is currently under an alpha test. All developers using the Streaming API must tolerate

[twitter-dev] Re: Streaming API Terms Of Service change - multiple simultaneous logins discouraged

2009-05-10 Thread John Kalucki
not appear too onerous. Unfortunately such clients will require the login credentials to be predicated on production status. If we're missing a use case, let's discuss. We have options at this early stage. -John Kalucki - Services, Twitter Inc. http://twitter.com/jkalucki On May 10, 12:55 pm, benburkert

[twitter-dev] New Public Streaming API Resource - Follow

2009-05-12 Thread John Kalucki
Note: The Streaming API is currently under a limited alpha test, details below. The /follow Streaming API resource is now publicly available. This resource streams near-real-time public updates posted by an arbitrary set of users. Streaming by user_id may be interesting to a variety of

[twitter-dev] Re: Streaming API's XML format

2009-05-13 Thread John Kalucki
13, 2009 at 6:24 AM, John Kalucki jkalu...@gmail.com wrote: Ianiv, I'm glad you are giving the XML feed a close examination. Nearly all consumers so far have been on the JSON feed. The statuses begin their life upstream from Hosebird as these fully- formed documents. Hosebird doesn't

[twitter-dev] Re: Streaming API's XML format

2009-05-13 Thread John Kalucki
having to wrap the parser inside another one that splits the feed into documents then parsing each document individually. Ianiv Schweber ia...@blogaholics.ca Skype: ianivs Public Key:http://www.blogaholics.ca/ianivpubkey.asc On Wed, May 13, 2009 at 6:24 AM, John Kalucki jkalu...@gmail.com wrote

[twitter-dev] Re: New Public Streaming API Resource - Follow

2009-05-13 Thread John Kalucki
available seems quite unsecure. Any plans to also support https soon (or any other mechanism which gives better security?) Thanks, Marco 2009/5/13 John Kalucki jkalu...@gmail.com Chad, Yes, I think this is called POSTDATA in browsers. I don't recall what the actual name

[twitter-dev] Re: Streaming API Terms Of Service change - multiple simultaneous logins discouraged

2009-05-14 Thread John Kalucki
to these services, i.e. I want to set up a stream for x,y and z users and another stream for p,q and r users. Is that a valid use of those streams? Thanks, dpc On May 9, 9:04 pm, John Kalucki jkalu...@gmail.com wrote: Note: The Streaming API is currently under a limited alpha test, details below

[twitter-dev] Re: New Public Streaming API Resource - Follow

2009-05-14 Thread John Kalucki
 am, Marco Kaiser kaiser.ma...@gmail.com wrote: 2009/5/13 John Kalucki jkalu...@gmail.com I'll attempt to answer these questions, but I can only do so with some speculation and humble ignorance. 1) OAuth allows clients to authenticate with the Twitter REST API via third-party services

[twitter-dev] Re: stream follow request not working

2009-05-21 Thread John Kalucki
. The newlines are keep-alive probes. -John Kalucki Services, Twitter Inc. On May 21, 4:22 am, developerinlondon ebilliona...@gmail.com wrote: I tried using the stream API call documented here:http://apiwiki.twitter.com/Streaming-API-Documentation#Connecting At the bottom there is the following example

[twitter-dev] Re: Public timeline sample data set.

2009-05-21 Thread John Kalucki
to store and serve the SGS for internal purposes. The size and velocity alone make it, cough, cough, unwieldy.) If you are interested in doing this sort of analysis full-time, apply for a job! We're a data-driven shop, and we're always crawling over the numbers. -John Kalucki Services, Twitter

[twitter-dev] Re: Public timeline sample data set.

2009-05-22 Thread John Kalucki
The /spritzer feed is open to everyone with a Twitter account: http://apiwiki.twitter.com/Streaming-API-Documentation -John Kalucki Services, Twitter Inc. On May 22, 8:48 am, Burhan TANWEER btanw...@gmail.com wrote: How can I get access to /gardenhose and /spritzer feeds? On Thu, May 21

[twitter-dev] Re: Is the spritzer supposed to be as fast as the datamining feed?

2009-05-26 Thread John Kalucki
and week, so be sure you are comparing the exact same time periods. -John Kalucki Services, Twitter Inc. On May 25, 7:20 pm, Twittledee webs...@twittledee.com wrote: Hello:  In an answer to a different question in this group, Doug said that the spritzer was supposed to be as fast

[twitter-dev] Re: Streaming API: /spritzer sending nothing but keep-alives after a while

2009-05-26 Thread John Kalucki
Digging into this... -John Kalucki Services, Twitter Inc. On May 26, 4:58 pm, Chad Etzel jazzyc...@gmail.com wrote: New debugging output shows I just received 44,574 tweets before getting only keep-alive newlines every 20 seconds for about 30 minutes before I killed the script and restarted

[twitter-dev] Re: Twitter stream api -ping service-

2009-05-26 Thread John Kalucki
, they are written immediately on the TCP socket. You read them with a HTTP client that is capable of incremental reads. After that, you are on your own, route them within your application as you see fit. -John Kalucki Services, Twitter Inc. On May 26, 11:42 am, techtimes techf...@gmail.com wrote: Hi, If I

[twitter-dev] Re: Streaming API: Spritzer-stream coverage

2009-05-27 Thread John Kalucki
, and there's plenty we don't know just yet. -John Kalucki Services, Twitter Inc. On May 26, 11:55 pm, Brendan O'Connor breno...@gmail.com wrote: On Tue, May 26, 2009 at 10:07 PM, elversatile elversat...@gmail.com wrote: Makes sense. I was assuming the same. Thanks people! John from Twitter said

[twitter-dev] Re: Source showing as web

2009-05-31 Thread John Kalucki
, but it's not yet clear when the issue will be fixed. -John Kalucki Services, Twitter, Inc. On May 30, 10:35 pm, Swap rh.swar...@gmail.com wrote: All tweets seem to be showing as posted from web? :)

[twitter-dev] Re: source name has switch to web

2009-05-31 Thread John Kalucki
, but it's not yet clear when the issue will be fixed. -John Kalucki Services, Twitter, Inc. On May 31, 1:19 am, Adrian spiritpo...@gmail.com wrote: Hi, all preexisting and newly added tweets with source Twitya have changed to Web. Tweets are added using 'source=twitya' in the post querystring as per

[twitter-dev] Re: Reg: Follow/Un-Follow Multiple users

2009-06-02 Thread John Kalucki
in the Streaming API, or, consider searching for a hashtag in the Search API. -John Kalucki Services, Twitter Inc. On Jun 1, 11:29 pm, kkp 33spa...@gmail.com wrote: Hi, I want to follow/unfollow multiple users in one web request. At present i am following/un follow users individually by sending each

[twitter-dev] Re: Sreaming API: /follow closing immediately

2009-06-04 Thread John Kalucki
and /follow from the same account, the first connection may be thrown off by the second connection. -John Kalucki Services, Twitter, Inc. On Jun 4, 2:26 pm, Chad Etzel jazzyc...@gmail.com wrote: I am playing with the follow methods, and they have been acting funny all day.  Lately it just

[twitter-dev] Re: A Fresh Look At Follower Processing

2009-06-05 Thread John Kalucki
Hosebird already works. It practically writes itself. It would be a help to describe some compelling use cases for this data beyond efficiency, QoS and ease of use. -John Kalucki Services, Twitter Inc. On Jun 5, 6:08 am, dewald dpr...@gmail.com wrote: New follower processing using the Social Graph

[twitter-dev] Re: Streaming API: missing updates non-indexed user correlation?

2009-06-05 Thread John Kalucki
that everything is working by the rules, if not also by design. These two concepts are not always in alignment! -John Kalucki Services, Twitter, Inc. On Jun 5, 10:09 am, Chad Etzel jazzyc...@gmail.com wrote: Hi John, et al. I have been playing with the /follow streams and noticed that some

[twitter-dev] Re: Streaming API: missing updates non-indexed user correlation?

2009-06-05 Thread John Kalucki
for /follow methods. Any other opinions out there? -Chad On Fri, Jun 5, 2009 at 1:44 PM, John Kalucki jkalu...@gmail.com wrote: There are multiple bits set for accounts that control various levels of access and all kinds of folderol. It's complicated and for mostly understandable reasons

[twitter-dev] Re: Twitter Apps

2009-06-08 Thread John Kalucki
. -John Kalucki Services, Twitter Inc. On Jun 7, 12:02 am, umaydin devnetw...@gmail.com wrote: Hello, I have a social network and I want my members share their twitter updates on profile pages as same as in facebook, friendfeed, etc. My updates are going to be shown in 5 seconds in friendfeed

[twitter-dev] Re: Streaming API + PHP and Python

2009-06-08 Thread John Kalucki
in the chunked transfer coding in the PHP client wherein it cannot support endless streams. Some resource is exhausted or administratively limited (php.ini), and the stream stops. -John Kalucki Services, Twitter Inc. On Jun 8, 1:16 pm, Chad Etzel jazzyc...@gmail.com wrote: Hi All, I am stumped

[twitter-dev] Streaming API -- /follow /birddog and /shadow also match in_reply_to field.

2009-06-09 Thread John Kalucki
@user!), but aren't explicit replies, are not matched. -John Kalucki Services, Twitter Inc.

[twitter-dev] Re: Streaming API -- /follow /birddog and /shadow also match in_reply_to field.

2009-06-09 Thread John Kalucki
of attribute to the status object which indicates when this is the case? (i.e. this update is being sent to you, but the user id of the sender is not explicitly in the follow id list?) Would be handy, perhaps. -Chad On Tue, Jun 9, 2009 at 10:46 PM, John Kalucki jkalu...@gmail.com wrote

[twitter-dev] Re: Streaming API -- /follow /birddog and /shadow also match in_reply_to field.

2009-06-10 Thread John Kalucki
of for everyone. This duplicate update also happens if you have the same user id listed twice (or more) in the follow id list.  I found this out by merging two follow lists which overlapped.  'sort' and 'uniq' became my friends soon thereafter. -Chad On Tue, Jun 9, 2009 at 11:24 PM, John Kalucki jkalu

[twitter-dev] Re: Streaming API -- /follow /birddog and /shadow also match in_reply_to field.

2009-06-10 Thread John Kalucki
twice (or more) in the follow id list.  I found this out by merging two follow lists which overlapped.  'sort' and 'uniq' became my friends soon thereafter. -Chad On Tue, Jun 9, 2009 at 11:24 PM, John Kalucki jkalu...@gmail.com wrote: Unlikely. In general, we treat a status

[twitter-dev] Re: New Public Streaming API Resource - Follow

2009-06-10 Thread John Kalucki
receive from those users. -John Kalucki Services, Twitter Inc. On Jun 10, 9:26 am, AE antonio_eggb...@yahoo.se wrote: Hi John Questions regardingfollow. On May 13, 10:50 pm, John Kalucki jkalu...@gmail.com wrote: I'll attempt to answer these questions, but I can only do so with some

[twitter-dev] Re: New Public Streaming API Resource - Follow

2009-06-11 Thread John Kalucki
them coming! -John Kalucki Services, Twitter, Inc. On Jun 11, 8:15 am, AE antonio_eggb...@yahoo.se wrote: On Jun 10, 6:51 pm, John Kalucki jkalu...@gmail.com wrote: I haven't done the math, but I don't think a single prolific user could tweet more than you can consume. Now, if you are trying

[twitter-dev] Re: New Public Streaming API Resource - Follow

2009-06-11 Thread John Kalucki
to allow more applications to operate. I hope I've answered your questions. Keep them coming! -John Kalucki Services, Twitter, Inc. On Jun 11, 8:15 am, AE antonio_eggb...@yahoo.se wrote: On Jun 10, 6:51 pm, John Kalucki jkalu...@gmail.com wrote: I haven't done the math, but I don't

[twitter-dev] Streaming API -- Code Change Required: follow parameter delimiter

2009-06-12 Thread John Kalucki
The follow post parameter now takes a comma separated list of userids to follow in the /follow, /track and /birddog resources. This change is being made to support future features. Space separated lists will also be supported until Wednesday June 17 to allow for transition. -John Kalucki

[twitter-dev] Streaming API -- Announcing /track resource - Search on status text

2009-06-12 Thread John Kalucki
little, if any, notice. Any developer may experiment with the unrestricted resources and provide feedback via this list. Access to restricted resources is extremely limited and is only granted on a case-by-case basis after acceptance of an additional terms of service document. -John Kalucki Services

[twitter-dev] Streaming API -- Note for desktop developers

2009-06-12 Thread John Kalucki
For the moment the Streaming API is primarily intended for consumption by partner services. Developers considering desktop deployment of Streaming API clients must coordinate with a...@twitter.com. -John Kalucki http://www.twitter.com/jkalucki Services, Twitter Inc.

[twitter-dev] Re: how is the gardenhose actually selected?

2009-06-12 Thread John Kalucki
other purposes, however, it's probably not terribly useful. If you want to follow specific users, consider the /follow resource. -John Kalucki Services, Twitter Inc. On Jun 12, 3:27 pm, braver delivera...@gmail.com wrote: Is there any guarantee that we'll follow certain users sufficiently

[twitter-dev] Re: location data for searched tweets

2009-06-18 Thread John Kalucki
The entire user profile, including location, is returned for each match in the Streaming API /track method. Matches are by keyword, not phrase. -John Kalucki Services, Twitter Inc. On Jun 18, 5:29 pm, Germig i...@exbeerde.de wrote: Hi, is it  not possible to get the location data as a return

[twitter-dev] Re: Streaming API Terms Of Service change - multiple simultaneous logins discouraged

2009-06-23 Thread John Kalucki
You can't have multiple logins per account at the moment. In general, contact the API group for help with this. In this case, I'll set things up for you. -John Kalucki Services, Twitter Inc. On Jun 23, 7:26 am, கார்த்திக்.மு fermis...@gmail.com wrote: John, Can we have two concurrent

[twitter-dev] Re: Reg gardenhose feed

2009-06-25 Thread John Kalucki
. If you use a reasonable JSON parser, it will mask all of these issues for you. If you try to pick the text apart via other means, you will be continuously reworking as the status format evolves and as the JSON encoder capriciously reorders its output. -John Kalucki Services, Twitter. Inc. On Jun

[twitter-dev] Re: streaming api multiple connections

2009-06-30 Thread John Kalucki
of few other valid use cases for more than one or two connections from the same service, user or company. -John Kalucki Services, Twitter Inc. On Jun 29, 10:06 pm, Hardeep Khehra hardeep.s.khe...@gmail.com wrote: will the streaming track api allow multiple connections from the same IP using

[twitter-dev] Streaming API -- Pre-launch checklist added to Wiki

2009-06-30 Thread John Kalucki
Some tips for developers, copied below: Pre-Launch Checklist 1. Creating the minimal number of connections? 2. Avoiding duplicate logins? 3. Backing off from failures: none for first disconnect, seconds for repeated network (TCP/IP) level issues, minutes for repeated HTTP (4XX codes)?

[twitter-dev] Re: Why are there pagination limits

2009-06-30 Thread John Kalucki
. (Apologies to Doug and the API team.) -John Kalucki Services, Twitter Inc. On Jun 30, 4:15 pm, Scott Haneda talkli...@newgeo.com wrote: Been pondering this today.  There seem to be 7 day limits, or around   3000 tweet limits to the API.  At first, my gut told me that was for   load reasons

[twitter-dev] Re: Stream API : Tracker

2009-07-06 Thread John Kalucki
The documentation is incorrect. But, instead of fixing the documentation, it's reasonable to fix the code. For the time being, you'll have to query for the three permutations. -John Kalucki Services, Twitter Inc. On Jul 5, 9:30 pm, Cary Knoop carykn...@gmail.com wrote: Unlike the wiki

[twitter-dev] Re: Stream API : Tracker

2009-07-07 Thread John Kalucki
A fix for this issue will be deployed this afternoon, PDT. -John Kalucki Services, Twitter inc. On Jul 6, 12:21 pm, John Kalucki jkalu...@gmail.com wrote: The documentation is incorrect. But, instead of fixing the documentation, it's reasonable to fix the code. For the time being, you'll

[twitter-dev] Re: Streaming API -- Code Change Required: follow parameter delimiter

2009-07-07 Thread John Kalucki
A reminder: Support for space separated track and follow lists will be dropped in this afternoon's Streaming API deploy. Only comma separated lists will be accepted. On Jun 12, 11:53 am, John Kalucki jkalu...@gmail.com wrote: The follow post parameter now takes acommaseparated list of userids

[twitter-dev] Re: Whitelist Limits

2009-07-08 Thread John Kalucki
and I'll get them to the Platform product manager. -John Kalucki twitter.com/jkalucki Services, Twitter Inc. On Jul 7, 8:57 pm, whoiskb whoi...@gmail.com wrote: From what I can tell, the white list limits are 20,000 calls per hour.  I am curious if any app out there has come close to hitting

[twitter-dev] Re: updating follow/shadow/birddog list of users

2009-07-08 Thread John Kalucki
case and I'll forward it on to the Platform PM to help prioritize the better solution, as outlined by Alex. -John Kalucki twitter.com/jkalucki Services, Twitter Inc. On Jul 8, 12:17 pm, braver delivera...@gmail.com wrote: Uf you have thousands of users, do you really have to cook up a following

[twitter-dev] Re: How to insure that all tweets are retrieved in a search?

2009-07-09 Thread John Kalucki
with no other rate limiting. Contact us if the default limits are an issue. -John Kalucki Services, Twitter Inc. On Jul 9, 3:51 pm, owkaye owk...@gmail.com wrote: You are correct, you have to do 15 requests.  However, you can cache the results in your end, so when you come back, you are only

[twitter-dev] Re: Appx # of records in gardenhose

2009-07-09 Thread John Kalucki
2m - 3m, very roughly. On Jul 9, 8:34 pm, dhaval dhaval.parik...@gmail.com wrote: hey can ne one tell me the # of records we get appx in gardenhose per day? Thanks

[twitter-dev] Streaming API -- New objects in markup stream. Test your code

2009-07-10 Thread John Kalucki
experiment with the unrestricted resources and provide feedback via this list. Access to restricted resources is extremely limited and is only granted on a case-by-case basis after acceptance of an additional terms of service document. -John Kalucki twitter.com/jkalucki Services, Twitter Inc.

[twitter-dev] Re: Streaming API: updating request parameters

2009-07-10 Thread John Kalucki
This isn't implemented. I don't think we could, either, given our server framework. Create a new connection with the updated parameters. As soon as you receive data from the new connection, close the old connection. Keep the churn rate low, don't reconnect too often, and you should stay out of

[twitter-dev] Re: Streaming API -- New objects in markup stream. Test your code

2009-07-11 Thread John Kalucki
you please clarify what we should be expecting to see in JSON ? And maybe also provide some sample objects in the Wiki, both for XML and JSON ? Thanks ! -Laurent On Jul 10, 8:00 pm, John Kalucki jkalu...@gmail.com wrote: Note: The Streaming API is currently under a limited alpha test

[twitter-dev] Re: Streaming API/ track method - results Tweets from Dec. 2008

2009-07-11 Thread John Kalucki
Unless there's been a server restart and some unusual resulting backlog, nearly all tweets from /track will be forwarded within a second or two of being posted. I suspect you are conflating the created_at of the user with the created_at of the status. I've done this many times. -John Kalucki

[twitter-dev] Re: Streaming API -- New objects in markup stream. Test your code

2009-07-11 Thread John Kalucki
? This would allow for   overlap and testing. -Joel On Jul 11, 2009, at 7:04 AM, John Kalucki jkalu...@gmail.com wrote: Laurent, There are examples of the new objects on the Streaming API wiki. The XML and JSON formats are, sadly, not orthogonal. The objects aren't flowing to give

[twitter-dev] Re: How to insure that all tweets are retrieved in a search?

2009-07-13 Thread John Kalucki
track access for services. It's possible that you are worrying about an unlikely event. Sustained single topic statuses in the thousands per minute are usually limited to things like massive social upheaval, big political events, celebrity death, etc. -John Kalucki twitter.com/jkalucki Services

[twitter-dev] Streaming API -- Additional markup added -- Deletion notifications on track streams.

2009-07-13 Thread John Kalucki
} } -John Kalucki twitter.com/jkalucki 
Services, Twitter Inc.

[twitter-dev] Re: Streaming API -- Additional markup added -- Deletion notifications on track streams.

2009-07-14 Thread John Kalucki
Yes, the two are related. Good sleuthing. On Jul 13, 10:08 pm, Damon Clinkscales sca...@pobox.com wrote: On Mon, Jul 13, 2009 at 9:53 PM, John Kaluckijkalu...@gmail.com wrote: Deletions will be enabled on or after Thursday July 16th, as previously scheduled. From the wiki,  

[twitter-dev] Re: How to track a phrase in Streaming API?

2009-07-14 Thread John Kalucki
for Harry OR Potter, but not Harry AND Potter. It's probably best to track on the lowest frequency word in the phrase, to avoid the rate limit. -John Kalucki twitter.com/jkalucki Services, Twitter Inc. On Jul 14, 8:26 am, owkaye owk...@gmail.com wrote: How do I track a phrase like harry potter

[twitter-dev] Re: number of search results for query

2009-07-16 Thread John Kalucki
. An approximation is all you'll get from any approach, as there is no totally unfiltered source of statuses -- for example, protected users' statuses are unavailable, how do you account for deleted statuses, etc. etc., so you are always estimating. -John Kalucki twitter.com/jkalucki Services

[twitter-dev] Re: Process every single Tweet.

2009-07-17 Thread John Kalucki
make your results worthless, by hitting the Search API. All other approaches will be rate limited or considered scraping. Scraping is frowned upon and you'll be quickly detected and blocked. I'd suggest recasting your project to the sample available in the gardenhose. -John Kalucki twitter.com

[twitter-dev] Re: The Gardenhose Cooperative

2009-07-22 Thread John Kalucki
Section 5) ii) b) and e) of the Gardenhose EULA cover this issue. On Jul 22, 3:41 pm, braver delivera...@gmail.com wrote: After we lost a few days of gardenhose, I'm wondering whether it would be OK for us gardenhosers to back up each other.  In case we do research, for instance -- as we do

[twitter-dev] Re: id field is missing in status from streaming API frequently

2009-07-24 Thread John Kalucki
It appears that you are treating status deletions as statuses. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Jul 24, 3:18 pm, AJ Chen cano...@gmail.com wrote: twitter streaming api has lots of statuses missing id? the following exception appears almost continuously

[twitter-dev] Re: Open streams limits

2009-07-27 Thread John Kalucki
, contact us. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Jul 27, 6:31 am, Joseph northwest...@gmail.com wrote: Using the streaming API, is it possible to open up more than one stream using the same login credentials, or would that be a considered bad behavior? For instance, I

[twitter-dev] Re: Open streams limits

2009-07-27 Thread John Kalucki
(sleepMs) sleepMs = Math.min(sleepMs * 2, maxSleepMs) } -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Jul 27, 7:46 am, Joseph northwest...@gmail.com wrote: Thanks for the answer. A follow up: assuming there's no problem with my code, but I am getting errors opening up

[twitter-dev] Re: track syntax

2009-07-27 Thread John Kalucki
with curl(1) and capture the interaction with a protocol decoder, perhaps Wireshark. Then analyze your client, and fix the deltas. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Jul 27, 11:18 am, Joseph northwest...@gmail.com wrote: I am trying to use the track streaming API

[twitter-dev] Re: updating follow/shadow/birddog list of users

2009-07-27 Thread John Kalucki
the /shadow stream is still connected. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Jul 27, 7:18 pm, nickdella nick.dellamaggi...@gmail.com wrote: Hi, I'm working on a similar system in which members on my site dynamically subscribe to Twitter. Thus, my following list

[twitter-dev] Re: updating follow/shadow/birddog list of users

2009-07-28 Thread John Kalucki
. Consider an explicit limiter on your end that prevents connecting more than once every one or two minutes. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Jul 27, 8:53 pm, nickdella nick.dellamaggi...@gmail.com wrote: John, Thanks for the quick reply!  The /shadow

[twitter-dev] Re: Knowing how to judge Search API rate limits

2009-08-05 Thread John Kalucki
Steve, It sounds like you should consider the /follow method in the streaming API. You'll get similar results with no latency or rate limits. If you need to follow more users, apply for the /shadow method. If you also want mentions, you can use /track. -John Kalucki http://twitter.com/jkalucki

[twitter-dev] Re: Knowing how to judge Search API rate limits

2009-08-06 Thread John Kalucki
limiting hassles. Let me know if you have any questions or issues with the Streaming API, or just post to this list. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 5, 12:11 pm, Josh Shabtai joshshab...@gmail.com wrote: Hi there.  I was just about to start a thread

[twitter-dev] Re: Current Twitter site status

2009-08-06 Thread John Kalucki
Monitor the Twitter Blog, but yes, various services are still recovering and/or flapping. For the next few hours, I'd assume it's a problem on Twitter's side, not on your side. On Aug 6, 11:43 am, David Fisher tib...@gmail.com wrote: Is the Search API being effected? I thought at first that I

[twitter-dev] Streaming API -- Recheck your clients -- post DDoS cleanup

2009-08-06 Thread John Kalucki
, or any other issue that started today, please contact me with your account name and IP address, and I'll work to resolve the issue. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc.

[twitter-dev] Re: HTTP 409 on status update via API

2009-08-06 Thread John Kalucki
This should be fixed for the Streaming API. -John On Aug 6, 1:59 pm, Jennie Lees trin...@gmail.com wrote: Getting the same thing using the track function of the API. On Thu, Aug 6, 2009 at 9:43 PM, briantroy brian.cosin...@gmail.com wrote: Sorry... these are HTTP 408s... On Aug 6,

[twitter-dev] Re: Gardenhose API

2009-08-07 Thread John Kalucki
quite slow and or stop. Please feel free to disconnect and reconnect if the stream appears too slow. I've eased the anti-abuse system, and I'll ease it more if needed to allow clients to ride this out. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 6, 10:12 pm, Kris

[twitter-dev] Re: You have been rate limited. Enhance your calm.

2009-08-07 Thread John Kalucki
Is your library following redirects? On Aug 7, 10:18 am, David Fisher tib...@gmail.com wrote: If you're getting that then you're getting more than me. I'm just doing: require 'rubygems' gem 'twitter' require 'twitter' Twitter::Search.new('foo').each do |r|   puts r.inspect end And I

[twitter-dev] Streaming API -- Saturday Morning Status Update

2009-08-08 Thread John Kalucki
-product. Then, there's an attack dynamically probing and leveraging weaknesses. We understand the impact this is having on the community. Thanks for your understanding. John Kalucki http://twitter.com/jkalucki Services, Twitter inc.

[twitter-dev] Re: 302s are NOT the solution

2009-08-08 Thread John Kalucki
protocol. Consider why applications are not built using fully HTTP compliant libraries. This doesn't address all the problems that we're all having, but it does address some. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 8, 8:53 am, Kyle Mulka repalvigla...@yahoo.com

[twitter-dev] Re: PubSubHubbub and Twitter RSS

2009-08-09 Thread John Kalucki
hubs. If you are looking at RSS feeds, I'd guess that you are looking at grabbing user timelines. The Streaming API already supports this via the /follow resource. If this doesn't meet your needs, email me with your requirements and we'll see how we can support your use case. -John Kalucki http

[twitter-dev] Re: Keyword searching the Friends Timeline

2009-08-09 Thread John Kalucki
or the Search API are the easiest, as you won't run into any rate limiting issues with either for a reasonably infrequent keyword. John Kalucki twitter.com/jkalucki Services, Twitter Inc. On Aug 9, 9:56 pm, trident maklymc...@gmail.com wrote: Hello, I am running a contest on twitter, and I

[twitter-dev] Re: twitter Apis not working

2009-08-10 Thread John Kalucki
detailed information about exactly what is failing, including your IP address. Thanks, John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 10, 5:13 am, Sultan Saadat sultansaa...@gmail.com wrote: i think the reprecussions of the DDOS attack on twitter are still prevailing. My

[twitter-dev] Registering new applications should not be blocked

2009-08-10 Thread John Kalucki
trace of a failure or two sent to a...@twitter.com should a resource become available to look at this issue. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc.

[twitter-dev] Re: PubSubHubbub and Twitter RSS

2009-08-11 Thread John Kalucki
for various levels of access, disable malicious actors, and so forth. By pushing out to a hub, we've ceded control of these issues. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 9, 9:35 am, Jesse Stay jesses...@gmail.com wrote: On Sun, Aug 9, 2009 at 2:23 AM, John Kalucki

[twitter-dev] Re: PubSubHubbub and Twitter RSS

2009-08-11 Thread John Kalucki
I want to believe! If there are compelling arguments, we'll consider this deeply. So far I'm still unconvinced. The Streaming API is built only on open standards: HTTP, XML, JSON. Anyone can build a Streaming API client in a few hours of work using well worn libraries and techniques. (Only a

[twitter-dev] Re: Following a large number of users

2009-08-12 Thread John Kalucki
private accounts, for example. -John Kalucki twitter.com/jkalucki Services, Twitter Inc. On Aug 12, 7:10 am, murphy murphyb...@gmail.com wrote: We are building a suite of applications for Facebook Pages and one of the features is integration of user's twitter status updates into their facebook

[twitter-dev] Streaming API -- ordering guarantees: deletions may come before status updates

2009-08-13 Thread John Kalucki
deletion. Yes, deletion notices may be delivered in advance of the status itself. Even in this apparently odd situation, the delete statuses still must be purged from your backing store. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc.

[twitter-dev] Re: streaming API track method missing statuses?

2009-08-13 Thread John Kalucki
Andrew, If your test account statuses show up in search, but not in track, and you haven't been rate limited in track, then there's a problem. If the test account doesn't show up in search, it won't show up in the Streaming API either. I don't understand your second question. -John Kalucki

[twitter-dev] Re: streaming API track method missing statuses?

2009-08-14 Thread John Kalucki
Track keywords are logically ORed together. Give it a try. It should work as you expect. If not, let's figure it out. (OTOH: You have to do logical ANDs via post processing on your end.) -John Kalucki twitter.com/jkalucki Services, Twitter, Inc. On Aug 13, 9:56 pm, Andrew McCloud

[twitter-dev] Re: Track vs. Search

2009-08-24 Thread John Kalucki
If you want a larger proportion of the statuses, you can apply for a higher level of track access. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 22, 8:17 am, Mark Nutter marknut...@gmail.com wrote: @Will Yeah, that's what we're currently using, and it works well

[twitter-dev] Re: streaming api - track method with oauth ?

2009-08-24 Thread John Kalucki
OAuth is desired, but it's a very low priority right now. We're focused on supporting Twitter to Services interactions in the Streaming API, while attempting to not preclude Twitter to Client interactions. John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 18, 3:40 pm

[twitter-dev] Re: Track API Limit message meaning

2009-08-24 Thread John Kalucki
that your predicate is too broad, and you should consider a predicate with higher selectivity. Alternatively, you can apply for higher levels of track access that allow a higher proportion of statuses to be delivered. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Aug 21, 12

[twitter-dev] Re: Getting access to Birddog or Shadow

2009-08-24 Thread John Kalucki
Lyn, Please describe your application in an email to a...@twitter.com. Also, create a new account for this access, read and accept the EULA at twitter.com/help/request_streaming, and send this account along in your email. -John On Aug 20, 3:27 pm, Lyn Headley lahea...@gmail.com wrote: Hello,

[twitter-dev] Streaming API -- Changes yesterday and today.

2009-08-26 Thread John Kalucki
Various significant changes have been made to the Streaming API yesterday, and further changes should be expected today. So far we haven't observed any increased failure rates. If you notice any new failure behavior today, please post on this thread immediately, or just @jkalucki. -John Kalucki

[twitter-dev] Streaming API -- CHANGE REQUIRED -- URL rationalization

2009-08-26 Thread John Kalucki
/birddog, /shadow, /follow - /1/statuses/filter /partner/track, /restricted/track, /track - /1/statuses/filter For example, if you have been connecting to /gardenhose.json, connect to /1/statuses/sample.json. Note that the Streaming API is still in Alpha test. -John Kalucki http://twitter.com

[twitter-dev] Re: Streaming API -- CHANGE REQUIRED -- URL rationalization

2009-08-26 Thread John Kalucki
This change went into effect at about 3pm PST Tuesday August 25th. On Aug 26, 12:30 pm, Joel Strellner j...@twitturly.com wrote: When does this change go into effect? -Joel On Wed, Aug 26, 2009 at 12:06 PM, John Kalucki jkalu...@gmail.com wrote: The resources in the Streaming API have

[twitter-dev] Re: Problem in past 48 hours: friendships/create severe lag or loss

2009-08-31 Thread John Kalucki
, will eventually work?  Since we database all of these actions, we're worried that we're going to have bad data for the past, e.g., 48 hours, unless those non-error calls actually go through. On Aug 31, 12:03 pm, John Kalucki jkalu...@gmail.com wrote: We're on this. Updates from the usual sources

[twitter-dev] Re: track syntax

2009-08-31 Thread John Kalucki
You can set both the track and follow parameters when using the /1/ statuses/filter URL. Best practices around changing your predicate: http://apiwiki.twitter.com/Streaming-API-Documentation#UpdatingFilterPredicates I can't answer PHP questions, sorry. -John Kalucki http://twitter.com/jkalucki

[twitter-dev] Re: Stream API Count Parameter

2009-09-01 Thread John Kalucki
that not all roles, resources and parameter combinations support the count parameter. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Sep 1, 2:47 pm, Sameer sameer.kha...@gmail.com wrote: Hello, my question is in regards to the Stream API and how to deal with getting statuses

[twitter-dev] Re: Stream API Count Parameter

2009-09-01 Thread John Kalucki
provides a k-sorted stream and therefore could provide some sort of k-aware predicate filtering based on a recent estimation of k. That wouldn't quite be since_id though. In any case, you are left with some uncertainty and some over- delivery and client-side deduplication. -John Kalucki http

[twitter-dev] Re: Twitter IP Whitelisting

2009-09-02 Thread John Kalucki
into a posting limit and there's a corner-case error condition that your HTTP client isn't logging and alerting? -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Sep 1, 11:28 pm, Andy Pirate piratea...@gmail.com wrote: So here's the deal. We've had the Twitter API integrated

[twitter-dev] Re: Would like to have a database of tweets for a filter

2009-09-02 Thread John Kalucki
Search will give you results for the last several days. Then switch over to stream.twitter.com and use the track parameter on stream.twitter.com/1/statuses/filter.format. -John Kalucki http://twitter.com/jkalucki Services, Twitter Inc. On Sep 2, 8:06 am, Stuart stut...@gmail.com wrote: 2009/9

  1   2   3   4   5   6   7   >