[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-25 Thread Jacopo Gio
Thank John and Ntwrk Team ! ;-) On Feb 24, 8:48 pm, John Kalucki wrote: > Network operations believes that they found and fixed the proximate cause of > the connection abandonment issue -- a periodically overwhelmed LB CPU. The > LB should close connections in this case, but for some reason it wa

Re: [twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-24 Thread John Kalucki
Network operations believes that they found and fixed the proximate cause of the connection abandonment issue -- a periodically overwhelmed LB CPU. The LB should close connections in this case, but for some reason it wasn't closing them over the last two weeks. Load will be more carefully managed o

Re: [twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-23 Thread M. Edward (Ed) Borasky
On 02/23/2010 09:37 AM, John Kalucki wrote: > Judging my some additional data found yesterday, this drop apparently > happens most often at around say 14:30 and 16:00 UTC, a time period that we > also happen to steeply climb into our daily peak traffic. By our monitoring, > we have not experienced

Re: [twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-23 Thread John Kalucki
Judging my some additional data found yesterday, this drop apparently happens most often at around say 14:30 and 16:00 UTC, a time period that we also happen to steeply climb into our daily peak traffic. By our monitoring, we have not experienced a connection drop so far this morning. But, I have n

[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Sergi
I experienced the problem for the last time today - in fact now yesterday - at 15:55 and after 5 minutes Phirehose reconnected. [22-Feb-2010 15:55:25] Phirehose: Consume rate: 0 status/sec (1 total), avg enqueueStatus(): 0.05ms, avg checkFilterPredicates(): 0.01ms (3 total) over 60 seconds. [22-Fe

Re: [twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Scott Wilcox
Hi John, I've had the same setup for a while now without issue, but from 17:00GMT I started getting connections dropped, then once connected they'd just hang. I'll look into the lib and make sure its not my end. Scott. On 22 Feb 2010, at 22:25, John Kalucki wrote: > I don't believe that we've

Re: [twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Marc Mims
> On Mon, Feb 22, 2010 at 1:53 PM, Scott Wilcox wrote: > > > Same issue here, over the past six hours more than ever. * John Kalucki [100222 14:25]: > I don't believe that we've seen this issue since 15:55 UTC. If you've been > seeing hangs more often, it's possible that you are experiencing an

[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread M. Edward (Ed) Borasky
I have data from the "sample" stream with a gap at the time in question if you'd like it. The last tweet before the gap is status ID 9481349102 created at Mon Feb 22 15:56:27 + 2010. The first tweet after the gap is status ID 9481743502 created at Mon Feb 22 16:06:34 + 2010. I am connected

Re: [twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread John Kalucki
I don't believe that we've seen this issue since 15:55 UTC. If you've been seeing hangs more often, it's possible that you are experiencing another problem. Or, equally likely, there is another set of things going wrong. I've restarted the cluster twice today, but this shouldn't cause hanging -- j

[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Misja Hoebe
John, thanks for looking into this. I experienced an interruption at the same time, 15.55 UTC. Misja On 22 feb, 19:51, John Kalucki wrote: > A number of developers have reported abandoned connection issues on the > Streaming API starting, perhaps, about two weeks ago. The symptoms include a > lo

Re: [twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Scott Wilcox
Same issue here, over the past six hours more than ever. On 22 Feb 2010, at 19:13, John Kalucki wrote: > One further note: A reasonable workaround for the moment is to, if your > client allows iotcls, set a socket timeout of about 90 seconds on your > streaming api connection. The servers curre

[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Stephen Smith
I also experienced an interruption this morning at that time. Stephen

[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Damon C
Hey John, +1 on experiencing that issue this morning. Let me know if there's any way I can help. dpc On Feb 22, 10:51 am, John Kalucki wrote: > A number of developers have reported abandoned connection issues on the > Streaming API starting, perhaps, about two weeks ago. The symptoms include a

[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread John Kalucki
One further note: A reasonable workaround for the moment is to, if your client allows iotcls, set a socket timeout of about 90 seconds on your streaming api connection. The servers currently send a newline every 30 seconds. If you stop receiving newlines for 90 seconds, your connection is probably

[twitter-dev] Re: Streaming API connection abandonment & separation anxiety issues

2010-02-22 Thread Canadaka
I'm I think this could be the problem I've been having. My connection to the streaming API stays connected and works fine initially, but often over time the new tweets stop streaming in, but the connection is still active. I have to stop and restart the process. I've been using the streaming API si