We're still seeing very low tweet rates from our polls.  We have 40+
searches and 40+ timeline (actually List timelines) that have been
running fine for may months.  Over the last two days, even though
we've gotten successful polls, the rate of tweets is WAY down (like an
order of magnitude).

In the following hour-by-hour dump, you can see the patterns of normal
ebb-and-flow over time (since the focus of what we monitor is St.
Louis local, the volume follows).  The columns are the hour slot, the
number "matched" (e.g. returned from Twitter) and the number
"inserted" (e.g. the new tweets not seen in another search).  There
are some weird lines where I reset the "since_id" to zero so we could
try catching up.  Any ideas when  this will get better?

The vast majority of our results have traditionally come in from a
geocode search like below (returned one tweet, normally returns dozens/
100 per pulse [hence the need for since_id]);

http://search.twitter.com/search.atom?rpp=100&lang=en&geocode=38.627522%2C-90.19841%2C30mi&since_id=15864634317

2010-06-10 17:00:00.000 437     200
2010-06-10 16:00:00.000 678     308
2010-06-10 15:00:00.000 667     277
2010-06-10 14:00:00.000 705     427
2010-06-10 13:00:00.000 481     247
2010-06-10 12:00:00.000 442     257
2010-06-10 11:00:00.000 320     225
2010-06-10 10:00:00.000 235     158
2010-06-10 09:00:00.000 6524    181   <- I reset the since_id again, but
no NEW messages
2010-06-10 08:00:00.000 433     284
2010-06-10 07:00:00.000 190     169
2010-06-10 06:00:00.000 427     368
2010-06-10 05:00:00.000 408     290
2010-06-10 04:00:00.000 664     434
2010-06-10 03:00:00.000 803     503
2010-06-10 02:00:00.000 594     440
2010-06-10 01:00:00.000 4654    1318  <- I reset the since_id to catch up
2010-06-09 20:00:00.000 571     253
2010-06-09 19:00:00.000 597     244
2010-06-09 18:00:00.000 669     281
2010-06-09 17:00:00.000 2190    995
2010-06-09 15:00:00.000 10      10
2010-06-09 14:00:00.000 456     180
2010-06-09 13:00:00.000 1013    641
2010-06-09 12:00:00.000 628     386
2010-06-09 11:00:00.000 454     351
2010-06-09 10:00:00.000 355     281
2010-06-09 09:00:00.000 266     224
2010-06-09 08:00:00.000 449     371     <- twitter goes wonky
2010-06-09 07:00:00.000 1881    1798
2010-06-09 06:00:00.000 2601    2467
2010-06-09 05:00:00.000 3020    2780
2010-06-09 04:00:00.000 3793    3461
2010-06-09 03:00:00.000 3187    2827
2010-06-09 02:00:00.000 705     467      <- our maint period completes
2010-06-09 01:00:00.000 377     184
2010-06-09 00:00:00.000 438     202      <- out maint period begins
2010-06-08 23:00:00.000 1710    1432
2010-06-08 22:00:00.000 1718    1422
2010-06-08 21:00:00.000 3427    2932
2010-06-08 20:00:00.000 3772    3159
2010-06-08 19:00:00.000 2722    1451  <- twitter come back
2010-06-08 18:00:00.000 146     127
2010-06-08 17:00:00.000 198     171
2010-06-08 16:00:00.000 185     134
2010-06-08 15:00:00.000 1335    924    <- twitter goes wonky
2010-06-08 14:00:00.000 2253    1909
2010-06-08 13:00:00.000 2088    1727
2010-06-08 12:00:00.000 1353    1129
2010-06-08 11:00:00.000 832     689
2010-06-08 10:00:00.000 627     540
2010-06-08 09:00:00.000 580     532
2010-06-08 08:00:00.000 874     776
2010-06-08 07:00:00.000 1140    1090
2010-06-08 06:00:00.000 1927    1817
2010-06-08 05:00:00.000 2571    2422
2010-06-08 04:00:00.000 3435    3185
2010-06-08 03:00:00.000 4226    3846
2010-06-08 02:00:00.000 5210    4714
2010-06-08 01:00:00.000 4400    3800
2010-06-08 00:00:00.000 3116    2814
2010-06-07 23:00:00.000 2752    2437
2010-06-07 22:00:00.000 3414    2683
2010-06-07 21:00:00.000 3008    2343
2010-06-07 20:00:00.000 3433    2969
2010-06-07 19:00:00.000 3522    2875
2010-06-07 18:00:00.000 3953    3352
2010-06-07 17:00:00.000 3067    2399
2010-06-07 16:00:00.000 3332    2461
2010-06-07 15:00:00.000 2978    2412
2010-06-07 14:00:00.000 2500    2035
2010-06-07 13:00:00.000 1941    1607
2010-06-07 12:00:00.000 1381    1174
2010-06-07 11:00:00.000 747     584
2010-06-07 10:00:00.000 719     502
2010-06-07 09:00:00.000 482     430
2010-06-07 08:00:00.000 635     518
2010-06-07 07:00:00.000 912     879
2010-06-07 06:00:00.000 1580    1489
2010-06-07 05:00:00.000 1950    1830
2010-06-07 04:00:00.000 2596    2438
2010-06-07 03:00:00.000 3329    2995
2010-06-07 02:00:00.000 3594    3296
2010-06-07 01:00:00.000 3361    3097
2010-06-07 00:00:00.000 2980    2702
2010-06-06 23:00:00.000 2157    1912
2010-06-06 22:00:00.000 2154    1944
2010-06-06 21:00:00.000 1948    1790
2010-06-06 20:00:00.000 2266    2020
2010-06-06 19:00:00.000 2273    2024
2010-06-06 18:00:00.000 2263    2119
2010-06-06 17:00:00.000 2278    1998
2010-06-06 16:00:00.000 1982    1790
2010-06-06 15:00:00.000 1812    1586
2010-06-06 14:00:00.000 1335    1179
2010-06-06 13:00:00.000 1106    978
2010-06-06 12:00:00.000 795     680
2010-06-06 11:00:00.000 516     443
2010-06-06 10:00:00.000 487     412
2010-06-06 09:00:00.000 594     534

Reply via email to