For anyone else who is having this problem, the fix has been identified but has not yet been published as a new gem version. What happens is that it skips some tweets. The ones it skips are the ones that happen to have a message length in hex that includes a zero character so it will seem pretty random which ones get through and which ones don't.
Here's how to fix it: First update the gem and see if it is a version later than 0.7.7. If it is, you should be OK. If it's 0.7.7 or earlier, change one line of code: Look in the gem source code on your system for the yajl-ruby gem and find the file lib/yajl/http_stream.rb. Edit line 151 from break if line.match /0.*?\r\n/ to break if line.match /^0.*?\r\n/ Adding that one character will correct the error. -- Twitter developer documentation and resources: http://dev.twitter.com/doc API updates via Twitter: http://twitter.com/twitterapi Issues/Enhancements Tracker: http://code.google.com/p/twitter-api/issues/list Change your membership to this group: http://groups.google.com/group/twitter-development-talk