I've just found by tweaking the fav crawler, that if I slow the crawler down, then the twitter API keeps responding. At the moment I'm injecting a 15 second wait between every 30 or so calls. I'll be playing around with that to see what I can get it down too.
Tim. http://favstar.fm
