I actually think memory could definitely be the culprit. On a VPS I switched from 256mb to 512mb and noticed a dramatic improvement. I'm not really sure how to check my system's memory usage, though.
I'd be surprised if it were migrations or tables. Have you tried just running welcome or examples? How about just returning a page that doesn't hit the DB?

