I'd suggest starting over with a clean install if possible. Is there some reason you are installing 2.5? If not, I'd avoid it and use what your server comes with.
I use Ubuntu 10.04 which is a "long term support" release and comes with Python 2.6. But 11.04 should work fine, too.

