d) Try using NFS. This slows down the i/o bound resource hog enough to leave the machine usable for interactive tasks. Yes it's ugly, but scheduling in 2.0 is suboptimal, and nice doesn't have much effect on i/o, only CPU. An extra disk dedicated to the i/o hog would probably be better than an SMP for this problem.
-Drake