Judging by what I see, most of the mail most people get is HTML
And I've got legitimate mail from places like Paypal in HTML format, which means these phishers are actually credible... and would be a lot less so if the link was obviously seen to be at "http://10.23.34.45:6789/paypal.com/".
And of course the link sometimes points to an exploit page, so a good deal of the spam you get is via botnets set up by taking advantage of this hatefully missing feature, or is trying to take advantage of its lack.
So even though you don't directly suffer from it, you're not immune to the effects. :(
