I think the main reason people don't give a damn provided they can get their trendy little gadgets is the prevailing propaganda, which a) encourages acquisition of wealth and status symbols above all else, b) vilifies the poor for being 'lazy' or otherwise unworthy, c) denies the exploitative basis of all employment, d) breeds ignorance among the working class, e) insists that all's well.
I don't buy from Apple, but not because of their horrific working conditions. Ultimately, 'ethical consumption' of this sort doesn't really bring about any change, can't be done on a large scale, and ultimately cannot be implemented consistently because literally thousands of people and dozens of companies were involved in the production of even the smallest things. I don't buy from Apple because I value my freedom in the computing arena.
