I think the reason why it is slow is due to indexing is making a copy of your data and not passed by reference as in python. This behavior is going to change in 0.4 where subarrays is introduced then the data is not copied.
You could try it by. @time v=mat[:,1]; w=mat[:,2] This should take long time and allocate a lot of memory.
