Is there any problem with reinterpreting the array and then use a SubArray or ArrayView to do the index transformation?
Pointer arithmetic is not more or less dangerous in Julia, than what it is in C. The only thing you need to ensure is that the object you have a pointer to is referenced by something the GC traverses, and that it isn't moved in memory (Eg. vector resize).
