I also opted for this often in the past, but you need to take care then of several issues. Take for example the Algorithm floats:
The EmbeddedObjects manual describes a lot of Preamle hooks that are needed when hyperref is used.There are a lot other cases where this is problematic, just search in the EmbeddedObjects manual for "hyperref".
regards Uwe