Removing these packages means that users calling go -race will have to always recompile the standard library, and they can't cache it without root.
Wouldn't it be better to install all the packages, by running race.bash: https://golang.org/src/race.bash The race.bash could be run with exit code ignored, since it only runs on architectures where -race is supported.
