dev, I would be interesting in understanding how to make core Spark run on a non IP network stack like MPI. The main dependencies seem to be in org.apache.spark.network but I also see some other dependencies sprinkled in auxiliary functions.
Pointers to code, mailing list discussions or people to talk to appreciated. Take care, Kai -- Kai Backman, CEO http://airstonelabs.com