Hi Folks, I am planning to implement hdfs off heap support for spark, and have uploaded the design doc for the off heap support through hdfs ramdisk in jira SPARK-6112. Please review it and provide your feedback if anybody are interested.
https://issues.apache.org/jira/browse/SPARK-6112 Thanks. Zhan Zhang