2015-07-20 21:32 GMT-07:00 Prashant Sharma <scrapco...@gmail.com>: > +1 Looks like a nice idea(I do not see any harm). Would you like to work > on the patch to support it ? > > Prashant Sharma > > Yes, I would like to contribute to it once we clarify the appropriate path.
--Alexey > > > On Tue, Jul 21, 2015 at 2:46 AM, Alexey Goncharuk < > alexey.goncha...@gmail.com> wrote: > >> Hello Spark community, >> >> I was looking through the code in order to understand better how RDD is >> persisted to Tachyon off-heap filesystem. It looks like that the Tachyon >> filesystem is hard-coded and there is no way to switch to another in-memory >> filesystem. I think it would be great if the implementation of the >> BlockManager and BlockStore would be able to plug in another filesystem. >> >> For example, Apache Ignite also has an implementation of in-memory >> filesystem which can store data in on-heap and off-heap formats. It would >> be great if it could integrate with Spark. >> >> I have filed a ticket in Jira: >> https://issues.apache.org/jira/browse/SPARK-9203 >> >> If it makes sense, I will be happy to contribute to it. >> >> Thoughts? >> >> -Alexey (Apache Ignite PMC) >> > >
