unsubscribe

2014-05-18 Thread Venkat Krishnamurthy

Re: Spark on other parallel filesystems

2014-04-05 Thread Venkat Krishnamurthy
cified as glusterfs:// (or querying the xattr blindly for file://). How much of a difference does data locality make for Spark use cases anyways (since most of the computation happens in memory)? Any sort of numbers? Thanks! Avati Matei On Apr 4, 2014, at 4:56 PM, Venkat Krishnamurthy m

Spark on other parallel filesystems

2014-04-04 Thread Venkat Krishnamurthy
All Are there any drawbacks or technical challenges (or any information, really) related to using Spark directly on a global parallel filesystem like Lustre/GPFS? Any idea of what would be involved in doing a minimal proof of concept? Is it just possible to run Spark unmodified (without the H