Re: Spark partial data in memory/and partial in disk

You can use persist(StorageLevel.MEMORY_AND_DISK) if you are not having sufficient memory to cache everything. Thanks Best Regards On Fri, Feb 27, 2015 at 7:20 PM, Siddharth Ubale < siddharth.ub...@syncoms.com> wrote: > Hi, > > > > How do we manage putting partial data in to memory and partial

Spark partial data in memory/and partial in disk

Hi, How do we manage putting partial data in to memory and partial into disk where data resides in hive table ? We have tried using the available documentation but unable to go ahead with above approach , we are only able to cache the entire table or uncache it. Thanks, Siddharth Ubale, Synchro