Nathan, you are looking for SparkContext.getRDDStorageInfo which returns the information on how much is cached.
On Tue, Jul 15, 2014 at 8:01 PM, Nathan Kronenfeld < nkronenf...@oculusinfo.com> wrote: > Is there a way of determining programatically the cache state of an RDD? > Not its storage level, but how much of it is actually cached? > > Thanks, > -Nathan > > > > > > -- > Nathan Kronenfeld > Senior Visualization Developer > Oculus Info Inc > 2 Berkeley Street, Suite 600, > Toronto, Ontario M5A 4J5 > Phone: +1-416-203-3003 x 238 > Email: nkronenf...@oculusinfo.com >
