Re: Get size of rdd in memory

2015-02-02 Thread Cheng Lian
(...) is strongly recommended for this use case.. If this is no longer accurate, i could make a PR to remove it. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Get-size-of-rdd-in-memory-tp10366p10392.html Sent from the Apache Spark Developers List mailing

Re: Get size of rdd in memory

2015-02-02 Thread Cheng Lian
this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Get-size-of-rdd-in-memory-tp10366p10388.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e

Re: Get size of rdd in memory

2015-02-02 Thread ankits
-developers-list.1001551.n3.nabble.com/Get-size-of-rdd-in-memory-tp10366p10392.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org

Re: Get size of rdd in memory

2015-02-02 Thread ankits
this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Get-size-of-rdd-in-memory-tp10366p10388.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e-mail: dev

Get size of rdd in memory

2015-01-30 Thread ankits
I understand i will need a reference to the block manager, or something like RDDInfo.fromRdd(rdd).memSize. I could use reflection or whatever to override the private access modifiers. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Get-size-of-rdd

Re: Get size of rdd in memory

2015-01-30 Thread Cheng Lian
RDDInfo.fromRdd(rdd).memSize. I could use reflection or whatever to override the private access modifiers. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Get-size-of-rdd-in-memory-tp10366.html Sent from the Apache Spark Developers List mailing list archive