spark git commit: [SPARK-5112] Expose SizeEstimator as a developer api

2015-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 93af96a2f - 0327ca2b2 [SPARK-5112] Expose SizeEstimator as a developer api The best way to size the amount of memory consumption your dataset will require is to create an RDD, put it into cache, and look at the SparkContext logs on

spark git commit: [SPARK-5112] Expose SizeEstimator as a developer api

2015-05-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master fc8feaa8e - 4222da68d [SPARK-5112] Expose SizeEstimator as a developer api The best way to size the amount of memory consumption your dataset will require is to create an RDD, put it into cache, and look at the SparkContext logs on your