On 3/23/14, 5:49 PM, Matei Zaharia wrote:
You can set spark.local.dir to put this data somewhere other than /tmp if /tmp is full. Actually it’s recommended to have multiple local disks and set to to a comma-separated list of directories, one per disk.Matei, does the number of tasks/partitions in a transformation influence something in terms of disk space consumption? Or inode consumption?
Thanks, Ognen
