On 3/23/14, 5:35 PM, Aaron Davidson wrote:
On some systems, /tmp/ is an in-memory tmpfs file system, with its own
size limit. It's possible that this limit has been exceeded. You might
try running the "df" command to check to free space of "/tmp" or root
if tmp isn't listed.
3 GB also seems pretty low for the remaining free space of a disk. If
your disk size is in the TB range, it's possible that the last couple
GB have issues when being allocated due to fragmentation or
reclamation policies.
Aaron, thanks for the reply. These are Amazon Ubuntu instances that I
have that have an 8GB root filesystem (with everything OS+Spark taking
up about 4.5GB). The /tmp appears to be just a regular directory in / -
hence it shares in the same 3.5GB left free space. I was "watch df"ing
the space while my job was running.
Ognen
