I've got 2 datanodes setup with the following configuration parameter:
<property>
<name>dfs.datanode.du.reserved</name>
<value>429496729600</value>
<description>Reserved space in bytes per volume. Always leave this much
space free for non dfs use.
</description>
</property>
Both are housed on 800GB volumes, so I thought this would keep about half
the volume free for non-HDFS usage.
After some long running jobs last night, both disk volumes were completely
filled. The bulk of the data was in:
${my.hadoop.tmp.dir}/hadoop-hadoop/dfs/data
This is running as the user hadoop.
Am I interpretting these parameters incorrectly?
I noticed this issue, but it is marked as closed:
http://issues.apache.org/jira/browse/HADOOP-2549
--
Jimmy
