Hi, Make sure to also set mapred.local.dir to the same set of output directories, this is were the intermediate key-value pairs are stored!
Regards, Dieter 2013/12/16 Tao Xiao <[email protected]> > I have ten disks per node,and I don't know what value I should set to > "hadoop.tmp.dir". Some said this property refers to a location in local > disk while some other said it refers to a directory in HDFS. I'm confused, > who can explain it ? > > I want to spread I/O since I have ten disks per node, so should I set a > comma-separated list of directories (which are on different disks) to > "hadoop.tmp.dir" ? >
