Hi, We would like to set up a Hadoop test environment under the following scenario:
- 6 PCs - Each PC has an Sata disk (2TB) and an SSD disk (256GB) - OS: Ubuntu 12.04 Server LTS, which is installed in Sata drive - SSD drive is mounted under /ssd - Hadoop user name: hadoop Goal: - 1 PC: pure namenode - Other 5 PCs: datanodes (1 of which also serves as secondary namenode) - Sata disk with bigger size: common HDFS data storage - SSD disk with smaller size but faster: temporary data storage when processing map reduce jobs or doing data analyzing. If this is the case, then am I right under the following cofiguration? - In each node, configure hadoop.tmp.dir under core-site.xml and specify 1 path: /home/hadoop/db/hadoop-${user.name} - In namenode, configure dfs.name.dir under hdfs-site.xml and specify 2 paths: ${hadoop.tmp.dir}/dfs/name,/ssd/hadoop/dfs/name - In datanode, configure mapred.local.dir under mapred-site.xml and specify 1 path: /ssd/hadoop/mapred/local Is there anything that needs to be modified? Any help would be greatly appreciated. -- View this message in context: http://lucene.472066.n3.nabble.com/Configuring-Hadoop-clusters-with-multiple-PCs-each-of-which-has-2-hard-disks-Sata-SSD-tp3994589.html Sent from the Hadoop lucene-users mailing list archive at Nabble.com.