I have setup 3 node cluster each node having 100GB for configured VM on 3 nodes . When I did Terasort first time ,very less space reserved for NonHDFS , due to that blocks are corrupted on 3 nodes .Again I had setup the cluster with 300GB on each node . To get HDFS size use the below command on each node . sudo -u hdfs hadoop fs -du -h / 0 0 /system 3.4 M 10.1 M /tmp 385.1 M 1.1 G /user
There are total 4 GB used for HDFS Can you please help on the below terasort testing on 3 node cluster 1.How much HDFS size? 2.How much Non HDFS size? 3.Any customization parameters are required? Regards, Mohan
