On 03/31/2010 08:12 PM, Zhanlei Ma wrote:
How to Recommission or decommission DataNode(s) in hadoop???
Decommission(Del some Datanodes):
On a large cluster removing one or two data-nodes will not lead to any data
loss, because name-node will replicate their blocks as long as it
[...]
But
On 03/18/2010 05:41 PM, Mag Gam wrote:
Chris:
This clears up my questions a lot! Thankyou.
So, if I have 4 data servers and I want 2 racks. I can do this
#!/bin/bash
#rack1.sh
echo rack1
#bin/bash
#rack2.sh
echo rack2
So, I can do this for 2 servers
property
On 03/17/2010 08:34 PM, Mag Gam wrote:
Well, I didn't really solve the problem. Now I have even more questions.
I came across this script,
http://wiki.apache.org/hadoop/topology_rack_awareness_scripts
but it makes no sense to me! Can someone please try to explain what
its trying to do?
On 03/18/2010 06:21 PM, Michael Thomas wrote:
On 03/17/2010 08:34 PM, Mag Gam wrote:
Well, I didn't really solve the problem. Now I have even more questions.
I came across this script,
http://wiki.apache.org/hadoop/topology_rack_awareness_scripts
but it makes no sense to me! Can someone
Hi,
From what I've observed, if you don't provide a script for rack
awareness, hadoop treats all nodes as if they belong the the same rack.
Here is the section in hadoop-site xml where we define our rack
awareness script:
property
nametopology.script.file.name/name
We have used selinux on our large cluster with HDFS (we don't use MR).
The only issue I've found is that the mount program does not have
permission to execute java, which prohibits you from mounting the fuse
filesystem from /etc/fstab. This is fixed with the policy file below.
require {
