Re: How to retrieve rack ID of a datanode

2008-11-26 Thread lohit 
I take that back. I forgot about the changes in new version of HDFS.
If you are testing this take a look at TestReplication.java
Lohit



- Original Message 
From: Ramya R <[EMAIL PROTECTED]>
To: core-user@hadoop.apache.org
Cc: [EMAIL PROTECTED]
Sent: Tuesday, November 25, 2008 11:15:28 PM
Subject: RE: How to retrieve rack ID of a datanode

Hi Lohit,
  I have not set the datanode to tell namenode which rack it belongs to.
Can you please tell me how do I do it? Is it using setNetworkLocation()?

My intention is to kill the datanodes in a given rack. So it would be
useful even if I obtain the subnet each datanode belongs to.

Thanks
Ramya

-Original Message-
From: lohit [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, November 26, 2008 12:26 PM
To: core-user@hadoop.apache.org
Subject: Re: How to retrieve rack ID of a datanode

/default-rack is set when datanode has not set rackID. It is upto the
datanode to tell namenode which rack it belongs to.
Is your datanode doing that explicitly ?
-Lohit



- Original Message 
From: Ramya R <[EMAIL PROTECTED]>
To: core-user@hadoop.apache.org
Sent: Tuesday, November 25, 2008 10:36:46 PM
Subject: How to retrieve rack ID of a datanode

Hi all,



I want to retrieve the Rack ID of every datanode. How can I do this?

I tried using getNetworkLocation() in
org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack
as the output for all datanodes.



Any advice?



Thank in advance

Ramya

Re: How to retrieve rack ID of a datanode

2008-11-25 Thread Yi-Kai Tsai 

hi Ramya

Setup topology.script.file.name in your hadoop-site.xml  and the script.

check http://hadoop.apache.org/core/docs/current/cluster_setup.html , 
Hadoop Rack Awareness section.




Hi Lohit,
  I have not set the datanode to tell namenode which rack it belongs to.
Can you please tell me how do I do it? Is it using setNetworkLocation()?
 
My intention is to kill the datanodes in a given rack. So it would be

useful even if I obtain the subnet each datanode belongs to.

Thanks
Ramya

-Original Message-
From: lohit [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, November 26, 2008 12:26 PM

To: core-user@hadoop.apache.org
Subject: Re: How to retrieve rack ID of a datanode

/default-rack is set when datanode has not set rackID. It is upto the
datanode to tell namenode which rack it belongs to.
Is your datanode doing that explicitly ?
-Lohit



- Original Message 
From: Ramya R <[EMAIL PROTECTED]>
To: core-user@hadoop.apache.org
Sent: Tuesday, November 25, 2008 10:36:46 PM
Subject: How to retrieve rack ID of a datanode

Hi all,



I want to retrieve the Rack ID of every datanode. How can I do this?

I tried using getNetworkLocation() in
org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack
as the output for all datanodes.



Any advice?



Thank in advance

Ramya
  



--
Yi-Kai Tsai (cuma) <[EMAIL PROTECTED]>, Asia Regional Search Engineering.

RE: How to retrieve rack ID of a datanode

2008-11-25 Thread Ramya R 
Hi Lohit,
  I have not set the datanode to tell namenode which rack it belongs to.
Can you please tell me how do I do it? Is it using setNetworkLocation()?
 
My intention is to kill the datanodes in a given rack. So it would be
useful even if I obtain the subnet each datanode belongs to.

Thanks
Ramya

-Original Message-
From: lohit [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, November 26, 2008 12:26 PM
To: core-user@hadoop.apache.org
Subject: Re: How to retrieve rack ID of a datanode

/default-rack is set when datanode has not set rackID. It is upto the
datanode to tell namenode which rack it belongs to.
Is your datanode doing that explicitly ?
-Lohit



- Original Message 
From: Ramya R <[EMAIL PROTECTED]>
To: core-user@hadoop.apache.org
Sent: Tuesday, November 25, 2008 10:36:46 PM
Subject: How to retrieve rack ID of a datanode

Hi all,



I want to retrieve the Rack ID of every datanode. How can I do this?

I tried using getNetworkLocation() in
org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack
as the output for all datanodes.



Any advice?



Thank in advance

Ramya

Re: How to retrieve rack ID of a datanode

2008-11-25 Thread Amar Kamat 

Ramya R wrote:

Hi all,

 


I want to retrieve the Rack ID of every datanode. How can I do this?

I tried using getNetworkLocation() in
org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack
as the output for all datanodes.

  
Have you setup the cluster to be rack-aware? Atleast in MR we have to 
provide a script that resolves the rack for a given node. Might be 
similar for DFS too. See topology.script.file.name parameter in 
hadoop-default.conf for more details.

Amar
 


Any advice?

 


Thank in advance

Ramya

Re: How to retrieve rack ID of a datanode

2008-11-25 Thread lohit 
/default-rack is set when datanode has not set rackID. It is upto the datanode 
to tell namenode which rack it belongs to.
Is your datanode doing that explicitly ?
-Lohit



- Original Message 
From: Ramya R <[EMAIL PROTECTED]>
To: core-user@hadoop.apache.org
Sent: Tuesday, November 25, 2008 10:36:46 PM
Subject: How to retrieve rack ID of a datanode

Hi all,



I want to retrieve the Rack ID of every datanode. How can I do this?

I tried using getNetworkLocation() in
org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack
as the output for all datanodes.



Any advice?



Thank in advance

Ramya

How to retrieve rack ID of a datanode

2008-11-25 Thread Ramya R 
Hi all,

 

I want to retrieve the Rack ID of every datanode. How can I do this?

I tried using getNetworkLocation() in
org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack
as the output for all datanodes.

 

Any advice?

 

Thank in advance

Ramya