Need help regarding DataNodeCluster
Hello, I tried using DataNodeCluster to simulate a set of 3000 datanodes. The namenode is already running. When I gave the below command : $ java DataNodeCluster -n 3000 -simulated -inject 1 1 -d someDirectory I am getting the following error: Starting 3000 Simulated Data Nodes that will connect to Name Node at gs301850.inktomisearch.com:50830 Starting DataNode 0 with dfs.data.dir: someDirectory/dfs/data/data1,someDirectory/dfs/data/data2 08/12/22 11:42:33 INFO datanode.DataNode: Registered FSDatasetStatusMBean 08/12/22 11:42:33 INFO datanode.DataNode: Opened info server at 60195 08/12/22 11:42:33 INFO datanode.DataNode: Balancing bandwith is 1048576 bytes/s 08/12/22 11:42:33 INFO datanode.DataNode: Periodic Block Verification is disabled because verifcation is supported only with FSDataset. 08/12/22 11:42:33 INFO http.HttpServer: Version Jetty/5.1.4 08/12/22 11:42:33 INFO util.Container: Started HttpContext[/static,/static] 08/12/22 11:42:34 INFO util.Credential: Checking Resource aliases 08/12/22 11:42:34 INFO util.Container: Started org.mortbay.jetty.servlet.webapplicationhand...@1f03691 08/12/22 11:42:34 INFO http.SocketListener: Started SocketListener on 127.0.0.1:60196 08/12/22 11:42:34 INFO datanode.DataNode: Waiting for threadgroup to exit, active threads is 0 Error creating data node:java.io.IOException: Problem starting http server The system just hangs after the above message. Can anyone please let me know why I am getting the above error? Thanks in advance Ramya
RE: How to retrieve rack ID of a datanode
Hi Lohit, I have not set the datanode to tell namenode which rack it belongs to. Can you please tell me how do I do it? Is it using setNetworkLocation()? My intention is to kill the datanodes in a given rack. So it would be useful even if I obtain the subnet each datanode belongs to. Thanks Ramya -Original Message- From: lohit [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 26, 2008 12:26 PM To: core-user@hadoop.apache.org Subject: Re: How to retrieve rack ID of a datanode /default-rack is set when datanode has not set rackID. It is upto the datanode to tell namenode which rack it belongs to. Is your datanode doing that explicitly ? -Lohit - Original Message From: Ramya R <[EMAIL PROTECTED]> To: core-user@hadoop.apache.org Sent: Tuesday, November 25, 2008 10:36:46 PM Subject: How to retrieve rack ID of a datanode Hi all, I want to retrieve the Rack ID of every datanode. How can I do this? I tried using getNetworkLocation() in org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack as the output for all datanodes. Any advice? Thank in advance Ramya
How to retrieve rack ID of a datanode
Hi all, I want to retrieve the Rack ID of every datanode. How can I do this? I tried using getNetworkLocation() in org.apache.hadoop.hdfs.protocol.DatanodeInfo. I am getting /default-rack as the output for all datanodes. Any advice? Thank in advance Ramya
