Re: Lots of Exception for "cannot assign requested address" in datanode logs

2017-07-27 Thread Ravi Prakash
You replication numbers do seem to be on the high. How did you arrive at those numbers? If you swamp the datanode with too much replication work than it can do in an iteration (every 3 seconds), things would go bad. I often check using `ps aux | grep java` all the java processes running rather

RE: Lots of Exception for "cannot assign requested address" in datanode logs

2017-07-26 Thread omprakash
Hi Ravi, The two datanodes are on different Machines. At the time when these error were generating I can see that DN1 was replicating under-replicating blocks on DN2. Can this be related to properties I added for increasing replication rate? Regards Om Prakash From: Ravi Prakash

Re: Lots of Exception for "cannot assign requested address" in datanode logs

2017-07-26 Thread Ravi Prakash
Hi Omprakash! DatanodeRegistration happens when the Datanode first hearbeats to the Namenode. In your case, it seems some other application has acquired the port 50010 . You can check this with the command "netstat -anp | grep 50010" . Are you trying to run 2 datanode processes on the same

Lots of Exception for "cannot assign requested address" in datanode logs

2017-07-26 Thread omprakash
Hi all, I am running a 4 node cluster with 2 Master node( NN1, NN2 with HA using QJM) and 2 Slave nodes(DN1, DN2). I am receiving lots of Exceptions in Datanode logs as shown below 2017-07-26 17:56:00,703 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: