RE: How can I increase the speed balancing?

2014-09-16 Thread John Lilley
@hadoop.apache.org Subject: RE: How can I increase the speed balancing? I have also found that neither dfsadmin - setBalanacerBandwidth nor dfs.datanode.balance.bandwidthPerSec’ have any notable effect on apparent balancer rate. This is on Hadoop 2.2.0 john From: cho ju il [mailto:tjst...@kgrid.co.kr] Sent

RE: How can I increase the speed balancing?

2014-09-04 Thread Srikanth upputuri
@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: RE: How can I increase the speed balancing? Bandwidth is enough And i use command bin/hdfs dfsadmin -setBalancerBandwidth 52428800 . Yet balancing slow. I think because the file transfer speed is slow and move 5 files per 1 server

RE: How can I increase the speed balancing?

2014-09-03 Thread cho ju il
; To: user@hadoop.apache.orglt;user@hadoop.apache.orggt;; Cc: Sent: 2014-09-03 (수) 14:10:24 Subject: RE: How can I increase the speed balancing? I am not sure what you meant by ‘Bandwidth is not a lack of data nodes’ but have you configured the balancer bandwidth property

RE: How can I increase the speed balancing?

2014-09-03 Thread John Lilley
@hadoop.apache.org Subject: RE: How can I increase the speed balancing? Bandwidth is enough And i use command bin/hdfs dfsadmin -setBalancerBandwidth 52428800 . Yet balancing slow. I think because the file transfer speed is slow and move 5 files per 1 server . -Original Message- From: Srikanth

RE: How can I increase the speed balancing?

2014-09-02 Thread Srikanth upputuri
I am not sure what you meant by ‘Bandwidth is not a lack of data nodes’ but have you configured the balancer bandwidth property ‘dfs.datanode.balance.bandwidthPerSec’? If not it defaults to 1KB/s. You can increase this to improve the balancer speed. You may also set it dynamically using the