[ 
https://issues.apache.org/jira/browse/HDFS-15253?focusedWorklogId=496728&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-496728
 ]

ASF GitHub Bot logged work on HDFS-15253:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 07/Oct/20 16:24
            Start Date: 07/Oct/20 16:24
    Worklog Time Spent: 10m 
      Work Description: rakeshadr commented on pull request #2366:
URL: https://github.com/apache/hadoop/pull/2366#issuecomment-705048932


   +1 LGTM, test case failures are unrelated to the patch. Will merge it 
shortly.
   
   Thanks @karthikhw for the contribution.
   Thanks @mukul1987 for the reviews.
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 496728)
    Time Spent: 0.5h  (was: 20m)

> Set default throttle value on dfs.image.transfer.bandwidthPerSec
> ----------------------------------------------------------------
>
>                 Key: HDFS-15253
>                 URL: https://issues.apache.org/jira/browse/HDFS-15253
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>            Reporter: Karthik Palanisamy
>            Assignee: Karthik Palanisamy
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> The default value dfs.image.transfer.bandwidthPerSec is set to 0 so it can 
> use maximum available bandwidth for fsimage transfers during checkpoint. I 
> think we should throttle this. Many users were experienced namenode failover 
> when transferring large image size along with fsimage replication on 
> dfs.namenode.name.dir. eg. >25Gb.  
> Thought to set,
> dfs.image.transfer.bandwidthPerSec=52428800. (50 MB/s)
> dfs.namenode.checkpoint.txns=2000000 (Default is 1M, good to avoid frequent 
> checkpoint. However, the default checkpoint runs every 6 hours once)
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to