[jira] [Comment Edited] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-07-29 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16101026#comment-16101026 ] Brahma Reddy Battula edited comment on HDFS-11799 at 7/30/17 6:13 AM: --

[jira] [Comment Edited] (HDFS-12084) Scheduled Count will not decrement when file is deleted before all IBR's received

2017-07-29 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091704#comment-16091704 ] Brahma Reddy Battula edited comment on HDFS-12084 at 7/30/17 6:12 AM: --

[jira] [Commented] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106321#comment-16106321 ] Hadoop QA commented on HDFS-12209: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106318#comment-16106318 ] Hadoop QA commented on HDFS-12214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12183) Ozone: KSM : Use proper defaults for block client address

2017-07-29 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106309#comment-16106309 ] Lokesh Jain commented on HDFS-12183: Thank You!! > Ozone: KSM : Use proper defaults

[jira] [Commented] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-07-29 Thread fatkun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106297#comment-16106297 ] fatkun commented on HDFS-12209: --- I have no idea to write unit test. > VolumeScanner scan cu

[jira] [Updated] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-07-29 Thread fatkun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fatkun updated HDFS-12209: -- Status: Patch Available (was: Open) > VolumeScanner scan cursor not save periodic > ---

[jira] [Updated] (HDFS-12209) VolumeScanner scan cursor not save periodic

2017-07-29 Thread fatkun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fatkun updated HDFS-12209: -- Attachment: HDFS-12209.patch > VolumeScanner scan cursor not save periodic > ---

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Attachment: HDFS-12214-HDFS-10285-02.patch Attached another patch including {{isSatisfierRunning}} changes.

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Description: This sub-task is to address [~andrew.wang]'s review comments. Please refer the [review commen

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106285#comment-16106285 ] Uma Maheswara Rao G commented on HDFS-12214: [~rakeshr] There is another comme

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-07-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106283#comment-16106283 ] Uma Maheswara Rao G commented on HDFS-10285: [~andrew.wang] Thanks a lot Andre

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106229#comment-16106229 ] Hadoop QA commented on HDFS-12214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12228) [SPS]: Add storage policy satisfier related metrics

2017-07-29 Thread Rakesh R (JIRA)
Rakesh R created HDFS-12228: --- Summary: [SPS]: Add storage policy satisfier related metrics Key: HDFS-12228 URL: https://issues.apache.org/jira/browse/HDFS-12228 Project: Hadoop HDFS Issue Type: Sub

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Attachment: HDFS-12214-HDFS-10285-01.patch Thanks [~andrew.wang] for the reviews. Attached new patch address

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of 'dfs.storage.policy.satisfier.activate' configuration

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Description: This sub-task is to address [~andrew.wang]'s review comments. Please refer the [review commen

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-29 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106182#comment-16106182 ] Manoj Govindassamy commented on HDFS-12217: --- Thanks for the details [~yzhangal].

[jira] [Comment Edited] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106143#comment-16106143 ] Yongjun Zhang edited comment on HDFS-12217 at 7/29/17 3:22 PM: -

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106143#comment-16106143 ] Yongjun Zhang commented on HDFS-12217: -- Hi [~manojg], {quote} LeaseManager#getINodeW

[jira] [Updated] (HDFS-12227) [SPS]: Add throttling to control the number of concurrent moves at the datanode

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12227: Summary: [SPS]: Add throttling to control the number of concurrent moves at the datanode (was: Add throttli

[jira] [Created] (HDFS-12227) Add throttling to control the number of concurrent moves at the datanode

2017-07-29 Thread Rakesh R (JIRA)
Rakesh R created HDFS-12227: --- Summary: Add throttling to control the number of concurrent moves at the datanode Key: HDFS-12227 URL: https://issues.apache.org/jira/browse/HDFS-12227 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11244) [SPS]: Limit the number of satisfyStoragePolicy items at Namenode

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11244: Parent Issue: HDFS-12226 (was: HDFS-10285) > [SPS]: Limit the number of satisfyStoragePolicy items at Namen

[jira] [Updated] (HDFS-11669) [SPS]: Add option in "setStoragePolicy" command to satisfy the policy.

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11669: Parent Issue: HDFS-12226 (was: HDFS-10285) > [SPS]: Add option in "setStoragePolicy" command to satisfy the

[jira] [Updated] (HDFS-12106) [SPS]: Make satisfy policy retry configurable.

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12106: Parent Issue: HDFS-12226 (was: HDFS-10285) > [SPS]: Make satisfy policy retry configurable. > -

[jira] [Updated] (HDFS-11125) [SPS]: Use smaller batches of BlockMovingInfo into the block storage movement command

2017-07-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11125: Parent Issue: HDFS-12226 (was: HDFS-10285) > [SPS]: Use smaller batches of BlockMovingInfo into the block s

[jira] [Created] (HDFS-12226) Follow-on work for Storage Policy Satisfier in Namenode

2017-07-29 Thread Rakesh R (JIRA)
Rakesh R created HDFS-12226: --- Summary: Follow-on work for Storage Policy Satisfier in Namenode Key: HDFS-12226 URL: https://issues.apache.org/jira/browse/HDFS-12226 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-07-29 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16106076#comment-16106076 ] Manoj Govindassamy commented on HDFS-12217: --- * {{LeaseManager#getINodeWithLeases