[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092639#comment-16092639 ] Weiwei Yang commented on HDFS-12126: Just committed to the feature branch, thanks [~li

[jira] [Updated] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12126: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolv

[jira] [Updated] (HDFS-11936) Ozone: TestNodeManager times out before it is able to find all nodes

2017-07-18 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11936: -- Attachment: HDFS-11936-HDFS-7240.001.patch We cannot rely on {{waitForHeartbeatProcessed}} to detect whe

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration in branch-2.7.

2017-07-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092634#comment-16092634 ] Brahma Reddy Battula commented on HDFS-11896: - [~shv] thanks a lot for review

[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092633#comment-16092633 ] Weiwei Yang commented on HDFS-12126: +1, I will commit this soon. Thanks [~linyiqun]!

[jira] [Commented] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092581#comment-16092581 ] Erik Krogen commented on HDFS-11345: Awesome, thanks [~ajisakaa]! I'm glad after so lo

[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092575#comment-16092575 ] Hadoop QA commented on HDFS-12126: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12161) Distcp does not preserve ownership in destination parent folder

2017-07-18 Thread Sailesh Patel (JIRA)
Sailesh Patel created HDFS-12161: Summary: Distcp does not preserve ownership in destination parent folder Key: HDFS-12161 URL: https://issues.apache.org/jira/browse/HDFS-12161 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-07-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092534#comment-16092534 ] Rakesh R commented on HDFS-12090: - bq. That's what the -createMountOnly flag is expected t

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-07-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092518#comment-16092518 ] Brahma Reddy Battula commented on HDFS-5040: *Comments for patch:* # ) Inste

[jira] [Updated] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12126: - Attachment: HDFS-12126-HDFS-7240.003.patch Thanks [~cheersyang] for the review! All the comments make sens

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-07-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092500#comment-16092500 ] Brahma Reddy Battula commented on HDFS-5040: [~kshukla] thanks for working on t

[jira] [Assigned] (HDFS-11984) Ozone: Ensures listKey lists all required key fields

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11984: -- Assignee: Weiwei Yang > Ozone: Ensures listKey lists all required key fields >

[jira] [Updated] (HDFS-10874) libhdfs++: Public API headers should not depend on internal implementation

2017-07-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10874: --- Attachment: HDFS-10874.HDFS-8707.001.patch New patch that should work, going to do a bit more

[jira] [Commented] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

2017-07-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092457#comment-16092457 ] Akira Ajisaka commented on HDFS-11345: -- Okay, pushed this to branch-2.7. > Document

[jira] [Updated] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

2017-07-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11345: - Fix Version/s: 2.7.4 > Document the configuration key for FSNamesystem lock fairness > ---

[jira] [Comment Edited] (HDFS-9507) LeaseRenewer Logging Under-Reporting

2017-07-18 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092453#comment-16092453 ] Bharat Viswanadham edited comment on HDFS-9507 at 7/19/17 1:31 AM: --

[jira] [Assigned] (HDFS-9507) LeaseRenewer Logging Under-Reporting

2017-07-18 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-9507: Assignee: Bharat Viswanadham > LeaseRenewer Logging Under-Reporting > --

[jira] [Commented] (HDFS-9507) LeaseRenewer Logging Under-Reporting

2017-07-18 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092453#comment-16092453 ] Bharat Viswanadham commented on HDFS-9507: -- I think here it is not logged at warn

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-07-18 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092451#comment-16092451 ] Virajith Jalaparti commented on HDFS-12090: --- Re 1: Yes, agree that we should gra

[jira] [Commented] (HDFS-5896) DataXceiver and DFSOutputStream call Thread.setName(), which is not thread safe

2017-07-18 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092445#comment-16092445 ] Bharat Viswanadham commented on HDFS-5896: -- Hi Hiroshi, That is not a problem. We

[jira] [Assigned] (HDFS-336) dfsadmin -report should report number of blocks from datanode

2017-07-18 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-336: --- Assignee: Bharat Viswanadham > dfsadmin -report should report number of blocks from dat

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092430#comment-16092430 ] Hadoop QA commented on HDFS-11472: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration in branch-2.7.

2017-07-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092423#comment-16092423 ] Konstantin Shvachko commented on HDFS-11896: I was thinking how to fix this. T

[jira] [Commented] (HDFS-12160) Fix broken NameNode metrics documentation

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092420#comment-16092420 ] Hadoop QA commented on HDFS-12160: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-12160) Fix broken NameNode metrics documentation

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12160: --- Attachment: HDFS-12160.000.patch Attaching patch which replaces the pipe with a comma instead to fix t

[jira] [Updated] (HDFS-12160) Fix broken NameNode metrics documentation

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12160: --- Status: Patch Available (was: In Progress) > Fix broken NameNode metrics documentation >

[jira] [Updated] (HDFS-12160) Fix broken NameNode metrics documentation

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12160: --- Description: HDFS-11261 introduced documentation in {{Metrics.md}} for the metrics added in HDFS-10872

[jira] [Work started] (HDFS-12160) Fix broken NameNode metrics documentation

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12160 started by Erik Krogen. -- > Fix broken NameNode metrics documentation > ---

[jira] [Created] (HDFS-12160) Fix broken NameNode metrics documentation

2017-07-18 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-12160: -- Summary: Fix broken NameNode metrics documentation Key: HDFS-12160 URL: https://issues.apache.org/jira/browse/HDFS-12160 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11920) Ozone : add key partition

2017-07-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092385#comment-16092385 ] Chen Liang commented on HDFS-11920: --- Had an discussion with [~anu] today, mentioned that

[jira] [Updated] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12131: --- Attachment: HDFS-12131.002.patch Attaching v002 patch with updated {{Metrics.md}}. Thanks for the poin

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092327#comment-16092327 ] Xiao Chen commented on HDFS-12139: -- +1. Thanks, [~yzhangal]. > HTTPFS liststatus returns

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092326#comment-16092326 ] Hadoop QA commented on HDFS-12139: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11472: --- Attachment: HDFS-11472.004.patch > Fix inconsistent replica size after a data pipeline failure > -

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092322#comment-16092322 ] Erik Krogen commented on HDFS-11472: Hey [~jojochuang], no problem, I'm happy to take

[jira] [Assigned] (HDFS-11415) NS, Diskspace % in the dfs -count output

2017-07-18 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-11415: - Assignee: Bharat Viswanadham > NS, Diskspace % in the dfs -count output > ---

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092298#comment-16092298 ] Yongjun Zhang commented on HDFS-12139: -- All good catches, thanks much [~xiaochen]! I

[jira] [Updated] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12139: - Attachment: HDFS-12139.002.patch > HTTPFS liststatus returns incorrect pathSuffix for path of file

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-07-18 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Attachment: HDFS-12159-HDFS-7240.001.patch Attaching the patch for early code review, This depends o

[jira] [Created] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-07-18 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12159: --- Summary: Ozone: SCM: Add create replication pipeline RPC Key: HDFS-12159 URL: https://issues.apache.org/jira/browse/HDFS-12159 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092147#comment-16092147 ] Xiao Chen commented on HDFS-12139: -- Thanks [~yzhangal] for clarifying offline. Change mak

[jira] [Commented] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092134#comment-16092134 ] Hadoop QA commented on HDFS-12117: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092133#comment-16092133 ] Hadoop QA commented on HDFS-5040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-12158) Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protection

2017-07-18 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12158: Summary: Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protection Key: HDFS-12158 URL: https://issues.apache.org/jira/browse/HDFS-12158

[jira] [Comment Edited] (HDFS-11590) Nodemanagers have DDoS our namenode due to HDFS_DELEGATION_TOKEN expired or not in the cache

2017-07-18 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092103#comment-16092103 ] Nicolas Fraison edited comment on HDFS-11590 at 7/18/17 8:12 PM: ---

[jira] [Commented] (HDFS-11590) Nodemanagers have DDoS our namenode due to HDFS_DELEGATION_TOKEN expired or not in the cache

2017-07-18 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092103#comment-16092103 ] Nicolas Fraison commented on HDFS-11590: The client will try to abort the files be

[jira] [Comment Edited] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration in branch-2.7.

2017-07-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092037#comment-16092037 ] Konstantin Shvachko edited comment on HDFS-11896 at 7/18/17 7:55 PM: ---

[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-18 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12117: Attachment: HDFS-12117.005.patch Tried rebase, > HttpFS does not seem to support SN

[jira] [Comment Edited] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-18 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092082#comment-16092082 ] Wellington Chevreuil edited comment on HDFS-12117 at 7/18/17 7:54 PM: --

[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-18 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12117: Status: Patch Available (was: In Progress) > HttpFS does not seem to support SNAPSH

[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-18 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12117: Status: In Progress (was: Patch Available) > HttpFS does not seem to support SNAPSH

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092058#comment-16092058 ] Yongjun Zhang commented on HDFS-12139: -- Thanks [~shahrs87] [~xiaochen] [~jojochuang].

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092053#comment-16092053 ] Wei-Chiu Chuang commented on HDFS-12139: Well not expected, since WebHDFS does not

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration in branch-2.7.

2017-07-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092037#comment-16092037 ] Konstantin Shvachko commented on HDFS-11896: Spent some time debugging this. F

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092004#comment-16092004 ] Xiao Chen commented on HDFS-12139: -- Thanks [~yzhangal] for creating the issue and providi

[jira] [Updated] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12139: - Summary: HTTPFS liststatus returns incorrect pathSuffix for path of file (was: liststatus returns incorre

[jira] [Commented] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091982#comment-16091982 ] Hadoop QA commented on HDFS-12157: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-07-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-5040: -- Target Version/s: (was: ) Status: Patch Available (was: In Progress) > Audit log for adm

[jira] [Updated] (HDFS-5040) Audit log for admin commands/ logging output of all DFS admin commands

2017-07-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-5040: -- Attachment: HDFS-5040.001.patch First cut of the patch that audit logs allowed=false for AcessControlExce

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091868#comment-16091868 ] Hadoop QA commented on HDFS-11246: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-07-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12157: - Assignee: Vinayakumar B Target Version/s: 3.0.0-alpha4 Status: Patch Avai

[jira] [Updated] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-07-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12157: - Attachment: HDFS-12157-01.patch Attached the patch for trunk > Do fsyncDirectory(..) outside of F

[jira] [Commented] (HDFS-12153) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-07-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091775#comment-16091775 ] Rushabh S Shah commented on HDFS-12153: --- Thanks [~templedf] for the patch. It looks

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-07-18 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091766#comment-16091766 ] Wei-Chiu Chuang commented on HDFS-12136: Hi [~daryn] sorry come to this late. Than

[jira] [Comment Edited] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2017-07-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091759#comment-16091759 ] Kuhu Shukla edited comment on HDFS-11246 at 7/18/17 4:05 PM: -

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2017-07-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11246: --- Attachment: HDFS-11246.002.patch Fixed checkstyle and whitespace issues. Findbugs warnings are unrelat

[jira] [Assigned] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-11472: -- Assignee: Erik Krogen (was: Wei-Chiu Chuang) > Fix inconsistent replica size after a data pipe

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091750#comment-16091750 ] Rushabh S Shah commented on HDFS-12131: --- Thanks [~xkrogen] for revising the patch. O

[jira] [Comment Edited] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091743#comment-16091743 ] Erik Krogen edited comment on HDFS-11345 at 7/18/17 3:50 PM: -

[jira] [Commented] (HDFS-11345) Document the configuration key for FSNamesystem lock fairness

2017-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091743#comment-16091743 ] Erik Krogen commented on HDFS-11345: Hey [~ajisakaa], actually I misspoke, the patch a

[jira] [Comment Edited] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-07-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091683#comment-16091683 ] Rakesh R edited comment on HDFS-12090 at 7/18/17 3:40 PM: -- Thanks

[jira] [Updated] (HDFS-12067) Correct dfsadmin commands usage message to reflects IPC port

2017-07-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12067: Summary: Correct dfsadmin commands usage message to reflects IPC port (was: Add com

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks during operations like getContentSummary

2017-07-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091717#comment-16091717 ] Daryn Sharp commented on HDFS-11246: bq. audit log can be async; anyway logging out of

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-07-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091709#comment-16091709 ] Vinayakumar B commented on HDFS-5042: - Created HDFS-12157 for the fsyncDir outside lock

[jira] [Updated] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-07-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12157: - Description: HDFS-5042 introduced fsyncDirectory(..) to save blocks from power failure. Do it out

[jira] [Created] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-07-18 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-12157: Summary: Do fsyncDirectory(..) outside of FSDataset lock Key: HDFS-12157 URL: https://issues.apache.org/jira/browse/HDFS-12157 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-12084) Scheduled Count will not decrement when file is deleted before all IBR's received

2017-07-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091704#comment-16091704 ] Brahma Reddy Battula commented on HDFS-12084: - Hi [~szetszwo]/[~vinayrpet]/[~a

[jira] [Commented] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2017-07-18 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091686#comment-16091686 ] Rushabh S Shah commented on HDFS-11146: --- bq. Rushabh S Shah patch is ready for revie

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-07-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091683#comment-16091683 ] Rakesh R commented on HDFS-12090: - Thanks [~virajith] for the detailed explanation. Sorry

[jira] [Comment Edited] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2017-07-18 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16086809#comment-16086809 ] Brahma Reddy Battula edited comment on HDFS-11146 at 7/18/17 3:07 PM: --

[jira] [Commented] (HDFS-12143) Improve performance of getting and removing inode features

2017-07-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091661#comment-16091661 ] Daryn Sharp commented on HDFS-12143: This patch is intended to surgically fix the unne

[jira] [Assigned] (HDFS-11232) System.err should be System.out

2017-07-18 Thread Ethan Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Li reassigned HDFS-11232: --- Assignee: (was: Ethan Li) > System.err should be System.out > --- > >

[jira] [Commented] (HDFS-12152) [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091435#comment-16091435 ] Hadoop QA commented on HDFS-12152: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091383#comment-16091383 ] Weiwei Yang edited comment on HDFS-12126 at 7/18/17 10:25 AM: --

[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091383#comment-16091383 ] Weiwei Yang commented on HDFS-12126: Thanks [~linyiqun] for working on this, this is v

[jira] [Commented] (HDFS-225) Expose HDFS as a WebDAV store

2017-07-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091374#comment-16091374 ] Pau Tallada CrespĂ­ commented on HDFS-225: - This feature is so much needed :) Is the

[jira] [Commented] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091369#comment-16091369 ] Hadoop QA commented on HDFS-12126: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

2017-07-18 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12147: -- Status: Open (was: Patch Available) > Ozone: KSM: Add checkBucketAccess > -

[jira] [Commented] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091358#comment-16091358 ] Weiwei Yang commented on HDFS-12147: Hi [~nandakumar131] Please hold on submitting a

[jira] [Commented] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

2017-07-18 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091347#comment-16091347 ] Nandakumar commented on HDFS-12147: --- Good point [~cheersyang]. I agree that current impl

[jira] [Updated] (HDFS-12154) Incorrect javadoc description in StorageLocationChecker#check

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12154: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolv

[jira] [Comment Edited] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091335#comment-16091335 ] Weiwei Yang edited comment on HDFS-12147 at 7/18/17 9:26 AM: -

[jira] [Commented] (HDFS-12147) Ozone: KSM: Add checkBucketAccess

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091335#comment-16091335 ] Weiwei Yang commented on HDFS-12147: Hi [~nandakumar131] Thank you. But even we want

[jira] [Commented] (HDFS-12154) Incorrect javadoc description in StorageLocationChecker#check

2017-07-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091336#comment-16091336 ] Weiwei Yang commented on HDFS-12154: Looks good to me, +1, committing now. > Incorrec

[jira] [Commented] (HDFS-12154) Incorrect javadoc description in StorageLocationChecker#check

2017-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091316#comment-16091316 ] Hadoop QA commented on HDFS-12154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12152) [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time

2017-07-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12152: Attachment: HDFS-12152-HDFS-10285-03.patch > [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence

[jira] [Commented] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091272#comment-16091272 ] Yiqun Lin commented on HDFS-12118: -- Thanks [~vagarychen] for the commit! Agree on what yo

[jira] [Updated] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12126: - Status: Patch Available (was: Open) > Ozone: Ozone shell: Add more testing for bucket shell commands > --

[jira] [Updated] (HDFS-12126) Ozone: Ozone shell: Add more testing for bucket shell commands

2017-07-18 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12126: - Attachment: HDFS-12126-HDFS-7240.002.patch As HDFS-12118 has been resolved, rebase the codes and attach th

  1   2   >