[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6826: - Attachment: HDFSPluggableAuthorizationProposal-v2.pdf updated proposal removing the

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6376: Assignee: Dave Marion Distcp data between two HA clusters requires another configuration

[jira] [Updated] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6800: --- Attachment: HDFS-6800.2.patch Updated the patch to delete the trash directory if the previous

[jira] [Updated] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6800: --- Attachment: HDFS-6800.3.patch Determine how Datanode layout changes should interact with rolling

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098270#comment-14098270 ] Yongjun Zhang commented on HDFS-6833: - HI Shinichi, Thanks for finding this issue and

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098295#comment-14098295 ] Jitendra Nath Pandey commented on HDFS-6826: In FsPermissionChecker

[jira] [Commented] (HDFS-5687) Problem in accessing NN JSP page

[ https://issues.apache.org/jira/browse/HDFS-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098319#comment-14098319 ] Hadoop QA commented on HDFS-5687: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6300) Allows to run multiple balancer simultaneously

[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098321#comment-14098321 ] Hadoop QA commented on HDFS-6300: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3907) Allow multiple users for local block readers

[ https://issues.apache.org/jira/browse/HDFS-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098375#comment-14098375 ] Hadoop QA commented on HDFS-3907: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098430#comment-14098430 ] Hadoop QA commented on HDFS-6800: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098443#comment-14098443 ] Hudson commented on HDFS-6850: -- FAILURE: Integrated in Hadoop-Yarn-trunk #647 (See

[jira] [Commented] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098520#comment-14098520 ] Hadoop QA commented on HDFS-6800: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6569) OOB message can't be sent to the client when DataNode shuts down for upgrade

[ https://issues.apache.org/jira/browse/HDFS-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6569: - Assignee: Brandon Li (was: Kihwal Lee) OOB message can't be sent to the client when DataNode shuts down

[jira] [Commented] (HDFS-6569) OOB message can't be sent to the client when DataNode shuts down for upgrade

[ https://issues.apache.org/jira/browse/HDFS-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098582#comment-14098582 ] Kihwal Lee commented on HDFS-6569: -- The patch looks good in general. There are a couple of

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098583#comment-14098583 ] Kihwal Lee commented on HDFS-6825: -- I will take a look at it soon. Edit log corruption

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098606#comment-14098606 ] Hudson commented on HDFS-6850: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1864 (See

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098657#comment-14098657 ] Kihwal Lee commented on HDFS-6825: -- Could we also check that this works with a recursive

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098640#comment-14098640 ] Hudson commented on HDFS-6850: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1838 (See

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098659#comment-14098659 ] Yongjun Zhang commented on HDFS-6825: - Thanks [~kihwal]! and thanks [~andrew.wang] and

[jira] [Updated] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-6833: - Attachment: HDFS-6833-6.patch Hi [~yzhangal], Thank you for your review and comments. I

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098682#comment-14098682 ] Yongjun Zhang commented on HDFS-6825: - HI [~kihwal], Thanks a lot for the review, we

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098685#comment-14098685 ] Yongjun Zhang commented on HDFS-6776: - I ran the failed tests locally several times and

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.004.patch distcp from insecure cluster (source) to secure cluster

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098708#comment-14098708 ] Zhe Zhang commented on HDFS-6850: - Thanks [~atm] and [~brandonli] for reviewing the patch!

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098711#comment-14098711 ] Alejandro Abdelnur commented on HDFS-6776: -- {{NullTokenMsgHeader}} constant name

[jira] [Assigned] (HDFS-6855) Add a different end-to-end non-manual NFS test to replace TestOutOfOrderWrite

[ https://issues.apache.org/jira/browse/HDFS-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-6855: --- Assignee: Zhe Zhang Add a different end-to-end non-manual NFS test to replace TestOutOfOrderWrite

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098722#comment-14098722 ] Yongjun Zhang commented on HDFS-6776: - Thanks a lot [~tucu00]! I will address your

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6826: - Attachment: HDFS-6826v3.patch Jitendra, attaching v3 patch, in this patch i've moving the

[jira] [Commented] (HDFS-4257) The ReplaceDatanodeOnFailure policies could have a forgiving option

[ https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098779#comment-14098779 ] Yongjun Zhang commented on HDFS-4257: - HI [~szetszwo], this issue is heating up now, I

[jira] [Commented] (HDFS-6847) Archival Storage: Support storage policy on directories

[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098781#comment-14098781 ] Tsz Wo Nicholas Sze commented on HDFS-6847: --- Thanks for clarifying it. Patch

[jira] [Updated] (HDFS-6847) Archival Storage: Support storage policy on directories

[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6847: Attachment: HDFS-6847.002.patch Thanks for the review, Nicholas! Update the patch to address your comments.

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098943#comment-14098943 ] Kihwal Lee commented on HDFS-6825: -- [~yzhangal] I've verified that you are correct. The

[jira] [Commented] (HDFS-4486) Add log category for long-running DFSClient notices

[ https://issues.apache.org/jira/browse/HDFS-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098950#comment-14098950 ] Zhe Zhang commented on HDFS-4486: - My current plan is to follow this page to generate an

[jira] [Assigned] (HDFS-5135) Create a test framework to enable NFS end to end unit test

[ https://issues.apache.org/jira/browse/HDFS-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-5135: --- Assignee: Zhe Zhang Create a test framework to enable NFS end to end unit test

[jira] [Commented] (HDFS-5135) Create a test framework to enable NFS end to end unit test

[ https://issues.apache.org/jira/browse/HDFS-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098960#comment-14098960 ] Zhe Zhang commented on HDFS-5135: - Hi Brandon, I'm a little confused by the description of

[jira] [Updated] (HDFS-6663) Admin command to track file and locations from block id

[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6663: -- Attachment: HDFS-6663.patch Admin command to track file and locations from block id

[jira] [Updated] (HDFS-6663) Admin command to track file and locations from block id

[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6663: -- Status: Patch Available (was: Open) Admin command to track file and locations from block id

[jira] [Commented] (HDFS-6663) Admin command to track file and locations from block id

[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099018#comment-14099018 ] Chen He commented on HDFS-6663: --- it can also shows how many expected, live, corrupted,

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099052#comment-14099052 ] Hadoop QA commented on HDFS-6833: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099078#comment-14099078 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099243#comment-14099243 ] Sanjay Radia commented on HDFS-6134: We have made very good progress over the last few

[jira] [Commented] (HDFS-5135) Create a test framework to enable NFS end to end unit test

[ https://issues.apache.org/jira/browse/HDFS-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099246#comment-14099246 ] Brandon Li commented on HDFS-5135: -- Most of the current unit NFS tests are not end-to-end

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099311#comment-14099311 ] Sanjay Radia commented on HDFS-6134: Alejandro. Wrt to the subtle difference between

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099318#comment-14099318 ] Yongjun Zhang commented on HDFS-6825: - HI [~kihwal], Thanks a lot for verifying and

[jira] [Created] (HDFS-6856) Send an OOB ack asynchronously

Brandon Li created HDFS-6856: Summary: Send an OOB ack asynchronously Key: HDFS-6856 URL: https://issues.apache.org/jira/browse/HDFS-6856 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6569) OOB message can't be sent to the client when DataNode shuts down for upgrade

[ https://issues.apache.org/jira/browse/HDFS-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099355#comment-14099355 ] Brandon Li commented on HDFS-6569: -- Thank you, Kihwal, for the review. I've created

[jira] [Updated] (HDFS-6569) OOB message can't be sent to the client when DataNode shuts down for upgrade

[ https://issues.apache.org/jira/browse/HDFS-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6569: - Attachment: HDFS-6569.003.patch OOB message can't be sent to the client when DataNode shuts down for

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099357#comment-14099357 ] Selvamohan Neethiraj commented on HDFS-6826: Alejandro, The use case for

[jira] [Commented] (HDFS-6663) Admin command to track file and locations from block id

[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099415#comment-14099415 ] Hadoop QA commented on HDFS-6663: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099441#comment-14099441 ] Shinichi Yamashita commented on HDFS-6833: -- The following tests succeeded in my

[jira] [Updated] (HDFS-6663) Admin command to track file and locations from block id

[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6663: -- Attachment: HDFS-6663-2.patch Admin command to track file and locations from block id

[jira] [Commented] (HDFS-6663) Admin command to track file and locations from block id

[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099453#comment-14099453 ] Chen He commented on HDFS-6663: --- update new patch that resolve the findbugs problem. The

[jira] [Updated] (HDFS-6663) Admin command to track file and locations from block id

[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6663: -- Affects Version/s: 2.5.0 Admin command to track file and locations from block id

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099469#comment-14099469 ] Alejandro Abdelnur commented on HDFS-6826: -- [~sneethiraj], got it, it makes sense.

[jira] [Commented] (HDFS-6774) Make FsDataset and DataStore support removing volumes.

[ https://issues.apache.org/jira/browse/HDFS-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099483#comment-14099483 ] Aaron T. Myers commented on HDFS-6774: -- Hey Eddy, patch looks pretty good to me. A few