[jira] [Commented] (HDFS-6577) Failure to create FinalizeCommand

2014-06-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039231#comment-14039231 ] Yongjun Zhang commented on HDFS-6577: - Thanks a lot Arpit! I will post a patch later

[jira] [Updated] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6579: Fix Version/s: (was: 2.4.1) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

[jira] [Updated] (HDFS-6222) Remove background token renewer from webhdfs

2014-06-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6222: Hadoop Flags: Reviewed +1 for the patch. Rushabh, thank you for addressing the feedback. Can you

[jira] [Updated] (HDFS-6222) Remove background token renewer from webhdfs

2014-06-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-6222: - Attachment: HDFS-6222.branch-2-v3.patch Thanks Chris for the review. Please find attached the

[jira] [Commented] (HDFS-6222) Remove background token renewer from webhdfs

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039273#comment-14039273 ] Hadoop QA commented on HDFS-6222: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039327#comment-14039327 ] Daryn Sharp commented on HDFS-6475: --- What I'm saying is I think the patch adds too much

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039330#comment-14039330 ] Daryn Sharp commented on HDFS-6475: --- I'm +0 and defer to atm if the fix is harder than

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039361#comment-14039361 ] Yongjun Zhang commented on HDFS-6475: - Many thanks [~daryn], I will work on a new

[jira] [Commented] (HDFS-6580) 2 internal APIs in FSNamesystem use raw dir.getFileInfo() to getAuditFileInfo()

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039376#comment-14039376 ] Hadoop QA commented on HDFS-6580: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6582) Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

2014-06-20 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6582: Summary: Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler) Key: HDFS-6582 URL: https://issues.apache.org/jira/browse/HDFS-6582 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6572) Add an option to the NameNode that prints the software and on-disk image versions

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6572: --- Attachment: HDFS-6572.002.patch New patch with unit test. Previous unit test failure was a spurious

[jira] [Reopened] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-06-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-6391: --- Get the Key/IV from the NameNode for encrypted files in DFSClient

[jira] [Created] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-6583: Summary: Remove clientNode in FileUnderConstructionFeature Key: HDFS-6583 URL: https://issues.apache.org/jira/browse/HDFS-6583 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6583: - Attachment: HDFS-6583.000.patch Remove clientNode in FileUnderConstructionFeature

[jira] [Updated] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6583: - Status: Patch Available (was: Open) Remove clientNode in FileUnderConstructionFeature

[jira] [Commented] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039408#comment-14039408 ] Haohui Mai commented on HDFS-6583: -- The v0 patch salvages most of the code from HDFS-5714.

[jira] [Updated] (HDFS-6516) Persist and Restore the List of Encryption Zones

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6516: --- Summary: Persist and Restore the List of Encryption Zones (was: Implement List Encryption Zones)

[jira] [Updated] (HDFS-6555) Specify file encryption attributes at create time

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6555: --- Summary: Specify file encryption attributes at create time (was: Create a crypto blob) Specify

[jira] [Commented] (HDFS-6555) Specify file encryption attributes at create time

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039416#comment-14039416 ] Charles Lamb commented on HDFS-6555: This is important for distcp. Specify file

[jira] [Updated] (HDFS-6457) Maintain a list of all the Encryption Zones in the file system

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6457: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-6134) Maintain a list of all the

[jira] [Updated] (HDFS-6390) chown/chgrp users/groups blacklist for encrypted files

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6390: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-6134) chown/chgrp users/groups

[jira] [Updated] (HDFS-6393) User settable xAttr to stop HDFS admins from reading/chowning a file

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6393: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-6134) User settable xAttr to stop

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039425#comment-14039425 ] Yongjun Zhang commented on HDFS-6475: - HI [~daryn], While I'm working on a revised

[jira] [Updated] (HDFS-6523) add unit tests for encryption zones api and cli

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6523: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-6134) add unit tests for encryption

[jira] [Updated] (HDFS-6508) Add an XAttr to specify the cipher mode

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6508: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-6134) Add an XAttr to specify the

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039426#comment-14039426 ] Daryn Sharp commented on HDFS-6562: --- Are you sure this can't be a

[jira] [Commented] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039429#comment-14039429 ] Tsz Wo Nicholas Sze commented on HDFS-6583: --- This is a good idea. Please as well

[jira] [Updated] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6583: -- Component/s: namenode Priority: Minor (was: Major) Assignee: Haohui Mai

[jira] [Updated] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6583: - Attachment: HDFS-6583.001.patch Remove clientNode in FileUnderConstructionFeature

[jira] [Commented] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039436#comment-14039436 ] Haohui Mai commented on HDFS-6583: -- The v1 patch implements [~szetszwo]'s comments.

[jira] [Comment Edited] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039444#comment-14039444 ] Jing Zhao edited comment on HDFS-6562 at 6/20/14 10:11 PM: ---

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039444#comment-14039444 ] Jing Zhao commented on HDFS-6562: - Thanks for the refactoring, Haohui! Just finished

[jira] [Updated] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-4667: -- Component/s: (was: datanode) Assignee: Jing Zhao (was: Binglin Chang)

[jira] [Commented] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-06-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039459#comment-14039459 ] Andrew Wang commented on HDFS-6391: --- I'm starting on this JIRA, and was wondering about

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039474#comment-14039474 ] Jing Zhao commented on HDFS-6562: - Comments for the remaining changes: # I guess we can

[jira] [Commented] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-06-20 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039479#comment-14039479 ] Mike Yoder commented on HDFS-6391: -- Regarding the write-side algo, the way TLS choose the

[jira] [Updated] (HDFS-6580) FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo()

2014-06-20 Thread Zhilei Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilei Xu updated HDFS-6580: Attachment: (was: patch_cadc3030359f6c317e46d43c9f7ef61c5576a872.txt) FSNamesystem.mkdirsInt uses raw

[jira] [Updated] (HDFS-6580) FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo()

2014-06-20 Thread Zhilei Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilei Xu updated HDFS-6580: Summary: FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo() (was: 2 internal APIs in

[jira] [Updated] (HDFS-6580) FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo()

2014-06-20 Thread Zhilei Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilei Xu updated HDFS-6580: Description: In FSNamesystem.java, getAuditFileInfo() is the canonical way to get file info for auditing

[jira] [Created] (HDFS-6584) Support archival storage

2014-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-6584: - Summary: Support archival storage Key: HDFS-6584 URL: https://issues.apache.org/jira/browse/HDFS-6584 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Updated] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

2014-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-5682: -- Component/s: namenode datanode Issue Type: New Feature (was: Bug)

[jira] [Updated] (HDFS-6580) FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo()

2014-06-20 Thread Zhilei Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilei Xu updated HDFS-6580: Attachment: patch_c89bff2bb7a06bb2b0c66a85acbd5113db6b0526.txt FSNamesystem.mkdirsInt uses raw

[jira] [Updated] (HDFS-6580) FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo()

2014-06-20 Thread Zhilei Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilei Xu updated HDFS-6580: Description: In FSNamesystem.java, getAuditFileInfo() is the canonical way to get file info for auditing

[jira] [Commented] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039491#comment-14039491 ] Jing Zhao commented on HDFS-4667: - Thanks for the review, Nicholas! [~decster], do you have

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6134: - Attachment: (was: HDFSDataAtRestEncryption.pdf) Transparent data at rest encryption

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6134: --- Attachment: ConceptualDesignProposal_2014-06-20.pdf.pdf Revised one-pager. Transparent data at rest

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6134: - Attachment: (was: ConceptualDesignProposal_2014-06-19.pdf) Transparent data at rest

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6134: --- Attachment: ConceptualDesignProposal_2014-06-20.pdf Transparent data at rest encryption

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6134: - Attachment: (was: ConceptualDesignProposal_2014-06-20.pdf.pdf) Transparent data at

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6134: - Attachment: HDFSDataatRestEncryptionProposal_obsolete.pdf Re-uploading the previous

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6134: - Attachment: (was: ConceptualDesignProposal_2014-06-20.pdf) Transparent data at rest

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6134: - Attachment: HDFSEncryptionConceptualDesignProposal-2014-06-20.pdf Transparent data at

[jira] [Updated] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

2014-06-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2856: Status: Open (was: Patch Available) Fix block protocol so that Datanodes don't require root or

[jira] [Updated] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

2014-06-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2856: Attachment: HDFS-2856.3.patch I'm attaching patch v3 and notifying [~jnp], since I know he had

[jira] [Updated] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

2014-06-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2856: Status: Patch Available (was: Open) Fix block protocol so that Datanodes don't require root or

[jira] [Commented] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-06-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039524#comment-14039524 ] Andrew Wang commented on HDFS-6391: --- Ah, so the client would just initially only send the

[jira] [Resolved] (HDFS-6508) Add an XAttr to specify the cipher mode

2014-06-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6508. Resolution: Not a Problem Add an XAttr to specify the cipher mode

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039537#comment-14039537 ] Yi Liu commented on HDFS-6134: -- [~yoderme], isn’t the same as I state? Also the result {code}

[jira] [Commented] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-06-20 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039540#comment-14039540 ] Mike Yoder commented on HDFS-6391: -- One further detail I forgot to mention - the client

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039546#comment-14039546 ] Mike Yoder commented on HDFS-6134: -- If you know P1 you can trivially get to P2, of course.

[jira] [Updated] (HDFS-6222) Remove background token renewer from webhdfs

2014-06-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6222: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-6391) Get the Key/IV from the NameNode for encrypted files in DFSClient

2014-06-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039579#comment-14039579 ] Andrew Wang commented on HDFS-6391: --- Gotcha, that works for me. I might rename CipherType

[jira] [Commented] (HDFS-6572) Add an option to the NameNode that prints the software and on-disk image versions

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039584#comment-14039584 ] Hadoop QA commented on HDFS-6572: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039592#comment-14039592 ] Hadoop QA commented on HDFS-6583: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6583: -- Hadoop Flags: Reviewed +1 the new patch looks good. Remove clientNode in

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039608#comment-14039608 ] Yi Liu commented on HDFS-6134: -- {quote} My point was that we don't necessarily have to know P1

[jira] [Commented] (HDFS-6583) Remove clientNode in FileUnderConstructionFeature

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039620#comment-14039620 ] Hadoop QA commented on HDFS-6583: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6222) Remove background token renewer from webhdfs

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039624#comment-14039624 ] Hudson commented on HDFS-6222: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5747 (See

[jira] [Commented] (HDFS-6580) FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo()

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039643#comment-14039643 ] Hadoop QA commented on HDFS-6580: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

2014-06-20 Thread Zhilei Xu (JIRA)
Zhilei Xu created HDFS-6585: --- Summary: INodesInPath.resolve is called multiple times in FSNamesystem.setPermission Key: HDFS-6585 URL: https://issues.apache.org/jira/browse/HDFS-6585 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

2014-06-20 Thread Zhilei Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilei Xu updated HDFS-6585: Attachment: patch_ab60af58e03b323dd4b18d32c4def1f008b98822.txt INodesInPath.resolve is called multiple

[jira] [Updated] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

2014-06-20 Thread Zhilei Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilei Xu updated HDFS-6585: Labels: patch (was: ) Status: Patch Available (was: Open) INodesInPath.resolve is called multiple

[jira] [Commented] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039649#comment-14039649 ] Hadoop QA commented on HDFS-2856: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-20 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039667#comment-14039667 ] Binglin Chang commented on HDFS-4667: - bq. Binglin Chang, do you have any other

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039675#comment-14039675 ] Yongjun Zhang commented on HDFS-6475: - Hello Guys, Thank you all for the review and

[jira] [Commented] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039694#comment-14039694 ] Hadoop QA commented on HDFS-6585: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-20 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-6527: Fix Version/s: (was: 2.5.0) 2.4.1 Edit log corruption due to defered INode

[jira] [Commented] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038585#comment-14038585 ] Hadoop QA commented on HDFS-4667: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6574) make sure addToDeadNodes() only be called when there's a connection issue occur

2014-06-20 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6574: --- Summary: make sure addToDeadNodes() only be called when there's a connection issue occur Key: HDFS-6574 URL: https://issues.apache.org/jira/browse/HDFS-6574 Project: Hadoop

[jira] [Updated] (HDFS-6513) Add MirrorJournalManager to transfer edits from primary cluster to Mirror cluster

2014-06-20 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated HDFS-6513: -- Attachment: HDFS-6513.patch Add MirrorJournalManager to transfer edits from primary cluster to Mirror

[jira] [Updated] (HDFS-6574) make sure addToDeadNodes() only be called when there's a connection issue occur

2014-06-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6574: Description: My colleague [~cuijianwei] found in a HBase testing scenario, once a bad disk occured, the

[jira] [Commented] (HDFS-6513) Add MirrorJournalManager to transfer edits from primary cluster to Mirror cluster

2014-06-20 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038589#comment-14038589 ] Dian Fu commented on HDFS-6513: --- Thanks Vinay for the review. {quote} a) put

[jira] [Resolved] (HDFS-5184) BlockPlacementPolicyWithNodeGroup does not work correct when avoidStaleNodes is true

2014-06-20 Thread Nikola Vujic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Vujic resolved HDFS-5184. Resolution: Done This is fixed in HDP 2 with the new implementation of the block placement policy

[jira] [Created] (HDFS-6575) HDFS quota is not updated when changing File replication

2014-06-20 Thread George Wong (JIRA)
George Wong created HDFS-6575: - Summary: HDFS quota is not updated when changing File replication Key: HDFS-6575 URL: https://issues.apache.org/jira/browse/HDFS-6575 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6575) HDFS quota is not updated when changing File replication

2014-06-20 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038633#comment-14038633 ] George Wong commented on HDFS-6575: --- I am going to give a patch later. This issue is

[jira] [Updated] (HDFS-6535) HDFS quota update is wrong when file is appended

2014-06-20 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Wong updated HDFS-6535: -- Status: Patch Available (was: Open) HDFS quota update is wrong when file is appended

[jira] [Updated] (HDFS-6535) HDFS quota update is wrong when file is appended

2014-06-20 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Wong updated HDFS-6535: -- Attachment: HDFS-6535_v1.patch change the patch to address Jing's comments. HDFS quota update is

[jira] [Commented] (HDFS-6535) HDFS quota update is wrong when file is appended

2014-06-20 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038640#comment-14038640 ] George Wong commented on HDFS-6535: --- [~jingzhao], when I am working on this issue, I find

[jira] [Commented] (HDFS-6535) HDFS quota update is wrong when file is appended

2014-06-20 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038641#comment-14038641 ] George Wong commented on HDFS-6535: --- [~jingzhao], Could you please help me to review the

[jira] [Commented] (HDFS-6312) WebHdfs HA failover is broken on secure clusters

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038703#comment-14038703 ] Hudson commented on HDFS-6312: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See

[jira] [Commented] (HDFS-6403) Add metrics for log warnings reported by JVM pauses

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038706#comment-14038706 ] Hudson commented on HDFS-6403: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See

[jira] [Commented] (HDFS-6549) Add support for accessing the NFS gateway from the AIX NFS client

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038698#comment-14038698 ] Hudson commented on HDFS-6549: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See

[jira] [Commented] (HDFS-3848) A Bug in recoverLeaseInternal method of FSNameSystem class

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038701#comment-14038701 ] Hudson commented on HDFS-3848: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See

[jira] [Commented] (HDFS-6492) Support create-time xattrs and atomically setting multiple xattrs

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038700#comment-14038700 ] Hudson commented on HDFS-6492: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See

[jira] [Commented] (HDFS-6375) Listing extended attributes with the search permission

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038704#comment-14038704 ] Hudson commented on HDFS-6375: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See

[jira] [Commented] (HDFS-6535) HDFS quota update is wrong when file is appended

2014-06-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038754#comment-14038754 ] Hadoop QA commented on HDFS-6535: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6576) Datanode log is generating at root directory in security mode

2014-06-20 Thread surendra singh lilhore (JIRA)
surendra singh lilhore created HDFS-6576: Summary: Datanode log is generating at root directory in security mode Key: HDFS-6576 URL: https://issues.apache.org/jira/browse/HDFS-6576 Project:

[jira] [Commented] (HDFS-6549) Add support for accessing the NFS gateway from the AIX NFS client

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038812#comment-14038812 ] Hudson commented on HDFS-6549: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1780 (See

[jira] [Commented] (HDFS-6375) Listing extended attributes with the search permission

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038818#comment-14038818 ] Hudson commented on HDFS-6375: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1780 (See

[jira] [Commented] (HDFS-6403) Add metrics for log warnings reported by JVM pauses

2014-06-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038820#comment-14038820 ] Hudson commented on HDFS-6403: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1780 (See

  1   2   >