[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096614#comment-14096614 ] Sanjay Radia commented on HDFS-6134: I get your point about client-side code for

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096617#comment-14096617 ] Sanjay Radia commented on HDFS-6134: Alejandro, can you please summarize your

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096627#comment-14096627 ] Hadoop QA commented on HDFS-6634: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096629#comment-14096629 ] Alejandro Abdelnur commented on HDFS-6134: -- on create() the NN creates the INode

[jira] [Commented] (HDFS-5887) Add suffix to generated protobuf class

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096663#comment-14096663 ] Hadoop QA commented on HDFS-5887: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096694#comment-14096694 ] Hudson commented on HDFS-6783: -- FAILURE: Integrated in Hadoop-trunk-Commit #6064 (See

[jira] [Commented] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096777#comment-14096777 ] Steve Loughran commented on HDFS-6843: -- ...no actual need, it's just if you are adding

[jira] [Commented] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096862#comment-14096862 ] Hudson commented on HDFS-6783: -- FAILURE: Integrated in Hadoop-Yarn-trunk #646 (See

[jira] [Commented] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096866#comment-14096866 ] Hudson commented on HDFS-6847: -- FAILURE: Integrated in Hadoop-Yarn-trunk #646 (See

[jira] [Commented] (HDFS-6849) Replace HttpFS custom proxyuser handling with common implementation

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096864#comment-14096864 ] Hudson commented on HDFS-6849: -- FAILURE: Integrated in Hadoop-Yarn-trunk #646 (See

[jira] [Commented] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096868#comment-14096868 ] Hudson commented on HDFS-6247: -- FAILURE: Integrated in Hadoop-Yarn-trunk #646 (See

[jira] [Commented] (HDFS-6567) Normalize the order of public final in HdfsFileStatus

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096857#comment-14096857 ] Hudson commented on HDFS-6567: -- FAILURE: Integrated in Hadoop-Yarn-trunk #646 (See

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096944#comment-14096944 ] Hadoop QA commented on HDFS-6833: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6659) Create a Block List

2014-08-14 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096987#comment-14096987 ] Amir Langer commented on HDFS-6659: --- Re: [~daryn] The problems I had with using

[jira] [Commented] (HDFS-6762) hadoop-hdfs build fails at module-javadocs

2014-08-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097041#comment-14097041 ] Xiaoyu Yao commented on HDFS-6762: -- +1 Will take a look. hadoop-hdfs build fails at

[jira] [Updated] (HDFS-5887) Add suffix to generated protobuf class

2014-08-14 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated HDFS-5887: -- Attachment: HDFS-5887.001.patch Jenkins did not pick up right patch. Attaching

[jira] [Updated] (HDFS-6801) Archival Storage: Add a new data migration tool

2014-08-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6801: -- Attachment: h6801_20140814b.patch h6801_20140814b.patch: starts dispatcher. The patch

[jira] [Commented] (HDFS-6567) Normalize the order of public final in HdfsFileStatus

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097087#comment-14097087 ] Hudson commented on HDFS-6567: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1837 (See

[jira] [Commented] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097092#comment-14097092 ] Hudson commented on HDFS-6783: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1837 (See

[jira] [Commented] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097098#comment-14097098 ] Hudson commented on HDFS-6247: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1837 (See

[jira] [Commented] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097096#comment-14097096 ] Hudson commented on HDFS-6847: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1837 (See

[jira] [Commented] (HDFS-6849) Replace HttpFS custom proxyuser handling with common implementation

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097094#comment-14097094 ] Hudson commented on HDFS-6849: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1837 (See

[jira] [Created] (HDFS-6852) TestBalancerWithEncryptedTransfer sometimes fails in trunk

2014-08-14 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6852: Summary: TestBalancerWithEncryptedTransfer sometimes fails in trunk Key: HDFS-6852 URL: https://issues.apache.org/jira/browse/HDFS-6852 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097130#comment-14097130 ] Hudson commented on HDFS-6247: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1863 (See

[jira] [Commented] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097124#comment-14097124 ] Hudson commented on HDFS-6783: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1863 (See

[jira] [Commented] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097128#comment-14097128 ] Hudson commented on HDFS-6847: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1863 (See

[jira] [Commented] (HDFS-6849) Replace HttpFS custom proxyuser handling with common implementation

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097126#comment-14097126 ] Hudson commented on HDFS-6849: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1863 (See

[jira] [Commented] (HDFS-6567) Normalize the order of public final in HdfsFileStatus

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097119#comment-14097119 ] Hudson commented on HDFS-6567: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1863 (See

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-14 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Attachment: HDFS-6546.002.patch [~cmccabe], Thanks for the review. New rev of the patch is attached

[jira] [Issue Comment Deleted] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6847: Comment: was deleted (was: FAILURE: Integrated in Hadoop-Hdfs-trunk #1837 (See

[jira] [Issue Comment Deleted] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6847: Comment: was deleted (was: FAILURE: Integrated in Hadoop-Yarn-trunk #646 (See

[jira] [Issue Comment Deleted] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6847: Comment: was deleted (was: SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1863 (See

[jira] [Commented] (HDFS-6801) Archival Storage: Add a new data migration tool

2014-08-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097260#comment-14097260 ] Vinayakumar B commented on HDFS-6801: - One quick comment. FileStoragePolicy says its

[jira] [Commented] (HDFS-4486) Add log category for long-running DFSClient notices

2014-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097308#comment-14097308 ] Zhe Zhang commented on HDFS-4486: - [~tlipcon] I wonder if you can share a little more

[jira] [Commented] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097325#comment-14097325 ] Colin Patrick McCabe commented on HDFS-6546: {code} /** + * Returns an

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097330#comment-14097330 ] Sanjay Radia commented on HDFS-6134: Had a chat with Owen over the wehbhdfs issue and

[jira] [Commented] (HDFS-4486) Add log category for long-running DFSClient notices

2014-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097332#comment-14097332 ] Colin Patrick McCabe commented on HDFS-4486: [~oldcap]: there are a bunch of

[jira] [Commented] (HDFS-5189) Rename the CorruptBlocks metric to CorruptReplicas

2014-08-14 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097354#comment-14097354 ] Harsh J commented on HDFS-5189: --- Good point; Lets have it more verbose then, perhaps

[jira] [Commented] (HDFS-4486) Add log category for long-running DFSClient notices

2014-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097356#comment-14097356 ] Zhe Zhang commented on HDFS-4486: - OK, then JMX doesn't make too much sense. I'll just add

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-14 Thread Selvamohan Neethiraj (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097384#comment-14097384 ] Selvamohan Neethiraj commented on HDFS-6826: It just make sense to add an

[jira] [Resolved] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-14 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6546. Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) I've committed

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-14 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Attachment: HDFS-6546.003.patch .003 addresses these issues. I turned the empty EZWId into a final

[jira] [Commented] (HDFS-5887) Add suffix to generated protobuf class

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097499#comment-14097499 ] Hadoop QA commented on HDFS-5887: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097505#comment-14097505 ] Suresh Srinivas commented on HDFS-6134: --- Finally got some time to catchup on this

[jira] [Commented] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097555#comment-14097555 ] Andrew Wang commented on HDFS-6843: --- +1 to that sentiment in the abstract. The other one

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097566#comment-14097566 ] Aaron T. Myers commented on HDFS-6850: -- Hey Zhe, the patch looks pretty good to me,

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097591#comment-14097591 ] Zhe Zhang commented on HDFS-6850: - The original TestOutOfOrderWrite.java was for manual

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097610#comment-14097610 ] Sanjay Radia commented on HDFS-6134: Context: making things work for cp, distcp, har,

[jira] [Created] (HDFS-6853) MiniDFSCluster.isClusterUp() should not check if null NameNodes are up

2014-08-14 Thread James Thomas (JIRA)
James Thomas created HDFS-6853: -- Summary: MiniDFSCluster.isClusterUp() should not check if null NameNodes are up Key: HDFS-6853 URL: https://issues.apache.org/jira/browse/HDFS-6853 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097611#comment-14097611 ] Colin Patrick McCabe commented on HDFS-6546: Thanks, Charles Add

[jira] [Updated] (HDFS-6853) MiniDFSCluster.isClusterUp() should not check if null NameNodes are up

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6853: --- Attachment: HDFS-6853.patch MiniDFSCluster.isClusterUp() should not check if null NameNodes are up

[jira] [Updated] (HDFS-6853) MiniDFSCluster.isClusterUp() should not check if null NameNodes are up

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6853: --- Assignee: James Thomas Status: Patch Available (was: Open) MiniDFSCluster.isClusterUp()

[jira] [Updated] (HDFS-6634) inotify in HDFS

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6634: --- Attachment: HDFS-6634.5.patch The TestCheckpoint failure looks like a flake even though it relates to

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-14 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097666#comment-14097666 ] Alejandro Abdelnur commented on HDFS-6826: -- [~sneethiraj], The current proposal

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097669#comment-14097669 ] Suresh Srinivas commented on HDFS-6134: --- bq. To read the file, you need to turn the

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097687#comment-14097687 ] Sanjay Radia commented on HDFS-6134: Soem thoughts on the Har use cases and possible

[jira] [Comment Edited] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097687#comment-14097687 ] Sanjay Radia edited comment on HDFS-6134 at 8/14/14 9:23 PM: -

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097729#comment-14097729 ] Suresh Srinivas commented on HDFS-6134: --- [~clamb], we are saying the same thing. For

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097743#comment-14097743 ] Charles Lamb commented on HDFS-6134: {quote} Charles Lamb, we are saying the same

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097809#comment-14097809 ] Brandon Li commented on HDFS-6850: -- TestOutOfOrderWrite was created in the early days of

[jira] [Updated] (HDFS-5135) Create a test framework to enable NFS end to end unit test

2014-08-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5135: - Affects Version/s: 2.2.0 Create a test framework to enable NFS end to end unit test

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097814#comment-14097814 ] Zhe Zhang commented on HDFS-6850: - [~brandonli] Thanks for the clarification. Sounds good

[jira] [Created] (HDFS-6854) Enhance CLI to support memory storage.

2014-08-14 Thread Tassapol Athiapinya (JIRA)
Tassapol Athiapinya created HDFS-6854: - Summary: Enhance CLI to support memory storage. Key: HDFS-6854 URL: https://issues.apache.org/jira/browse/HDFS-6854 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6855) Add a different end-to-end non-manual NFS test to replace TestOutOfOrderWrite

2014-08-14 Thread Brandon Li (JIRA)
Brandon Li created HDFS-6855: Summary: Add a different end-to-end non-manual NFS test to replace TestOutOfOrderWrite Key: HDFS-6855 URL: https://issues.apache.org/jira/browse/HDFS-6855 Project: Hadoop

[jira] [Updated] (HDFS-6855) Add a different end-to-end non-manual NFS test to replace TestOutOfOrderWrite

2014-08-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6855: - Issue Type: Improvement (was: Bug) Add a different end-to-end non-manual NFS test to replace

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-14 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097859#comment-14097859 ] Jitendra Nath Pandey commented on HDFS-6826: I agree with the idea of plugin

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097863#comment-14097863 ] Brandon Li commented on HDFS-6850: -- Created HDFS-6855 to track the effort of replacing

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097868#comment-14097868 ] Brandon Li commented on HDFS-6850: -- +1. Thank you, [~zhz] and [~atm]! Move NFS out of

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097875#comment-14097875 ] Sanjay Radia commented on HDFS-6134: bq. Had a chat with Owen over the wehbhdfs issue

[jira] [Updated] (HDFS-6561) Byte array native checksumming on client side

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6561: --- Attachment: HDFS-6561.4.patch Todd's patch with the second change suggested by Colin. [~cmccabe], as

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6581: Attachment: HDFSWriteableReplicasInMemory.pdf Proposal for supporting writeable replicas in memory.

[jira] [Commented] (HDFS-5135) Create a test framework to enable NFS end to end unit test

2014-08-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097882#comment-14097882 ] Brandon Li commented on HDFS-5135: -- [~zhz], thanks for the question! Let's use HDFS-6855

[jira] [Commented] (HDFS-6561) Byte array native checksumming on client side

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097898#comment-14097898 ] Hadoop QA commented on HDFS-6561: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6561) Byte array native checksumming on client side

2014-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097901#comment-14097901 ] Colin Patrick McCabe commented on HDFS-6561: So, I think that we could refactor

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.004.patch distcp from insecure cluster (source) to secure cluster

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097907#comment-14097907 ] Yongjun Zhang commented on HDFS-6776: - Hi [~daryn], Thanks a lot for your earlier

[jira] [Updated] (HDFS-6561) Byte array native checksumming on client side

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6561: --- Attachment: HDFS-6561.5.patch Thanks, Colin. Posted updated patch. Byte array native checksumming

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-14 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6826: - Attachment: HDFS-6826-idea2.patch attach is new POC where the FsPermissionChecker has

[jira] [Comment Edited] (HDFS-5135) Create a test framework to enable NFS end to end unit test

2014-08-14 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097882#comment-14097882 ] Brandon Li edited comment on HDFS-5135 at 8/15/14 12:03 AM:

[jira] [Commented] (HDFS-6561) Byte array native checksumming on client side

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097979#comment-14097979 ] Hadoop QA commented on HDFS-6561: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6853) MiniDFSCluster.isClusterUp() should not check if null NameNodes are up

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098017#comment-14098017 ] Hadoop QA commented on HDFS-6853: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098032#comment-14098032 ] Hadoop QA commented on HDFS-6634: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6853) MiniDFSCluster.isClusterUp() should not check if null NameNodes are up

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098034#comment-14098034 ] James Thomas commented on HDFS-6853: Looks like a few tests rely on this behavior ...

[jira] [Updated] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6800: --- Status: Patch Available (was: Open) Determine how Datanode layout changes should interact with

[jira] [Updated] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6800: --- Attachment: HDFS-6800.patch Attached a patch with our proposed solution. [~arpitagarwal] or

[jira] [Assigned] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-14 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas reassigned HDFS-6800: -- Assignee: James Thomas Determine how Datanode layout changes should interact with rolling

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098078#comment-14098078 ] Aaron T. Myers commented on HDFS-6850: -- Great, thanks for the comments, Brandon. +1

[jira] [Updated] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6850: - Target Version/s: 2.6.0 (was: 3.0.0) Move NFS out of order write unit tests into TestWrites

[jira] [Updated] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6850: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-6819) make HDFS fault injection framework working with maven

2014-08-14 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098081#comment-14098081 ] George Wong commented on HDFS-6819: --- MiniDFSCluster is very useful for testing. I saw

[jira] [Commented] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098105#comment-14098105 ] Arpit Agarwal commented on HDFS-6800: - Thanks James. I will try out your patch with

[jira] [Comment Edited] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098113#comment-14098113 ] Suresh Srinivas edited comment on HDFS-6134 at 8/15/14 3:53 AM:

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098113#comment-14098113 ] Suresh Srinivas commented on HDFS-6134: --- We had conversation about the finer details

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098126#comment-14098126 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6850) Move NFS out of order write unit tests into TestWrites class

2014-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098136#comment-14098136 ] Hudson commented on HDFS-6850: -- FAILURE: Integrated in Hadoop-trunk-Commit #6075 (See

[jira] [Commented] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098162#comment-14098162 ] Tsz Wo Nicholas Sze commented on HDFS-6847: --- We should add setStoragePolicyID

[jira] [Comment Edited] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-14 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097944#comment-14097944 ] Alejandro Abdelnur edited comment on HDFS-6826 at 8/15/14 5:06 AM:

[jira] [Updated] (HDFS-3744) Decommissioned nodes are included in cluster after switch which is not expected

2014-08-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-3744: --- Fix Version/s: (was: 2.5.0) Decommissioned nodes are included in cluster after switch

[jira] [Updated] (HDFS-5503) Datanode#checkDiskError also should check for ClosedChannelException

2014-08-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-5503: --- Fix Version/s: (was: 2.5.0) Datanode#checkDiskError also should check for

[jira] [Updated] (HDFS-3907) Allow multiple users for local block readers

2014-08-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-3907: --- Fix Version/s: (was: 2.5.0) 2.6.0 Allow multiple users for local

  1   2   >