[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033472#comment-14033472 ] Vinayakumar B commented on HDFS-6507: - Thanks [~wuzesheng] for working on this. Here

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033480#comment-14033480 ] Zesheng Wu commented on HDFS-6507: -- Thanks [~vinayrpet] for reviewing the patch, all

[jira] [Created] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-17 Thread Amir Langer (JIRA)
Amir Langer created HDFS-6552: - Summary: add DN storage to a BlockInfo will not replace the different storage from same DN Key: HDFS-6552 URL: https://issues.apache.org/jira/browse/HDFS-6552 Project:

[jira] [Updated] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-17 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-6552: -- Description: In BlockInfo - addStorage code looks wrong. At line 10 (below) - we remove the storage

[jira] [Updated] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-17 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-6552: -- Description: In BlockInfo - addStorage code looks wrong. At line 10 (below) - we remove the storage

[jira] [Commented] (HDFS-6551) Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode

2014-06-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033532#comment-14033532 ] Hadoop QA commented on HDFS-6551: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-17 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-6552: -- Description: In BlockInfo - addStorage code looks wrong. At line 10 (below) - we remove the storage

[jira] [Updated] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-17 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-6552: -- Description: In BlockInfo - addStorage code looks wrong. At line 10 (below) - we remove the storage

[jira] [Updated] (HDFS-6534) Fix build on macosx: HDFS parts

2014-06-17 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-6534: Attachment: HDFS-6534.v2.patch FIx a minor typo causing linux build failed Fix build on macosx:

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.3.patch New patch addressed Vinay's review comments. Improve DFSAdmin to support

[jira] [Updated] (HDFS-6505) file is corrupt due to last block is marked as corrupt by mistake

2014-06-17 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gordon Wang updated HDFS-6505: -- Summary: file is corrupt due to last block is marked as corrupt by mistake (was: Can not close file

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033657#comment-14033657 ] Vinayakumar B commented on HDFS-6507: - Instead of getting Proxy instances and addresses

[jira] [Commented] (HDFS-6539) test_native_mini_dfs is skipped in hadoop-hdfs/pom.xml

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033680#comment-14033680 ] Hudson commented on HDFS-6539: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #586 (See

[jira] [Commented] (HDFS-6518) TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033682#comment-14033682 ] Hudson commented on HDFS-6518: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #586 (See

[jira] [Commented] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033681#comment-14033681 ] Hudson commented on HDFS-6528: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #586 (See

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033688#comment-14033688 ] Zesheng Wu commented on HDFS-6507: -- I checked the related code, ProxyAndInfo is used in 3

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033693#comment-14033693 ] Zesheng Wu commented on HDFS-6507: -- Oh, It seems that NameNode also has a {{

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6507: Attachment: HDFS-6507.4-inprogress.patch Please check this patch. In this check the

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033731#comment-14033731 ] Hadoop QA commented on HDFS-6507: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033733#comment-14033733 ] Vinayakumar B commented on HDFS-6507: - I did not check the patch #4 of yours while

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033735#comment-14033735 ] Vinayakumar B commented on HDFS-6507: - One more query I have. using this

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033737#comment-14033737 ] Zesheng Wu commented on HDFS-6507: -- OK, let me figure these too out:) Improve DFSAdmin

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033738#comment-14033738 ] Zesheng Wu commented on HDFS-6507: -- bq. One more query I have. using this implementation

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033748#comment-14033748 ] Vinayakumar B commented on HDFS-6507: - Thats not acceptable. User should be able to do

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033754#comment-14033754 ] Zesheng Wu commented on HDFS-6507: -- Mmm, maybe in this case, user can use {{-fs}} generic

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033760#comment-14033760 ] Vinayakumar B commented on HDFS-6507: - Oh. Yes. Thats also possible. Better to get

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.5.patch Some minor polishes. Improve DFSAdmin to support HA cluster better

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033725#comment-14033725 ] Zesheng Wu commented on HDFS-6507: -- It seems that finalizeUpgrade() doesn't output any

[jira] [Updated] (HDFS-6545) Finalizing rolling upgrade can make NN unavailable for a long duration

2014-06-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6545: - Attachment: HDFS-6545.v2.patch I made the logsync conditional in the new patch. Finalizing rolling

[jira] [Assigned] (HDFS-6545) Finalizing rolling upgrade can make NN unavailable for a long duration

2014-06-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-6545: Assignee: Kihwal Lee Finalizing rolling upgrade can make NN unavailable for a long duration

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033814#comment-14033814 ] Kihwal Lee commented on HDFS-6527: -- +1 for the test improvement. Edit log corruption due

[jira] [Commented] (HDFS-6539) test_native_mini_dfs is skipped in hadoop-hdfs/pom.xml

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033832#comment-14033832 ] Hudson commented on HDFS-6539: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1777 (See

[jira] [Commented] (HDFS-6518) TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033834#comment-14033834 ] Hudson commented on HDFS-6518: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1777 (See

[jira] [Commented] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033833#comment-14033833 ] Hudson commented on HDFS-6528: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1777 (See

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033884#comment-14033884 ] Hadoop QA commented on HDFS-6507: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6539) test_native_mini_dfs is skipped in hadoop-hdfs/pom.xml

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033912#comment-14033912 ] Hudson commented on HDFS-6539: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1804 (See

[jira] [Commented] (HDFS-6518) TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033914#comment-14033914 ] Hudson commented on HDFS-6518: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1804 (See

[jira] [Commented] (HDFS-6528) Add XAttrs to TestOfflineImageViewer

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033913#comment-14033913 ] Hudson commented on HDFS-6528: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1804 (See

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033925#comment-14033925 ] Hadoop QA commented on HDFS-6507: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.6.patch The failed test {{TestCrcCorruption}} doesn't relate to this issue I run it

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033963#comment-14033963 ] Hadoop QA commented on HDFS-6507: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033975#comment-14033975 ] Owen O'Malley commented on HDFS-6134: - The right way to do this is to have the Yarn job

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033981#comment-14033981 ] Owen O'Malley commented on HDFS-6134: - A follow up on that is that of course KMS will

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033990#comment-14033990 ] Daryn Sharp commented on HDFS-6475: --- Is a static method in InvalidToken really the right

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034002#comment-14034002 ] Alejandro Abdelnur commented on HDFS-6134: -- [~owen.omalley], Yarn job submission

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034016#comment-14034016 ] Owen O'Malley commented on HDFS-6134: - Alejandro, which use cases don't know their

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034028#comment-14034028 ] Larry McCay commented on HDFS-6134: --- Hmmm, I agree with Owen. For usecases where these

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034031#comment-14034031 ] Alejandro Abdelnur commented on HDFS-6134: -- i.e.: if a M/R task opens a side file

[jira] [Commented] (HDFS-6536) FileSystem.Cache.closeAll() throws authentication exception at the end of a webhdfs client

2014-06-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034039#comment-14034039 ] Daryn Sharp commented on HDFS-6536: --- The problem should manifest with something as simple

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034040#comment-14034040 ] Larry McCay commented on HDFS-6134: --- [~tucu00] - that is a good example of where

[jira] [Commented] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034042#comment-14034042 ] Arpit Agarwal commented on HDFS-6552: - Thanks for reporting this [~langera]. It looks

[jira] [Commented] (HDFS-6545) Finalizing rolling upgrade can make NN unavailable for a long duration

2014-06-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034076#comment-14034076 ] Jing Zhao commented on HDFS-6545: - The patch looks good to me. +1. Thanks for working on

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034097#comment-14034097 ] Jing Zhao commented on HDFS-6527: - Thanks for reviewing the test change, [~kihwal]! I will

[jira] [Commented] (HDFS-6549) Add support for accessing the NFS gateway from the AIX NFS client

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034115#comment-14034115 ] Aaron T. Myers commented on HDFS-6549: -- I'm quite confident the test failure is

[jira] [Updated] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6527: - Target Version/s: 2.5.0 (was: 2.4.1) Changing the target version from 2.4.1 to 2.5.0 since 2.4.1 is

[jira] [Commented] (HDFS-6545) Finalizing rolling upgrade can make NN unavailable for a long duration

2014-06-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034136#comment-14034136 ] Kihwal Lee commented on HDFS-6545: -- Thanks for the review [~jingzhao]. I've committed this

[jira] [Updated] (HDFS-6545) Finalizing rolling upgrade can make NN unavailable for a long duration

2014-06-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6545: - Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-6545) Finalizing rolling upgrade can make NN unavailable for a long duration

2014-06-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034149#comment-14034149 ] Hudson commented on HDFS-6545: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5719 (See

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034155#comment-14034155 ] Owen O'Malley commented on HDFS-6134: - Alejandro, this is *exactly* equivalent of the

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-06-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034164#comment-14034164 ] Todd Lipcon commented on HDFS-5851: --- Yep, the native checksumming that James is working

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034204#comment-14034204 ] Hadoop QA commented on HDFS-6507: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034218#comment-14034218 ] Brandon Li commented on HDFS-6439: -- Thank you, Aaron, for the review! {quote}add a

[jira] [Commented] (HDFS-6492) Support create-time xattrs and atomically setting multiple xattrs

2014-06-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034229#comment-14034229 ] Charles Lamb commented on HDFS-6492: LGTM. I only have a few picky little nits. The

[jira] [Commented] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034233#comment-14034233 ] Aaron T. Myers commented on HDFS-6439: -- bq. Are you referring

[jira] [Commented] (HDFS-3848) A Bug in recoverLeaseInternal method of FSNameSystem class

2014-06-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034258#comment-14034258 ] Kihwal Lee commented on HDFS-3848: -- I kicked the precommit again. It looks like the patch

[jira] [Created] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-6553: - Summary: Add missing DeprecationDeltas for NFS Kerberos configurations Key: HDFS-6553 URL: https://issues.apache.org/jira/browse/HDFS-6553 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6553: -- Attachment: HDFS-6553.patch.001 Attaching patch. This adds two DeprecationDeltas for

[jira] [Updated] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6553: - Target Version/s: 2.5.0 Add missing DeprecationDeltas for NFS Kerberos configurations

[jira] [Commented] (HDFS-3848) A Bug in recoverLeaseInternal method of FSNameSystem class

2014-06-17 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034282#comment-14034282 ] Chen He commented on HDFS-3848: --- I will add the test case. A Bug in recoverLeaseInternal

[jira] [Commented] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034283#comment-14034283 ] Aaron T. Myers commented on HDFS-6553: -- Good stuff, Stephen. Thanks a lot for catching

[jira] [Commented] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034286#comment-14034286 ] Stephen Chu commented on HDFS-6553: --- That's a good idea. Let me check for any other

[jira] [Commented] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034370#comment-14034370 ] Stephen Chu commented on HDFS-6553: --- Hi ATM, I went through HDFS-6056, which was fixed in

[jira] [Updated] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6439: - Attachment: HDFS-6439.005.patch NFS should not reject NFS requests to the NULL procedure whether port

[jira] [Commented] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034384#comment-14034384 ] Brandon Li commented on HDFS-6439: -- OK. The new patch addressed the comments. Thanks,

[jira] [Updated] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6439: - Attachment: (was: HDFS-6439.005.patch) NFS should not reject NFS requests to the NULL procedure

[jira] [Updated] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6439: - Attachment: HDFS-6439.005.patch NFS should not reject NFS requests to the NULL procedure whether port

[jira] [Updated] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-5546: Attachment: HDFS-5546.2.001.patch Hey [~cmccabe] This patch includes a unit test that deletes a

[jira] [Updated] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-5546: Fix Version/s: 3.0.0 Status: Patch Available (was: Open) This patch catches

[jira] [Commented] (HDFS-6439) NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034459#comment-14034459 ] Aaron T. Myers commented on HDFS-6439: -- Thanks a lot for addressing my comments,

[jira] [Created] (HDFS-6554) Create unencrypted streams interface

2014-06-17 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6554: -- Summary: Create unencrypted streams interface Key: HDFS-6554 URL: https://issues.apache.org/jira/browse/HDFS-6554 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-6555) Create a crypto blob

2014-06-17 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6555: -- Summary: Create a crypto blob Key: HDFS-6555 URL: https://issues.apache.org/jira/browse/HDFS-6555 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034476#comment-14034476 ] Aaron T. Myers commented on HDFS-6553: -- Yes please, that sounds great. When you do,

[jira] [Commented] (HDFS-6549) Add support for accessing the NFS gateway from the AIX NFS client

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034486#comment-14034486 ] Aaron T. Myers commented on HDFS-6549: -- [~brandonli] - would you mind taking a look at

[jira] [Commented] (HDFS-6549) Add support for accessing the NFS gateway from the AIX NFS client

2014-06-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034494#comment-14034494 ] Brandon Li commented on HDFS-6549: -- Sure. I will review it shortly. Add support for

[jira] [Commented] (HDFS-6549) Add support for accessing the NFS gateway from the AIX NFS client

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034497#comment-14034497 ] Aaron T. Myers commented on HDFS-6549: -- Thanks much. Add support for accessing the

[jira] [Updated] (HDFS-6403) Add metrics for log warnings reported by JVM pauses

2014-06-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6403: Attachment: HDFS-6403.003.patch Add metrics for log warnings reported by JVM pauses

[jira] [Commented] (HDFS-6480) Move waitForReady() from FSDirectory to FSNamesystem

2014-06-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034503#comment-14034503 ] Jing Zhao commented on HDFS-6480: - The patch looks good to me. Some comments: # I think the

[jira] [Commented] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034511#comment-14034511 ] Brandon Li commented on HDFS-6553: -- Thank you, Stephen, for finding issue and providing

[jira] [Commented] (HDFS-6403) Add metrics for log warnings reported by JVM pauses

2014-06-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034514#comment-14034514 ] Yongjun Zhang commented on HDFS-6403: - HI [~atm], Thanks a lot for the review and the

[jira] [Commented] (HDFS-6403) Add metrics for log warnings reported by JVM pauses

2014-06-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034515#comment-14034515 ] Yongjun Zhang commented on HDFS-6403: - I meant version 003. Add metrics for log

[jira] [Updated] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6553: -- Status: Patch Available (was: Open) Add missing DeprecationDeltas for NFS Kerberos configurations

[jira] [Updated] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6553: -- Attachment: HDFS-6553.patch.002 Thanks, ATM and Brandon. I updated the patch to include the other

[jira] [Commented] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034535#comment-14034535 ] Hadoop QA commented on HDFS-5546: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6553) Add missing DeprecationDeltas for NFS Kerberos configurations

2014-06-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034538#comment-14034538 ] Aaron T. Myers commented on HDFS-6553: -- Latest patch looks good to me. +1 pending

[jira] [Commented] (HDFS-6403) Add metrics for log warnings reported by JVM pauses

2014-06-17 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034547#comment-14034547 ] Akira AJISAKA commented on HDFS-6403: - Thanks [~yzhangal] for the nice work! Would you

[jira] [Resolved] (HDFS-6390) chown/chgrp users/groups blacklist for encrypted files

2014-06-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6390. Resolution: Not a Problem This is no longer a problem now that the NN will never handle key

[jira] [Updated] (HDFS-6387) HDFS CLI admin tool for creating deleting an encryption zone

2014-06-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6387: --- Attachment: HDFS-6387.002.patch Rebased patch w/ unit tests. The unit tests will have to be re-run

[jira] [Resolved] (HDFS-6393) User settable xAttr to stop HDFS admins from reading/chowning a file

2014-06-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6393. Resolution: Not a Problem This is no longer a problem now that the NN will never handle key

[jira] [Commented] (HDFS-6516) Implement List Encryption Zones

2014-06-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034567#comment-14034567 ] Charles Lamb commented on HDFS-6516: Most of the backend of listEncryptionZones will be

[jira] [Work started] (HDFS-6386) HDFS Encryption Zones

2014-06-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6386 started by Charles Lamb. HDFS Encryption Zones - Key: HDFS-6386 URL:

  1   2   >