[jira] [Created] (HDFS-7037) distcp via hftp fails in a similar way as webhdfs reported by HDFS-6776

2014-09-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-7037: --- Summary: distcp via hftp fails in a similar way as webhdfs reported by HDFS-6776 Key: HDFS-7037 URL: https://issues.apache.org/jira/browse/HDFS-7037 Project: Hadoop

[jira] [Assigned] (HDFS-7037) distcp via hftp fails in a similar way as webhdfs reported by HDFS-6776

2014-09-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-7037: --- Assignee: Yongjun Zhang distcp via hftp fails in a similar way as webhdfs reported by

[jira] [Commented] (HDFS-6776) Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work

2014-09-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128115#comment-14128115 ] Yongjun Zhang commented on HDFS-6776: - Thanks a lot [~tucu00]! Many thanks to [~aw],

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128118#comment-14128118 ] Hadoop QA commented on HDFS-6757: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6469) Coordinated replication of the namespace using ConsensusNode

2014-09-10 Thread Dmitry Salychev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128133#comment-14128133 ] Dmitry Salychev commented on HDFS-6469: --- Will failure of CoordinationEngine cause

[jira] [Updated] (HDFS-7006) Test encryption zones with KMS

2014-09-10 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-7006: - Status: Open (was: Patch Available) testcases pass when run from hadoop source root, they

[jira] [Commented] (HDFS-6469) Coordinated replication of the namespace using ConsensusNode

2014-09-10 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128169#comment-14128169 ] Konstantin Boudnik commented on HDFS-6469: -- No, active-active model has strong

[jira] [Commented] (HDFS-6469) Coordinated replication of the namespace using ConsensusNode

2014-09-10 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128172#comment-14128172 ] Konstantin Boudnik commented on HDFS-6469: -- So, any feedback on the urge of having

[jira] [Created] (HDFS-7038) Provide a 64bit Native library

2014-09-10 Thread gurmukh singh (JIRA)
gurmukh singh created HDFS-7038: --- Summary: Provide a 64bit Native library Key: HDFS-7038 URL: https://issues.apache.org/jira/browse/HDFS-7038 Project: Hadoop HDFS Issue Type: Wish

[jira] [Commented] (HDFS-6776) Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128356#comment-14128356 ] Hudson commented on HDFS-6776: -- FAILURE: Integrated in Hadoop-Yarn-trunk #676 (See

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128362#comment-14128362 ] Hudson commented on HDFS-6940: -- FAILURE: Integrated in Hadoop-Yarn-trunk #676 (See

[jira] [Updated] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-09-10 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-6658: -- Attachment: HDFS-6658.patch Namenode memory optimization - Block replicas list

[jira] [Updated] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-09-10 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Langer updated HDFS-6658: -- Status: Patch Available (was: Open) Path includes all sub-tasks Namenode memory optimization - Block

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-10 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6705: --- Attachment: HDFS-6705.005.patch Rebased. Create an XAttr that disallows the HDFS admin from

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-10 Thread Lei Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128472#comment-14128472 ] Lei Chang commented on HDFS-3107: - Method #3 does not work for this use case which is very

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128499#comment-14128499 ] Hudson commented on HDFS-6940: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1867 (See

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128495#comment-14128495 ] Hudson commented on HDFS-6482: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1867 (See

[jira] [Commented] (HDFS-6776) Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128493#comment-14128493 ] Hudson commented on HDFS-6776: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1867 (See

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128533#comment-14128533 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7039) Archival Storage: fix Balancer tests

2014-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7039: - Summary: Archival Storage: fix Balancer tests Key: HDFS-7039 URL: https://issues.apache.org/jira/browse/HDFS-7039 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128572#comment-14128572 ] Tsz Wo Nicholas Sze commented on HDFS-6621: --- I agree with Yongjun that let's only

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128604#comment-14128604 ] Yongjun Zhang commented on HDFS-6621: - Thank you so much [~szetszwo]! HI

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128660#comment-14128660 ] Hadoop QA commented on HDFS-6705: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-10 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6705: --- Attachment: HDFS-6705.006.patch .006 has a few minor cleanups. Create an XAttr that disallows the

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-10 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128713#comment-14128713 ] Rafal Wojdyla commented on HDFS-6621: - [~yzhangal] for problem 1 - patch is in

[jira] [Updated] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-10 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6966: -- Attachment: HDFS-6966.4.patch Re-kick Hadoop QA. Add additional unit tests for encryption zones

[jira] [Updated] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-6867: Attachment: HDFS-6867-design-20140910.pdf New design doc addresses [~cmccabe]'s comments on locking between

[jira] [Commented] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-10 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12667785/HDFS-6867-design-20140910.pdf against trunk revision 3072c83. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HDFS

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128740#comment-14128740 ] Yongjun Zhang commented on HDFS-6621: - HI [~ravwojdyla], thanks for your quick

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

2014-09-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-49: --- Status: Open (was: Patch Available) MiniDFSCluster.stopDataNode will always shut down a node in the

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

2014-09-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-49: --- Target Version/s: 2.6.0 Status: Patch Available (was: Open) MiniDFSCluster.stopDataNode

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

2014-09-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-49: --- Attachment: HDFS-49-002.patch patch 002, applies to trunk MiniDFSCluster.stopDataNode will always shut

[jira] [Commented] (HDFS-6982) nntop: topĀ­-like tool for name node users

2014-09-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128806#comment-14128806 ] Haohui Mai commented on HDFS-6982: -- Given that the second architecture has been proven in

[jira] [Updated] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-10 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated HDFS-6621: Attachment: HDFS-6621_problem1.patch Hadoop Balancer prematurely exits iterations

[jira] [Updated] (HDFS-6948) DN rejects blocks if it has older UC block

2014-09-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-6948: - Attachment: HDFS-6948.201409101802.txt Thanks [~daryn] and [~kihwal]. bq. use instanceof to verify it's

[jira] [Commented] (HDFS-6948) DN rejects blocks if it has older UC block

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128841#comment-14128841 ] Hadoop QA commented on HDFS-6948: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6982) nntop: topĀ­-like tool for name node users

2014-09-10 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128844#comment-14128844 ] Maysam Yabandeh commented on HDFS-6982: --- bq. Given that the second architecture has

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128867#comment-14128867 ] Masatake Iwasaki commented on HDFS-6880: bq. So, it looks like we don't have

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128874#comment-14128874 ] Hadoop QA commented on HDFS-6705: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-09-10 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128880#comment-14128880 ] Jitendra Nath Pandey commented on HDFS-6826: My concern is that we are adding

[jira] [Commented] (HDFS-7035) Refactor DataStorage and BlockSlicePoolStorage

2014-09-10 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128896#comment-14128896 ] Lei (Eddy) Xu commented on HDFS-7035: - I will update the patch to address those

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128920#comment-14128920 ] Hudson commented on HDFS-6940: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1892 (See

[jira] [Commented] (HDFS-6776) Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128914#comment-14128914 ] Hudson commented on HDFS-6776: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1892 (See

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128916#comment-14128916 ] Hudson commented on HDFS-6482: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1892 (See

[jira] [Commented] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-10 Thread Zhe Zhang (JIRA)
, HDFS-6867-20140827.patch, HDFS-6867-20140828-1.patch, HDFS-6867-20140828-2.patch, HDFS-6867-design-20140820.pdf, HDFS-6867-design-20140821.pdf, HDFS-6867-design-20140822.pdf, HDFS-6867-design-20140827.pdf, HDFS-6867-design-20140910.pdf For DFSOutputStream, we should be able to do pipeline

[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128983#comment-14128983 ] Hadoop QA commented on HDFS-6621: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128982#comment-14128982 ] Hadoop QA commented on HDFS-6966: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-10 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128989#comment-14128989 ] Stephen Chu commented on HDFS-6966: --- The above 3 test failures are unrelated. Run them

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129037#comment-14129037 ] Hadoop QA commented on HDFS-49: --- {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-10 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129081#comment-14129081 ] Plamen Jeliazkov commented on HDFS-3107: I have a patch with failure scenarios

[jira] [Updated] (HDFS-6888) Remove audit logging of getFIleInfo()

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6888: -- Attachment: (was: HDFS-6888-3.patch) Remove audit logging of getFIleInfo()

[jira] [Updated] (HDFS-6888) Remove audit logging of getFIleInfo()

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6888: -- Attachment: (was: HDFS-6888-3.patch) Remove audit logging of getFIleInfo()

[jira] [Updated] (HDFS-6888) Remove audit logging of getFIleInfo()

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6888: -- Attachment: HDFS-6888-3.patch retrigger QA Remove audit logging of getFIleInfo()

[jira] [Resolved] (HDFS-3563) Fix findbug warnings in raid

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-3563. Resolution: Not a Problem RAID was removed. Closing as not a problem. Fix findbug warnings

[jira] [Updated] (HDFS-6663) Admin command to track file and locations from block id

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6663: -- Attachment: HDFS-6663-3.patch retrigger QA Admin command to track file and locations from block id

[jira] [Created] (HDFS-7040) HDFS dangerously uses @Beta methods from very old versions of Guava

2014-09-10 Thread Christopher Tubbs (JIRA)
Christopher Tubbs created HDFS-7040: --- Summary: HDFS dangerously uses @Beta methods from very old versions of Guava Key: HDFS-7040 URL: https://issues.apache.org/jira/browse/HDFS-7040 Project:

[jira] [Created] (HDFS-7041) add a library that can forward libhdfs calls to any other library implementation

2014-09-10 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7041: -- Summary: add a library that can forward libhdfs calls to any other library implementation Key: HDFS-7041 URL: https://issues.apache.org/jira/browse/HDFS-7041

[jira] [Updated] (HDFS-5570) Deprecate hftp / hsftp and replace them with webhdfs / swebhdfs

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5570: --- Release Note: Support for hftp and hsftp has been removed. They have superseded by webhdfs

[jira] [Updated] (HDFS-6246) Remove 'dfs.support.append' flag from trunk code

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6246: --- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) Remove 'dfs.support.append' flag

[jira] [Updated] (HDFS-6246) Remove 'dfs.support.append' flag from trunk code

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6246: --- Release Note: Appends in HDFS can no longer be disabled. Remove 'dfs.support.append' flag

[jira] [Commented] (HDFS-6880) Adding tracing to DataNode data transfer protocol

2014-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129265#comment-14129265 ] Colin Patrick McCabe commented on HDFS-6880: bq. Tracing is supposed to be

[jira] [Commented] (HDFS-7034) Archival Storage: Fix TestBlockPlacement and TestStorageMover

2014-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129267#comment-14129267 ] Jing Zhao commented on HDFS-7034: - Looks like there are several issues causing the current

[jira] [Updated] (HDFS-7034) Archival Storage: Fix TestBlockPlacement and TestStorageMover

2014-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7034: Attachment: HDFS-7034.001.patch Upload the patch. Archival Storage: Fix TestBlockPlacement and

[jira] [Created] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-10 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7042: --- Summary: Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Key: HDFS-7042 URL: https://issues.apache.org/jira/browse/HDFS-7042

[jira] [Updated] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7042: Status: Patch Available (was: Open) Upgrade fails for Windows HA cluster due to file locks held

[jira] [Updated] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7042: Attachment: HDFS-7042.1.patch The attached patch closes the last committed transaction ID file

[jira] [Created] (HDFS-7043) Can namenode recover from a edit log file?

2014-09-10 Thread Eason (JIRA)
Eason created HDFS-7043: --- Summary: Can namenode recover from a edit log file? Key: HDFS-7043 URL: https://issues.apache.org/jira/browse/HDFS-7043 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7043) Can namenode recover from a edit log file?

2014-09-10 Thread Eason (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eason updated HDFS-7043: Description: I have delete all the data dir on the namenode,causing lost of all the data. I can only recover a

[jira] [Updated] (HDFS-7043) Can namenode recover from a edit log file?

2014-09-10 Thread Eason (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eason updated HDFS-7043: Environment: linux (was: I have delete all the data dir on the namenode,causing lost of all the data. I can only

[jira] [Updated] (HDFS-7041) add a library that can forward libhdfs calls to any other library implementation

2014-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7041: --- Attachment: HDFS-7041.001.patch add a library that can forward libhdfs calls to any

[jira] [Updated] (HDFS-7041) add a library that can forward libhdfs calls to any other library implementation

2014-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7041: --- Status: Patch Available (was: Open) add a library that can forward libhdfs calls to

[jira] [Commented] (HDFS-7038) Provide a 64bit Native library

2014-09-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129341#comment-14129341 ] Chris Nauroth commented on HDFS-7038: - To generalize on this, I'd say it's a weakness

[jira] [Updated] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7042: -- Hadoop Flags: Reviewed +1 patch looks good. Upgrade fails for Windows HA cluster due

[jira] [Updated] (HDFS-5623) NameNode: add tests for skipping ACL enforcement when permission checks are disabled, user is superuser or user is member of supergroup.

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5623: --- Fix Version/s: (was: 2.3.0) 2.4.0 NameNode: add tests for skipping ACL

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129351#comment-14129351 ] Tsz Wo Nicholas Sze commented on HDFS-3107: --- Can we add snapshot support in

[jira] [Updated] (HDFS-5623) NameNode: add tests for skipping ACL enforcement when permission checks are disabled, user is superuser or user is member of supergroup.

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5623: --- Fix Version/s: (was: 3.0.0) 2.3.0 NameNode: add tests for skipping ACL

[jira] [Commented] (HDFS-7041) add a library that can forward libhdfs calls to any other library implementation

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129361#comment-14129361 ] Hadoop QA commented on HDFS-7041: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7041) add a library that can forward libhdfs calls to any other library implementation

2014-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7041: --- Attachment: HDFS-7041.002.patch fix build add a library that can forward libhdfs

[jira] [Commented] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-10 Thread Colin Patrick McCabe (JIRA)
-design-20140822.pdf, HDFS-6867-design-20140827.pdf, HDFS-6867-design-20140910.pdf For DFSOutputStream, we should be able to do pipeline recovery in the background, while the user is continuing to write to the file. This is especially useful for long-lived clients that write to an HDFS file

[jira] [Commented] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129416#comment-14129416 ] Hadoop QA commented on HDFS-7042: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6888) Remove audit logging of getFIleInfo()

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129417#comment-14129417 ] Hadoop QA commented on HDFS-6888: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5041) Add the time of last heartbeat to dead server Web UI

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-5041: --- Assignee: Ted Yu Add the time of last heartbeat to dead server Web UI

[jira] [Commented] (HDFS-6888) Remove audit logging of getFIleInfo()

2014-09-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129431#comment-14129431 ] Chen He commented on HDFS-6888: --- unit test failure is because of HDFS-6694 Remove audit

[jira] [Updated] (HDFS-3462) TestDFSClientRetries.busyTest() should restore default xceiver count in the config.

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3462: --- Assignee: madhukara phatak TestDFSClientRetries.busyTest() should restore default xceiver

[jira] [Commented] (HDFS-6663) Admin command to track file and locations from block id

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129432#comment-14129432 ] Hadoop QA commented on HDFS-6663: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7041) add a library that can forward libhdfs calls to any other library implementation

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129433#comment-14129433 ] Hadoop QA commented on HDFS-7041: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7040) HDFS dangerously uses @Beta methods from very old versions of Guava

2014-09-10 Thread Christopher Tubbs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Tubbs updated HDFS-7040: Status: Patch Available (was: Open) HDFS dangerously uses @Beta methods from very old

[jira] [Updated] (HDFS-7040) HDFS dangerously uses @Beta methods from very old versions of Guava

2014-09-10 Thread Christopher Tubbs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Tubbs updated HDFS-7040: Attachment: 0001-HDFS-7040-Avoid-beta-LimitInputStream-in-Guava.patch Patch attached to

[jira] [Commented] (HDFS-7040) HDFS dangerously uses @Beta methods from very old versions of Guava

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129440#comment-14129440 ] Hadoop QA commented on HDFS-7040: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129441#comment-14129441 ] Colin Patrick McCabe commented on HDFS-6727: Can we use a word other than

[jira] [Resolved] (HDFS-7043) Can namenode recover from a edit log file?

2014-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7043. - Resolution: Invalid If you have lost the Filesystem Image then the filesystem is unrecoverable,

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129498#comment-14129498 ] Colin Patrick McCabe commented on HDFS-6808: Looks good-- thanks, Eddy. {code}

[jira] [Commented] (HDFS-7042) Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.

2014-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129500#comment-14129500 ] Arpit Agarwal commented on HDFS-7042: - +1 Upgrade fails for Windows HA cluster due to

[jira] [Commented] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2014-09-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129535#comment-14129535 ] Yongjun Zhang commented on HDFS-7036: - Hi [~wheat9] and [~jingzhao], Thanks for the

[jira] [Commented] (HDFS-7040) HDFS dangerously uses @Beta methods from very old versions of Guava

2014-09-10 Thread Christopher Tubbs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129575#comment-14129575 ] Christopher Tubbs commented on HDFS-7040: - This patch needs manual QA testing, as