[jira] [Commented] (HDFS-6580) FSNamesystem.mkdirsInt uses raw dir.getFileInfo() to getAuditFileInfo()

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040479#comment-14040479 ] Haohui Mai commented on HDFS-6580: -- Looks good to me. +1 FSNamesystem.mkdirsInt uses raw

[jira] [Updated] (HDFS-6580) FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6580: - Summary: FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper (was: FSNamesystem.mkdirsInt

[jira] [Updated] (HDFS-6580) FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6580: - Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-6580) FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040483#comment-14040483 ] Hudson commented on HDFS-6580: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5753 (See

[jira] [Commented] (HDFS-6586) TestBalancer#testExitZeroOnSuccess sometimes fails in trunk

2014-06-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040606#comment-14040606 ] Binglin Chang commented on HDFS-6586: - TestBalancerWithNodeGroup also failed before

[jira] [Commented] (HDFS-6586) TestBalancer#testExitZeroOnSuccess sometimes fails in trunk

2014-06-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040607#comment-14040607 ] Binglin Chang commented on HDFS-6586: - bq. and potentially also have bug HDFS-6250

[jira] [Updated] (HDFS-6506) Newly moved block replica been invalidated and deleted

2014-06-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-6506: Attachment: HDFS-6506.v2.patch Update patch to add fix of bug in HDFS-6586, TestBalancer is

[jira] [Resolved] (HDFS-6586) TestBalancer#testExitZeroOnSuccess sometimes fails in trunk

2014-06-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang resolved HDFS-6586. - Resolution: Duplicate TestBalancer#testExitZeroOnSuccess sometimes fails in trunk

[jira] [Commented] (HDFS-6586) TestBalancer#testExitZeroOnSuccess sometimes fails in trunk

2014-06-23 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040625#comment-14040625 ] Binglin Chang commented on HDFS-6586: - I updated the patch in HDSF-6506 to fix the bug,

[jira] [Updated] (HDFS-6382) HDFS File/Directory TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6382: - Attachment: HDFS-TTL-Design-3.pdf Update the document according to the implementation. HDFS

[jira] [Updated] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6525: - Attachment: HDFS-6525.1.patch Initial implementation. FsShell supports HDFS TTL

[jira] [Updated] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6525: - Target Version/s: 2.5.0 Status: Patch Available (was: Open) FsShell supports HDFS TTL

[jira] [Updated] (HDFS-6526) Implement HDFS TtlManager

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6526: - Attachment: HDFS-6526.1.patch Initial implementation, the unit test depends on HDFS-6525, so we should

[jira] [Updated] (HDFS-6526) Implement HDFS TtlManager

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6526: - Target Version/s: 2.5.0 Status: Patch Available (was: Open) Implement HDFS TtlManager

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040644#comment-14040644 ] Hudson commented on HDFS-6507: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #592 (See

[jira] [Commented] (HDFS-6580) FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040643#comment-14040643 ] Hudson commented on HDFS-6580: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #592 (See

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040683#comment-14040683 ] Zesheng Wu commented on HDFS-6382: -- Hi guys, I've uploaded an initial implementation on

[jira] [Created] (HDFS-6592) Use Fluent to collect data to append to HDFS. Throw the AlreadyBeingCreatedException exception

2014-06-23 Thread jack (JIRA)
jack created HDFS-6592: -- Summary: Use Fluent to collect data to append to HDFS. Throw the AlreadyBeingCreatedException exception Key: HDFS-6592 URL: https://issues.apache.org/jira/browse/HDFS-6592 Project:

[jira] [Commented] (HDFS-6580) FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040751#comment-14040751 ] Hudson commented on HDFS-6580: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1783 (See

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040752#comment-14040752 ] Hudson commented on HDFS-6507: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1783 (See

[jira] [Commented] (HDFS-6506) Newly moved block replica been invalidated and deleted

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040758#comment-14040758 ] Hadoop QA commented on HDFS-6506: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-23 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040790#comment-14040790 ] Daryn Sharp commented on HDFS-6475: --- bq. Your earlier suggestion indicated that we should

[jira] [Commented] (HDFS-6526) Implement HDFS TtlManager

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040792#comment-14040792 ] Hadoop QA commented on HDFS-6526: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6582) Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

2014-06-23 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6582: - Component/s: nfs Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

[jira] [Commented] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040810#comment-14040810 ] Hadoop QA commented on HDFS-6525: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

2014-06-23 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040823#comment-14040823 ] Daryn Sharp commented on HDFS-6585: --- I've been working on the exact same change! Just to

[jira] [Commented] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040828#comment-14040828 ] Daryn Sharp commented on HDFS-6525: --- The test cases should verify that the inherited path

[jira] [Commented] (HDFS-6580) FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040835#comment-14040835 ] Hudson commented on HDFS-6580: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1810 (See

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040836#comment-14040836 ] Hudson commented on HDFS-6507: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1810 (See

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-23 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040873#comment-14040873 ] Sanjay Radia commented on HDFS-6134: Aaron said: bq. distcp... I disagree - this is

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040966#comment-14040966 ] Steve Loughran commented on HDFS-6134: -- Maybe the issue with distcp is sometimes you

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040984#comment-14040984 ] Yongjun Zhang commented on HDFS-6475: - HI [~daryn], Thanks a lot for the comments.

[jira] [Commented] (HDFS-4629) Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA

2014-06-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040995#comment-14040995 ] Steve Loughran commented on HDFS-4629: -- # the declaration of the xerces lib version

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041008#comment-14041008 ] Aaron T. Myers commented on HDFS-6134: -- Sanjay, Steve - regarding distcp, Alejandro

[jira] [Commented] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041020#comment-14041020 ] Lei (Eddy) Xu commented on HDFS-5546: - Maybe I misunderstand this JIRA. If printing FNF

[jira] [Updated] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-23 Thread Jinghui Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinghui Wang updated HDFS-6579: --- Attachment: HDFS-6579.patch TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

[jira] [Updated] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-23 Thread Jinghui Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinghui Wang updated HDFS-6579: --- Attachment: (was: HDFS-6579.patch) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on

[jira] [Commented] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-23 Thread Jinghui Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041047#comment-14041047 ] Jinghui Wang commented on HDFS-6579: Thanks for the prompt review. Yes, this is for

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041062#comment-14041062 ] Jing Zhao commented on HDFS-6588: - HDFS-5322 should not be related to the failed test. In

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041065#comment-14041065 ] Jing Zhao commented on HDFS-6562: - The new patch looks pretty good to me. +1 [~szetszwo],

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Summary: Bug in TestBPOfferService can cause test failure (was: Bug in TestBPOfferService blocks

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Component/s: test Bug in TestBPOfferService can cause test failure

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Affects Version/s: 2.4.0 Bug in TestBPOfferService can cause test failure

[jira] [Updated] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6587: Labels: (was: patch) Bug in TestBPOfferService can cause test failure

[jira] [Updated] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6579: Assignee: Jinghui Wang Hadoop Flags: Reviewed Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-6587) Bug in TestBPOfferService can cause test failure

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041092#comment-14041092 ] Hudson commented on HDFS-6587: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5754 (See

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-06-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041112#comment-14041112 ] Yongjun Zhang commented on HDFS-6588: - Hi [~jingzhao], thanks a lot for the comments.

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041119#comment-14041119 ] Jing Zhao commented on HDFS-6588: - Yeah, also the failed tests were not introduced by

[jira] [Commented] (HDFS-6579) TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041155#comment-14041155 ] Hadoop QA commented on HDFS-6579: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041159#comment-14041159 ] Colin Patrick McCabe commented on HDFS-5546: I think what Daryn is advocating

[jira] [Commented] (HDFS-6475) WebHdfs clients fail without retry because incorrect handling of StandbyException

2014-06-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041171#comment-14041171 ] Yongjun Zhang commented on HDFS-6475: - HI [~daryn], Would like to check with you, you

[jira] [Created] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6593: --- Summary: Move SnapshotDiffInfo out of INodeDirectorySnapshottable Key: HDFS-6593 URL: https://issues.apache.org/jira/browse/HDFS-6593 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Status: Patch Available (was: Open) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Attachment: HDFS-6593.000.patch Move SnapshotDiffInfo out of INodeDirectorySnapshottable

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-06-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041337#comment-14041337 ] Yongjun Zhang commented on HDFS-6588: - Thanks Jing. I found that the getTrueCause()

[jira] [Commented] (HDFS-6578) add toString method to DatanodeStorage etc for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041338#comment-14041338 ] Arpit Agarwal commented on HDFS-6578: - Your original understanding was correct. i.e.

[jira] [Commented] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041339#comment-14041339 ] Haohui Mai commented on HDFS-6593: -- The patch looks good to me. Is it possible to

[jira] [Updated] (HDFS-6578) add toString method to DatanodeStorage etc for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6578: Issue Type: Improvement (was: Bug) add toString method to DatanodeStorage etc for easier

[jira] [Updated] (HDFS-6578) add toString method to DatanodeStorage for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6578: Summary: add toString method to DatanodeStorage for easier debugging (was: add toString method to

[jira] [Updated] (HDFS-6578) add toString method to DatanodeStorage for easier debugging

2014-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6578: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Updated] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-5546: Attachment: HDFS-5546.2.004.patch This patch captures {{IOException}} instead of {{FNF}} based on

[jira] [Commented] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041352#comment-14041352 ] Lei (Eddy) Xu commented on HDFS-5546: - [~daryn] was right on this one, we should just

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Attachment: HDFS-6593.001.patch Thanks for the review, Haohui! Update the patch to address your comments.

[jira] [Commented] (HDFS-6578) add toString method to DatanodeStorage for easier debugging

2014-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041354#comment-14041354 ] Hudson commented on HDFS-6578: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5755 (See

[jira] [Created] (HDFS-6594) Use inodes to determine membership in an encryption zone

2014-06-23 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6594: -- Summary: Use inodes to determine membership in an encryption zone Key: HDFS-6594 URL: https://issues.apache.org/jira/browse/HDFS-6594 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6565) Use jackson instead jetty json in hdfs-client

2014-06-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6565: Attachment: HDFS-6565.patch Use jackson instead jetty json in hdfs-client

[jira] [Commented] (HDFS-6578) add toString method to DatanodeStorage for easier debugging

2014-06-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041395#comment-14041395 ] Yongjun Zhang commented on HDFS-6578: - Thanks a lot [~arpitagarwal]! add toString

[jira] [Commented] (HDFS-6565) Use jackson instead jetty json in hdfs-client

2014-06-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041409#comment-14041409 ] Akira AJISAKA commented on HDFS-6565: - Attaching a patch to remove jetty json library

[jira] [Updated] (HDFS-6565) Use jackson instead jetty json in hdfs-client

2014-06-23 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6565: Status: Patch Available (was: Open) Use jackson instead jetty json in hdfs-client

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041422#comment-14041422 ] Tsz Wo Nicholas Sze commented on HDFS-6562: --- Patch looks good. Some comments: -

[jira] [Commented] (HDFS-5546) race condition crashes hadoop ls -R when directories are moved/removed

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041420#comment-14041420 ] Hadoop QA commented on HDFS-5546: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-23 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041429#comment-14041429 ] Sanjay Radia commented on HDFS-6134: I believe the transparent encryption will break

[jira] [Updated] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6562: - Attachment: HDFS-6562.005.patch Refactor rename() in FSDirectory

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041440#comment-14041440 ] Haohui Mai commented on HDFS-6562: -- Uploaded v6 patch to address [~szetszwo]'s comments.

[jira] [Updated] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6562: - Attachment: HDFS-6562.006.patch Refactor rename() in FSDirectory

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-23 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041449#comment-14041449 ] Sanjay Radia commented on HDFS-6134: bq. Vanilla distcp will just work with transparent

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-23 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041456#comment-14041456 ] Siqi Li commented on HDFS-6527: --- When running unit tests in this patch v5, I get the

[jira] [Updated] (HDFS-6584) Support archival storage

2014-06-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6584: -- Attachment: HDFSArchivalStorageDesign20140623.pdf

[jira] [Commented] (HDFS-6560) Byte array native checksumming on DN side

2014-06-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041477#comment-14041477 ] Colin Patrick McCabe commented on HDFS-6560: {code} + public static void

[jira] [Commented] (HDFS-5369) Support negative caching of user-group mapping

2014-06-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041484#comment-14041484 ] Lei (Eddy) Xu commented on HDFS-5369: - [~andrew.wang] What should be an expected

[jira] [Commented] (HDFS-6570) add api that enables checking if a user has certain permissions on a file

2014-06-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041492#comment-14041492 ] Colin Patrick McCabe commented on HDFS-6570: bq. Note that the man page for

[jira] [Commented] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041495#comment-14041495 ] Hadoop QA commented on HDFS-6593: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5369) Support negative caching of user-group mapping

2014-06-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041497#comment-14041497 ] Andrew Wang commented on HDFS-5369: --- Hey [~eddyxu], 30s sounds okay to me, maybe even a

[jira] [Commented] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041501#comment-14041501 ] Haohui Mai commented on HDFS-6593: -- +1 on the latest patch, pending jenkins. Move

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041507#comment-14041507 ] Tsz Wo Nicholas Sze commented on HDFS-6562: --- Thanks for the explanation.

[jira] [Updated] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6562: - Attachment: HDFS-6562.007.patch Refactor rename() in FSDirectory

[jira] [Updated] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6562: -- Priority: Minor (was: Major) Hadoop Flags: Reviewed +1 the new patch looks

[jira] [Commented] (HDFS-6561) Byte array native checksumming on client side

2014-06-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041522#comment-14041522 ] Andrew Wang commented on HDFS-6561: --- +1 sounds good to me, pretty sure that flushes are

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-23 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041524#comment-14041524 ] Alejandro Abdelnur commented on HDFS-6134: -- [~sanjay.radia], Can you be a bit

[jira] [Commented] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041529#comment-14041529 ] Hadoop QA commented on HDFS-6593: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-06-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041545#comment-14041545 ] Tsz Wo Nicholas Sze commented on HDFS-3528: --- Is the native library faster than

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Attachment: HDFS-6593.002.patch Fix the failed unit test and javadoc. Move SnapshotDiffInfo out of

[jira] [Updated] (HDFS-6592) Use Fluent to collect data to append to HDFS. Throw the AlreadyBeingCreatedException exception

2014-06-23 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated HDFS-6592: --- Description: We use Fluent to collect log data. The log data append to the files in HDFS. The cluster

[jira] [Commented] (HDFS-6430) HTTPFS - Implement XAttr support

2014-06-23 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041561#comment-14041561 ] Alejandro Abdelnur commented on HDFS-6430: -- [~hitliuyi], my question was if we are

[jira] [Created] (HDFS-6595) Configure the maximum threads allowed for balancing on datanodes

2014-06-23 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-6595: -- Summary: Configure the maximum threads allowed for balancing on datanodes Key: HDFS-6595 URL: https://issues.apache.org/jira/browse/HDFS-6595 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6595) Configure the maximum threads allowed for balancing on datanodes

2014-06-23 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6595: --- Attachment: HDFS-6595.patch Attaching the patch which adds new configuration -

[jira] [Updated] (HDFS-6595) Configure the maximum threads allowed for balancing on datanodes

2014-06-23 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6595: --- Status: Patch Available (was: Open) Configure the maximum threads allowed for balancing on

[jira] [Commented] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041572#comment-14041572 ] Zesheng Wu commented on HDFS-6525: -- Thanks [~daryn], I will update the patch to address

[jira] [Commented] (HDFS-6565) Use jackson instead jetty json in hdfs-client

2014-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041608#comment-14041608 ] Hadoop QA commented on HDFS-6565: - {color:green}+1 overall{color}. Here are the results of

  1   2   >