[jira] [Commented] (HDFS-8625) count with -h option displays namespace quota in human readable format

2015-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596074#comment-14596074 ] Allen Wittenauer commented on HDFS-8625: Right, counts should be in billions, byte

[jira] [Commented] (HDFS-8637) OzoneHandler : Add Error Table

2015-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596261#comment-14596261 ] Arpit Agarwal commented on HDFS-8637: - +1 for the patch. Jenkins failures are unrelated

[jira] [Comment Edited] (HDFS-8625) count with -h option displays namespace quota in human readable format

2015-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596074#comment-14596074 ] Allen Wittenauer edited comment on HDFS-8625 at 6/22/15 3:23 PM:

[jira] [Commented] (HDFS-8515) Abstract a DTP/2 HTTP/2 server

2015-06-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596293#comment-14596293 ] Haohui Mai commented on HDFS-8515: -- The patch looks good. I'm wondering whether it is

[jira] [Commented] (HDFS-8462) Implement GETXATTRS and LISTXATTRS operation for WebImageViewer

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596246#comment-14596246 ] Hadoop QA commented on HDFS-8462: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8637) OzoneHandler : Add Error Table

2015-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8637: Resolution: Fixed Fix Version/s: HDFS-7240 Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596397#comment-14596397 ] Rakesh R commented on HDFS-8493: Following are the functions where it has done the

[jira] [Created] (HDFS-8644) OzoneHandler : Add volume handler

2015-06-22 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8644: -- Summary: OzoneHandler : Add volume handler Key: HDFS-8644 URL: https://issues.apache.org/jira/browse/HDFS-8644 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-7214: -- Attachment: HDFS-7214.v3.patch Display the time when NN became active on the webUI

[jira] [Commented] (HDFS-8617) Throttle DiskChecker#checkDirs() speed.

2015-06-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596712#comment-14596712 ] Haohui Mai commented on HDFS-8617: -- bq. You can read my related SoCC paper here:

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

2015-06-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8480: --- Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596652#comment-14596652 ] Hadoop QA commented on HDFS-7214: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8608) Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

2015-06-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596649#comment-14596649 ] Andrew Wang commented on HDFS-8608: --- +1 LGTM. I'm going to commit this to branch-2.

[jira] [Updated] (HDFS-4366) Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks

2015-06-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4366: -- Fix Version/s: (was: 3.0.0) 2.8.0 [~zhz] did up a branch-2 patch which I

[jira] [Commented] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596698#comment-14596698 ] Hadoop QA commented on HDFS-8542: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-22 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8542: -- Status: Patch Available (was: Open) WebHDFS getHomeDirectory behavior does not match specification

[jira] [Commented] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596608#comment-14596608 ] Siqi Li commented on HDFS-7214: --- It looks like HDFS-7257 has already checked in a similar

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

2015-06-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8480: --- Summary: Fix performance and timeout issues in HDFS-7929 by using hard-links to

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7390: --- Attachment: HDFS-7390-005.patch Provide JMX metrics per storage type

[jira] [Updated] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-22 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8542: -- Status: Open (was: Patch Available) WebHDFS getHomeDirectory behavior does not match specification

[jira] [Commented] (HDFS-8617) Throttle DiskChecker#checkDirs() speed.

2015-06-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596627#comment-14596627 ] Andrew Wang commented on HDFS-8617: --- You can read my related SoCC paper here:

[jira] [Updated] (HDFS-8608) Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

2015-06-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8608: -- Resolution: Fixed Fix Version/s: (was: 3.0.0) 2.8.0 Status:

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

2015-06-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596671#comment-14596671 ] Colin Patrick McCabe commented on HDFS-8480: Thanks, [~zhz]. +1. Fix

[jira] [Updated] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-22 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8542: -- Attachment: HDFS-8542-branch-2.7.002.patch I'm still not wild about caching the result since again, (a)

[jira] [Updated] (HDFS-7390) Provide JMX metrics per storage type

2015-06-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7390: --- Attachment: (was: HDFS-7390-005.patch) Provide JMX metrics per storage type

[jira] [Resolved] (HDFS-3620) WebHdfsFileSystem getHomeDirectory() should not resolve locally

2015-06-22 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-3620. --- Resolution: Duplicate This issue was duplicated and dealt with in HDFS-8542. WebHdfsFileSystem

[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

2015-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596702#comment-14596702 ] Hudson commented on HDFS-7929: -- FAILURE: Integrated in Hadoop-trunk-Commit #8046 (See

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

2015-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596703#comment-14596703 ] Hudson commented on HDFS-8480: -- FAILURE: Integrated in Hadoop-trunk-Commit #8046 (See

[jira] [Commented] (HDFS-8617) Throttle DiskChecker#checkDirs() speed.

2015-06-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596748#comment-14596748 ] Andrew Wang commented on HDFS-8617: --- bq. As you mentioned in the evaluation, there are

[jira] [Updated] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2015-06-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7645: -- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) This change is incompatible since we expose

[jira] [Updated] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-22 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8542: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596869#comment-14596869 ] Hudson commented on HDFS-8542: -- FAILURE: Integrated in Hadoop-trunk-Commit #8049 (See

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-22 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raju Bairishetti updated HDFS-8578: --- Fix Version/s: 2.7.1 On upgrade, Datanode should process all storage/data dirs in parallel

[jira] [Created] (HDFS-8645) Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2

2015-06-22 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8645: --- Summary: Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2 Key: HDFS-8645 URL: https://issues.apache.org/jira/browse/HDFS-8645 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596846#comment-14596846 ] Zhe Zhang commented on HDFS-8619: - A quick comment is maybe we should consider targeting

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596905#comment-14596905 ] Jing Zhao commented on HDFS-8619: - Thanks for the review, Zhe! Sure, I will separate some

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596967#comment-14596967 ] Jing Zhao commented on HDFS-8619: - Besides, we now have merged quite a few changes to

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596932#comment-14596932 ] Zhe Zhang commented on HDFS-8619: - Thanks Jing! I meant to say all changes, including the

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596933#comment-14596933 ] Zhe Zhang commented on HDFS-8619: - Thanks Jing! I meant to say all changes, including the

[jira] [Commented] (HDFS-8186) Erasure coding: Make block placement policy for EC file configurable

2015-06-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596973#comment-14596973 ] Walter Su commented on HDFS-8186: - comparison of HDFS-7068 and HDFS-8186 is

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596822#comment-14596822 ] Zhe Zhang commented on HDFS-7068: - [~walter.k.su] Since we are preparing to merge the

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596853#comment-14596853 ] Arpit Agarwal commented on HDFS-8277: - Hi [~surendrasingh], while putting the safe mode

[jira] [Commented] (HDFS-8634) OzoneHandler: Add userAuth Interface and Simple userAuth handler

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596856#comment-14596856 ] Hadoop QA commented on HDFS-8634: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Comment Edited] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-06-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596853#comment-14596853 ] Arpit Agarwal edited comment on HDFS-8277 at 6/22/15 11:39 PM:

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8578: --- Fix Version/s: (was: 2.7.1) On upgrade, Datanode should process all storage/data dirs in

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-06-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596964#comment-14596964 ] Walter Su commented on HDFS-7068: - comparison of HDFS-7068 and

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596786#comment-14596786 ] Zhe Zhang commented on HDFS-8480: - Thanks Colin for the review! And helpful comments from

[jira] [Updated] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8619: Attachment: HDFS-8619.000.patch Initial patch to fix the above issue. Erasure Coding: revisit replica

[jira] [Commented] (HDFS-7390) Provide JMX metrics per storage type

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596961#comment-14596961 ] Hadoop QA commented on HDFS-7390: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596797#comment-14596797 ] Hadoop QA commented on HDFS-7214: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596799#comment-14596799 ] Zhe Zhang commented on HDFS-8619: - Thanks Jing for the work! I think the analysis makes

[jira] [Commented] (HDFS-8608) Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596810#comment-14596810 ] Zhe Zhang commented on HDFS-8608: - Thanks Jing and Andrew for reviewing the patch! I filed

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-22 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596862#comment-14596862 ] Raju Bairishetti commented on HDFS-8578: [~vinayrpet] Have you done any performance

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596959#comment-14596959 ] Jing Zhao commented on HDFS-8619: - No. I guess we still need this jira for adding the

[jira] [Created] (HDFS-8642) Improve TestFileTruncate#setup by deleting the snapshots

2015-06-22 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8642: -- Summary: Improve TestFileTruncate#setup by deleting the snapshots Key: HDFS-8642 URL: https://issues.apache.org/jira/browse/HDFS-8642 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-06-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595735#comment-14595735 ] Vinayakumar B commented on HDFS-8493: - bq. The resolution should be in the lock of

[jira] [Commented] (HDFS-8642) Improve TestFileTruncate#setup by deleting the snapshots

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595795#comment-14595795 ] Hadoop QA commented on HDFS-8642: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8642) Improve TestFileTruncate#setup by deleting the snapshots

2015-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8642: --- Attachment: HDFS-8642-00.patch Improve TestFileTruncate#setup by deleting the snapshots

[jira] [Created] (HDFS-8643) Add snapshot names list to SnapshottableDirectoryStatus

2015-06-22 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8643: -- Summary: Add snapshot names list to SnapshottableDirectoryStatus Key: HDFS-8643 URL: https://issues.apache.org/jira/browse/HDFS-8643 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8642) Improve TestFileTruncate#setup by deleting the snapshots

2015-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8642: --- Target Version/s: 2.8.0 Status: Patch Available (was: Open) Improve TestFileTruncate#setup by

[jira] [Commented] (HDFS-8462) Implement GETXATTRS and LISTXATTRS operation for WebImageViewer

2015-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595516#comment-14595516 ] Akira AJISAKA commented on HDFS-8462: - Thanks [~jagadesh.kiran] for updating the patch.

[jira] [Resolved] (HDFS-8609) Dead Code in DFS Util for DFSUtil#substituteForWildcardAddress

2015-06-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt resolved HDFS-8609. Resolution: Invalid Sorry my mistake . Closing the issue as invalid Dead Code in DFS Util

[jira] [Commented] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-06-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596306#comment-14596306 ] Haohui Mai commented on HDFS-8493: -- bq. IMO, I think this is okay, especially for write

[jira] [Commented] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596331#comment-14596331 ] Hadoop QA commented on HDFS-8542: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8643) Add snapshot names list to SnapshottableDirectoryStatus

2015-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596432#comment-14596432 ] Rakesh R commented on HDFS-8643: Following warnings are not related to this patch: -

[jira] [Commented] (HDFS-8617) Throttle DiskChecker#checkDirs() speed.

2015-06-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596430#comment-14596430 ] Haohui Mai commented on HDFS-8617: -- bq. Andrew and I actually benchmarked setting ioprio

[jira] [Updated] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-7214: -- Attachment: HDFS-7214.v4.patch Display the time when NN became active on the webUI

[jira] [Commented] (HDFS-4366) Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks

2015-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596659#comment-14596659 ] Hudson commented on HDFS-4366: -- FAILURE: Integrated in Hadoop-trunk-Commit #8045 (See

[jira] [Commented] (HDFS-8617) Throttle DiskChecker#checkDirs() speed.

2015-06-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596369#comment-14596369 ] Colin Patrick McCabe commented on HDFS-8617: Andrew and I actually benchmarked

[jira] [Commented] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596419#comment-14596419 ] Haohui Mai commented on HDFS-7214: -- bq. 1. for suggestion of changing long to AtomicLong,

[jira] [Commented] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596326#comment-14596326 ] Haohui Mai commented on HDFS-7214: -- Thanks for working on this. {code} - + /** the

[jira] [Commented] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596372#comment-14596372 ] Siqi Li commented on HDFS-7214: --- [~wheat9], Thanks for your feedback. 1. for suggestion of

[jira] [Assigned] (HDFS-8644) OzoneHandler : Add volume handler

2015-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-8644: -- Assignee: Anu Engineer OzoneHandler : Add volume handler -

[jira] [Updated] (HDFS-8634) OzoneHandler: Add userAuth Interface and Simple userAuth handler

2015-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8634: --- Attachment: hdfs-8634-HDFS-7240.001.patch UserAuth Interface and simple Auth handler OzoneHandler:

[jira] [Updated] (HDFS-8634) OzoneHandler: Add userAuth Interface and Simple userAuth handler

2015-06-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8634: --- Status: Patch Available (was: Open) OzoneHandler: Add userAuth Interface and Simple userAuth handler

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597131#comment-14597131 ] Tsz Wo Nicholas Sze commented on HDFS-8619: --- Patch looks good in general. I

[jira] [Commented] (HDFS-1431) Balancer should work with the logic of BlockPlacementPolicy

2015-06-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597133#comment-14597133 ] Ming Ma commented on HDFS-1431: --- When I met with [~andrew.wang], [~ctrezzo], [~atm],

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597132#comment-14597132 ] Vinayakumar B commented on HDFS-8578: - bq. Vinayakumar B Have you done any performance

[jira] [Commented] (HDFS-7214) Display the time when NN became active on the webUI

2015-06-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596981#comment-14596981 ] Ming Ma commented on HDFS-7214: --- [~l201514] you are right that HDFS-7257 has added the

[jira] [Updated] (HDFS-8646) Prune cached replicas from DatanodeDescriptor state on replica invalidation

2015-06-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8646: -- Attachment: hdfs-8646.001.patch Patch attached. We now prune in BlockManager#removeStoredBlock, which

[jira] [Updated] (HDFS-6564) Use slf4j instead of common-logging in hdfs-client

2015-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6564: --- Release Note: Users may need special attention for this change while upgrading to this version. Previously

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2015-06-22 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597016#comment-14597016 ] Jesse Yates commented on HDFS-6440: --- Rebased on trunk, tests pass locally for me.

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2015-06-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597130#comment-14597130 ] Vinayakumar B commented on HDFS-8277: - bq. If we cannot make the change for 2.x I

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2015-06-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597138#comment-14597138 ] Vinayakumar B commented on HDFS-7645: - bq. This change is incompatible since we expose

[jira] [Commented] (HDFS-8619) Erasure Coding: revisit replica counting for striped blocks

2015-06-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597142#comment-14597142 ] Zhe Zhang commented on HDFS-8619: - bq. I guess we still need this jira for adding the

[jira] [Commented] (HDFS-8586) Dead Datanode is allocated for write when client is from deadnode

2015-06-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597156#comment-14597156 ] Vinayakumar B commented on HDFS-8586: - Thanks [~brahmareddy] for reporting this. This

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2015-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596984#comment-14596984 ] Hadoop QA commented on HDFS-6440: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8646) Prune cached replicas from DatanodeDescriptor state on replica invalidation

2015-06-22 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-8646: - Summary: Prune cached replicas from DatanodeDescriptor state on replica invalidation Key: HDFS-8646 URL: https://issues.apache.org/jira/browse/HDFS-8646 Project: Hadoop

[jira] [Commented] (HDFS-6564) Use slf4j instead of common-logging in hdfs-client

2015-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597023#comment-14597023 ] Rakesh R commented on HDFS-6564: Thanks for the reviews. I've updated {{Release note}}

[jira] [Updated] (HDFS-8447) Decouple information of files in GetLocatedBlocks

2015-06-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8447: - Attachment: HDFS-8447.004.patch Decouple information of files in GetLocatedBlocks

[jira] [Commented] (HDFS-8515) Abstract a DTP/2 HTTP/2 server

2015-06-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597011#comment-14597011 ] Duo Zhang commented on HDFS-8515: - I've introduced a Http2StreamChannel on the POC branch.

[jira] [Commented] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-06-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597140#comment-14597140 ] Vinayakumar B commented on HDFS-8493: - bq. Though most of the time the fsd lock is

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-06-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597150#comment-14597150 ] Vinayakumar B commented on HDFS-8578: - [~raju.bairishetti], would you mind testing with

[jira] [Updated] (HDFS-8515) Abstract a DTP/2 HTTP/2 server

2015-06-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HDFS-8515: Attachment: HDFS-8515-v4.patch A solution based on AbstractChannel. Abstract a DTP/2 HTTP/2 server

[jira] [Updated] (HDFS-8586) Dead Datanode is allocated for write when client is from deadnode

2015-06-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8586: --- Status: Patch Available (was: Open) Dead Datanode is allocated for write when client

[jira] [Updated] (HDFS-8586) Dead Datanode is allocated for write when client is from deadnode

2015-06-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8586: --- Attachment: HDFS-8586.patch Dead Datanode is allocated for write when client is from

[jira] [Created] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-06-22 Thread Ming Ma (JIRA)
Ming Ma created HDFS-8647: - Summary: Abstract BlockManager's rack policy into BlockPlacementPolicy Key: HDFS-8647 URL: https://issues.apache.org/jira/browse/HDFS-8647 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8493) Consolidate truncate() related implementation in a single class

2015-06-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597178#comment-14597178 ] Rakesh R commented on HDFS-8493: Yeah, I have raised HDFS-8648 sub-task to revisit these

[jira] [Created] (HDFS-8648) Revisit FsDirectory#resolvePath() function usage to check the call is made under proper lock

2015-06-22 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8648: -- Summary: Revisit FsDirectory#resolvePath() function usage to check the call is made under proper lock Key: HDFS-8648 URL: https://issues.apache.org/jira/browse/HDFS-8648

[jira] [Commented] (HDFS-8586) Dead Datanode is allocated for write when client is from deadnode

2015-06-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597196#comment-14597196 ] Brahma Reddy Battula commented on HDFS-8586: [~vinayrpet] thanks a lot for

  1   2   >