[jira] [Commented] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042531#comment-15042531 ] Hudson commented on HDFS-9214: -- FAILURE: Integrated in Hadoop-trunk-Commit #8926 (See

[jira] [Comment Edited] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042473#comment-15042473 ] Arpit Agarwal edited comment on HDFS-9414 at 12/5/15 12:24 AM: --- +1 for the

[jira] [Commented] (HDFS-9450) Fix failing HDFS tests on HDFS-7240 Ozone branch.

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042512#comment-15042512 ] Xiaobing Zhou commented on HDFS-9450: - I am taking this one to try to fix theses failures. > Fix

[jira] [Commented] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042537#comment-15042537 ] Hadoop QA commented on HDFS-9373: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042549#comment-15042549 ] Hadoop QA commented on HDFS-9448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9506) Move invalidate blocks to ReplicationManager

2015-12-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9506: Issue Type: Task (was: Sub-task) Parent: (was: HDFS-8966) > Move invalidate blocks to

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-12-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.007.patch The v7 patch is to move {{InvalidateBlocks}} to

[jira] [Comment Edited] (HDFS-8829) Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042579#comment-15042579 ] Arpit Agarwal edited comment on HDFS-8829 at 12/5/15 2:08 AM: -- Added a release

[jira] [Updated] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9491: Resolution: Fixed Fix Version/s: 2.9.0 3.0.0 Status: Resolved

[jira] [Updated] (HDFS-8829) Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8829: Release Note: HDFS-8829 introduces two new configuration settings:

[jira] [Commented] (HDFS-8829) Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042579#comment-15042579 ] Arpit Agarwal commented on HDFS-8829: - Added a release note. [~He Tianyi] can you please feel review

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042596#comment-15042596 ] Hudson commented on HDFS-9491: -- FAILURE: Integrated in Hadoop-trunk-Commit #8927 (See

[jira] [Commented] (HDFS-9281) Change TestDeleteBlockPool to not explicitly use File to check block pool existence.

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042628#comment-15042628 ] Hadoop QA commented on HDFS-9281: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042638#comment-15042638 ] Hadoop QA commented on HDFS-9414: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9414: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved

[jira] [Resolved] (HDFS-9506) Move invalidate blocks to ReplicationManager

2015-12-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9506. - Resolution: Duplicate As we keep updating the patch for [HDFS-9442], this issue is addressed

[jira] [Commented] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042642#comment-15042642 ] Arpit Agarwal commented on HDFS-9414: - This is a refactoring change so no new unit tests required. The

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042653#comment-15042653 ] Hadoop QA commented on HDFS-9442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042670#comment-15042670 ] Hudson commented on HDFS-9214: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #667 (See

[jira] [Commented] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042693#comment-15042693 ] Hudson commented on HDFS-9414: -- FAILURE: Integrated in Hadoop-trunk-Commit #8928 (See

[jira] [Created] (HDFS-9510) FsVolume should add the operation of creating file's time metrics

2015-12-04 Thread Lin Yiqun (JIRA)
Lin Yiqun created HDFS-9510: --- Summary: FsVolume should add the operation of creating file's time metrics Key: HDFS-9510 URL: https://issues.apache.org/jira/browse/HDFS-9510 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9510) FsVolume should add the operation of creating file's time metrics

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042732#comment-15042732 ] Hadoop QA commented on HDFS-9510: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042729#comment-15042729 ] Surendra Singh Lilhore commented on HDFS-9483: -- {{mvnsite}} failure is unrelated to this

[jira] [Updated] (HDFS-9510) FsVolume should add the operation of creating file's time metrics

2015-12-04 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9510: Status: Patch Available (was: Open) > FsVolume should add the operation of creating file's time metrics >

[jira] [Updated] (HDFS-9510) FsVolume should add the operation of creating file's time metrics

2015-12-04 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9510: Attachment: HDFS-9510.001.patch I add the initial patch. I create a new metric class {{FsVolumeMetrics}} and

[jira] [Updated] (HDFS-9430) Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started.

2015-12-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9430: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041892#comment-15041892 ] Xiaobing Zhou commented on HDFS-9214: - Reasonable. Let's do that for other similar patches. >

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-12.patch Patch with re-interrupt. Please review. > On upgrade, Datanode

[jira] [Updated] (HDFS-8030) HDFS Erasure Coding Phase II -- EC with contiguous layout

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8030: Component/s: erasure-coding > HDFS Erasure Coding Phase II -- EC with contiguous layout >

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041951#comment-15041951 ] Lei (Eddy) Xu commented on HDFS-9491: - Hi, [~twu] This patch can not compile on trunk {code} [ERROR]

[jira] [Updated] (HDFS-9330) Reconfigure DN deleting duplicate replica on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Status: Open (was: Patch Available) > Reconfigure DN deleting duplicate replica on the fly >

[jira] [Updated] (HDFS-9330) Reconfigure DN deleting duplicate replica on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Status: Patch Available (was: Open) > Reconfigure DN deleting duplicate replica on the fly >

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2015-12-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-12-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041970#comment-15041970 ] Vinayakumar B commented on HDFS-9314: - branch-2.6 compilation is broken. Please update the code to

[jira] [Commented] (HDFS-9430) Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started.

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041877#comment-15041877 ] Hudson commented on HDFS-9430: -- FAILURE: Integrated in Hadoop-trunk-Commit #8920 (See

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041880#comment-15041880 ] Arpit Agarwal commented on HDFS-9214: - +1 for v005 patch pending Jenkins. Thanks [~xiaobingo]. We can

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-12-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041902#comment-15041902 ] Chris Trezzo commented on HDFS-8791: Reviewing HDFS-8578. > block ID-based DN storage layout can be

[jira] [Updated] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9490: Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2015-12-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041935#comment-15041935 ] Xiaoyu Yao commented on HDFS-8831: -- The recent Jenkins shows failure in these related tests. The first one

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041945#comment-15041945 ] Lei (Eddy) Xu commented on HDFS-9491: - +1. LGTM. Will commit shortly. Thanks a lot, [~twu] > Tests

[jira] [Commented] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041952#comment-15041952 ] Hudson commented on HDFS-9490: -- FAILURE: Integrated in Hadoop-trunk-Commit #8921 (See

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

2015-12-04 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Attachment: HDFS-9469-HDFS-1312.003.patch This patch addresses all issues raised by [~szetszwo] in

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-12-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041889#comment-15041889 ] Xiao Chen commented on HDFS-9314: - Thank you Zhe, really appreciate it! > Improve

[jira] [Commented] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041900#comment-15041900 ] Lei (Eddy) Xu commented on HDFS-9490: - Thanks for the explanation, [~twu]. The v2 patch LGTM. +1,

[jira] [Commented] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

2015-12-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041906#comment-15041906 ] Tony Wu commented on HDFS-9490: --- Thanks a lot [~eddyxu], for reviewing and providing comments. >

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041929#comment-15041929 ] Vinayakumar B commented on HDFS-8578: - Thanks [~jrottinghuis] for review. bq. With 12 disks and 3

[jira] [Commented] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041927#comment-15041927 ] Xiaobing Zhou commented on HDFS-9262: - I tried that but DataNode#data that is typeof interface

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041946#comment-15041946 ] Chris Trezzo commented on HDFS-8578: [~jrottinghuis] bq. With 12 disks and 3 namespaces that would mean

[jira] [Issue Comment Deleted] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9491: Comment: was deleted (was: +1. LGTM. Will commit shortly. Thanks a lot, [~twu]) > Tests should get

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2015-12-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8747) > Trash Support for deletion

[jira] [Updated] (HDFS-8030) HDFS Erasure Coding Phase II -- EC with contiguous layout

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8030: Description: Data redundancy form -- replication or erasure coding, should be orthogonal to block layout --

[jira] [Commented] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041959#comment-15041959 ] Xiaobing Zhou commented on HDFS-9262: - This is also the case for HDFS-9330. > Reconfigure DN lazy

[jira] [Work started] (HDFS-8030) HDFS Erasure Coding Phase II -- EC with contiguous layout

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8030 started by Zhe Zhang. --- > HDFS Erasure Coding Phase II -- EC with contiguous layout >

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2015-12-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Description: Currently, "Soft Delete" is only supported if the whole encryption zone is deleted. If you

[jira] [Updated] (HDFS-8030) HDFS Erasure Coding Phase II -- EC with contiguous layout

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8030: Attachment: HDFSErasureCodingPhaseII-20151204.pdf Attaching initial draft of a design doc, based on offline

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2015-12-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Release Note: Trash is now supported for deletion of files within encryption zone after HDFS-8831. The

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041991#comment-15041991 ] Zhe Zhang commented on HDFS-9314: - Thanks Vinay for catching this! I just committed an addendum fix. >

[jira] [Updated] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Summary: Refactor reconfiguration of ClientDatanodeProtocol for reusability (was: Moving

[jira] [Updated] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9491: -- Attachment: HDFS-9491.002.patch In v2 patch: * Rebased to latest trunk. * Verified the build completes on OSX &

[jira] [Updated] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Attachment: HDFS-9414.002.patch > Refactor reconfiguration of ClientDatanodeProtocol for reusability

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042012#comment-15042012 ] Chris Trezzo commented on HDFS-8578: One big spot where I see the memory footprint potentially

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042020#comment-15042020 ] Chris Trezzo commented on HDFS-8578: [~vinayrpet] Woops, sorry I missed the part about no parallelism

[jira] [Commented] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042025#comment-15042025 ] Xiaobing Zhou commented on HDFS-9414: - V002 patch: 1. kept all interfaces in ClientDatanodeProtocol

[jira] [Created] (HDFS-9507) LeaseRenewer Logging Under-Reporting

2015-12-04 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HDFS-9507: - Summary: LeaseRenewer Logging Under-Reporting Key: HDFS-9507 URL: https://issues.apache.org/jira/browse/HDFS-9507 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041997#comment-15041997 ] Vinayakumar B commented on HDFS-8578: - bq. Hard-linking is also parallelized within each of these

[jira] [Updated] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Description: Since reconfiguration is reused by both DataNode and NameNode, this work proposes to

[jira] [Updated] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9483: - Attachment: HDFS-9483.patch Attached patch. Please review.. > Documentation does

[jira] [Updated] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9483: - Attachment: (was: HDFS-9483.patch) > Documentation does not cover use of

[jira] [Updated] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9483: - Attachment: HDFS-9483.patch > Documentation does not cover use of "swebhdfs" as

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042017#comment-15042017 ] Tony Wu commented on HDFS-9491: --- Hi [~eddyxu], I Just rebased the patch on latest trunk and ran a few tests.

[jira] [Updated] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9483: - Status: Patch Available (was: Open) > Documentation does not cover use of

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042046#comment-15042046 ] Hudson commented on HDFS-8831: -- FAILURE: Integrated in Hadoop-trunk-Commit #8922 (See

<    1   2