[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-01-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289533#comment-14289533 ] Kihwal Lee commented on HDFS-7609: -- Compared to 0.23, edit replaying in 2.x is 5x-10x

[jira] [Updated] (HDFS-7666) Datanode blockId layout upgrade threads should be daemon thread

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7666: --- Attachment: HDFS-7666-v1.patch Datanode blockId layout upgrade threads should be daemon thread

[jira] [Updated] (HDFS-3689) Add support for variable length block

2015-01-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.009.patch Add support for variable length block

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289686#comment-14289686 ] Andrew Wang commented on HDFS-7337: --- I don't think it's necessary to move to HADOOP. If

[jira] [Updated] (HDFS-7666) Datanode blockId layout upgrade threads should be daemon thread

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7666: --- Status: Patch Available (was: Open) Datanode blockId layout upgrade threads should be daemon thread

[jira] [Created] (HDFS-7666) Datanode blockId layout upgrade threads should be daemon thread

2015-01-23 Thread Rakesh R (JIRA)
Rakesh R created HDFS-7666: -- Summary: Datanode blockId layout upgrade threads should be daemon thread Key: HDFS-7666 URL: https://issues.apache.org/jira/browse/HDFS-7666 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-01-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289642#comment-14289642 ] Ming Ma commented on HDFS-7609: --- Yeah, we also had this issue. It appears somehow an entry

[jira] [Updated] (HDFS-3689) Add support for variable length block

2015-01-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: (was: HDFS-3689.009.patch) Add support for variable length block

[jira] [Updated] (HDFS-3689) Add support for variable length block

2015-01-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.009.patch editsStored Add support for variable length block

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289765#comment-14289765 ] Tsz Wo Nicholas Sze commented on HDFS-7353: --- Thanks for the update. Some

[jira] [Commented] (HDFS-7653) Block Readers and Writers used in both client side and datanode side

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289772#comment-14289772 ] Tsz Wo Nicholas Sze commented on HDFS-7653: --- Sound good. Thanks! Block Readers

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

2015-01-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.3.patch Include the editsStored binary in the patch. Enable Quota Support for

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289778#comment-14289778 ] Rakesh R commented on HDFS-7648: bq.If a mismatch is found, it should also fix it Should I

[jira] [Updated] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7667: --- Attachment: HDFS-7667.001.patch [~aw], Thanks for looking it over. The .001 version makes those two

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks() sorts DatanodeInfos but not StorageIDs

2015-01-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289725#comment-14289725 ] Arpit Agarwal commented on HDFS-7647: - Thanks for the patch [~milandesai], this looks

[jira] [Commented] (HDFS-7421) Move processing of postponed over-replicated blocks to a background task

2015-01-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289795#comment-14289795 ] Aaron T. Myers commented on HDFS-7421: -- Hey Kihwal, yes indeed, this seems like a

[jira] [Updated] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7667: --- Attachment: HDFS-7667.000.patch Diffs attached. Various typos and improvements to HDFS Federation

[jira] [Updated] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7667: --- Status: Patch Available (was: Open) Various typos and improvements to HDFS Federation doc

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289838#comment-14289838 ] Allen Wittenauer commented on HDFS-7667: Oh, should probably drop --config

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-01-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289871#comment-14289871 ] Zhe Zhang commented on HDFS-7285: - Thanks for clarifying. bq. After some discussion with

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

2015-01-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289901#comment-14289901 ] Zhe Zhang commented on HDFS-7339: - bq. First a quick comment about the current

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289698#comment-14289698 ] Rakesh R commented on HDFS-7648: [~szetszwo] I'm going through the block ID-based block

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

2015-01-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Attachment: HDFS-7584.2.patch Enable Quota Support for Storage Types (SSD)

[jira] [Resolved] (HDFS-7421) Move processing of postponed over-replicated blocks to a background task

2015-01-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-7421. -- Resolution: Duplicate Move processing of postponed over-replicated blocks to a background task

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289822#comment-14289822 ] Rakesh R commented on HDFS-7648: Ah, this is upgrade path. {{DataStorage.java:}} {code}

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289828#comment-14289828 ] Allen Wittenauer commented on HDFS-7667: While you're there, fix: {code}

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289855#comment-14289855 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- Yes. It won't be a problem then.

[jira] [Commented] (HDFS-7614) Implement COMPLETE state of erasure coding block groups

2015-01-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289875#comment-14289875 ] Zhe Zhang commented on HDFS-7614: - This design question is mainly [discussed |

[jira] [Updated] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7648: -- Description: HDFS-6482 changed datanode layout to use block ID to determine the

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289727#comment-14289727 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- During block report generation or

[jira] [Commented] (HDFS-7652) Process block reports for erasure coded blocks

2015-01-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289879#comment-14289879 ] Zhe Zhang commented on HDFS-7652: - This design question is mainly [discussed |

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289787#comment-14289787 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- Should I need to worry about the

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289780#comment-14289780 ] Tsz Wo Nicholas Sze commented on HDFS-7337: --- Do you expect that the erasure code

[jira] [Created] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7667: -- Summary: Various typos and improvements to HDFS Federation doc Key: HDFS-7667 URL: https://issues.apache.org/jira/browse/HDFS-7667 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

2015-01-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289868#comment-14289868 ] Zhe Zhang commented on HDFS-7339: - [~jingzhao] Thanks for the insightful review! I believe

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290062#comment-14290062 ] Tsz Wo Nicholas Sze commented on HDFS-7611: --- Thanks for digging deep into it. We

[jira] [Commented] (HDFS-7058) Tests for truncate CLI

2015-01-23 Thread Dasha Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290085#comment-14290085 ] Dasha Boudnik commented on HDFS-7058: - I can look into this. Thanks! Tests for

[jira] [Commented] (HDFS-4919) Improve documentation of dfs.permissions.enabled flag.

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290108#comment-14290108 ] Hadoop QA commented on HDFS-4919: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3728) Update Httpfs documentation

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290113#comment-14290113 ] Hadoop QA commented on HDFS-3728: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.008.patch Refactor and improve decommissioning logic into DecommissionManager

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290173#comment-14290173 ] Andrew Wang commented on HDFS-7411: --- If you look at version 2 of the patch, you can see

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290002#comment-14290002 ] Charles Lamb commented on HDFS-7667: [~aw], Thanks for the review. I started out

[jira] [Updated] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7667: --- Resolution: Fixed Fix Version/s: 3.0.0 Target Version/s: (was: 2.7.0)

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290032#comment-14290032 ] Charles Lamb commented on HDFS-7667: Thanks for the review and the commit [~aw]. If

[jira] [Commented] (HDFS-4919) Improve documentation of dfs.permissions.enabled flag.

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290090#comment-14290090 ] Allen Wittenauer commented on HDFS-4919: This no longer applies. :( Improve

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290034#comment-14290034 ] Hudson commented on HDFS-7667: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6920 (See

[jira] [Commented] (HDFS-7644) minor typo in HttpFS doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290048#comment-14290048 ] Charles Lamb commented on HDFS-7644: Gee, here I am fixing all these typos and I can't

[jira] [Assigned] (HDFS-7058) Tests for truncate CLI

2015-01-23 Thread Dasha Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dasha Boudnik reassigned HDFS-7058: --- Assignee: Dasha Boudnik Tests for truncate CLI --

[jira] [Updated] (HDFS-3750) API docs don't include HDFS

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3750: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-3728) Update Httpfs documentation

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3728: --- Status: Open (was: Patch Available) Update Httpfs documentation ---

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290095#comment-14290095 ] Tsz Wo Nicholas Sze commented on HDFS-3107: --- BTW, have we updated user

[jira] [Updated] (HDFS-3728) Update Httpfs documentation

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3728: --- Status: Patch Available (was: Open) Update Httpfs documentation ---

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: (was: hdfs-7411.008.patch) Refactor and improve decommissioning logic into

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.008.patch Refactor and improve decommissioning logic into DecommissionManager

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290146#comment-14290146 ] Andrew Wang commented on HDFS-7411: --- Thanks again for reviewing Colin, fixed with the

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289985#comment-14289985 ] Allen Wittenauer commented on HDFS-7667: There are other problems in the doc. but I

[jira] [Commented] (HDFS-3689) Add support for variable length block

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289966#comment-14289966 ] Hadoop QA commented on HDFS-3689: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289983#comment-14289983 ] Tsz Wo Nicholas Sze commented on HDFS-7339: --- The main reason for creating a

[jira] [Updated] (HDFS-7644) minor typo in HttpFS doc

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7644: --- Summary: minor typo in HttpFS doc (was: minor typo in HffpFS doc) minor typo in HttpFS doc

[jira] [Commented] (HDFS-4922) Improve the short-circuit document

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290101#comment-14290101 ] Allen Wittenauer commented on HDFS-4922: If someone updates this, we can get this

[jira] [Commented] (HDFS-7320) The appearance of hadoop-hdfs-httpfs site docs is inconsistent

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290135#comment-14290135 ] Hudson commented on HDFS-7320: -- FAILURE: Integrated in Hadoop-trunk-Commit #6923 (See

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290190#comment-14290190 ] Hadoop QA commented on HDFS-7667: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7058) Tests for truncate CLI

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7058: -- Description: Modify TestCLI to include general truncate tests. (was: Comprehensive test

[jira] [Commented] (HDFS-7644) minor typo in HttpFS doc

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290054#comment-14290054 ] Hudson commented on HDFS-7644: -- FAILURE: Integrated in Hadoop-trunk-Commit #6921 (See

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290092#comment-14290092 ] Allen Wittenauer commented on HDFS-6261: I'd prefer to see this get merged into the

[jira] [Updated] (HDFS-7320) The appearance of hadoop-hdfs-httpfs site docs is inconsistent

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7320: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-4922) Improve the short-circuit document

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290112#comment-14290112 ] Hadoop QA commented on HDFS-4922: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290111#comment-14290111 ] Hadoop QA commented on HDFS-6261: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290152#comment-14290152 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- Could we separate code refactoring

[jira] [Commented] (HDFS-7666) Datanode blockId layout upgrade threads should be daemon thread

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289994#comment-14289994 ] Hadoop QA commented on HDFS-7666: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7644) minor typo in HttpFS doc

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7644: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290072#comment-14290072 ] Tsz Wo Nicholas Sze commented on HDFS-3107: --- There is a list of unresolved JIRAs.

[jira] [Commented] (HDFS-3750) API docs don't include HDFS

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290121#comment-14290121 ] Hudson commented on HDFS-3750: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6922 (See

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290188#comment-14290188 ] Hadoop QA commented on HDFS-7667: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7644) minor typo in HffpFS doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289203#comment-14289203 ] Charles Lamb commented on HDFS-7644: The FB warnings are spurious. minor typo in

[jira] [Commented] (HDFS-7653) Block Readers and Writers used in both client side and datanode side

2015-01-23 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289262#comment-14289262 ] Li Bo commented on HDFS-7653: - Hi, Zhe , thanks for your comments. 1. BlockReader

[jira] [Updated] (HDFS-3689) Add support for variable length block

2015-01-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.009.patch Thanks again Nicholas! Update the patch to add quota verification. Add

[jira] [Updated] (HDFS-7418) Raw Reed-Solomon coder in pure Java

2015-01-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7418: Attachment: HDFS-7418-v1.patch Uploaded an initial patch, pending for submit since it depends on the one in

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-01-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288973#comment-14288973 ] Kai Zheng commented on HDFS-7337: - As discussed, most part of this source codes will be

[jira] [Created] (HDFS-7669) HDFS Design Doc references commands that no longer exist.

2015-01-23 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7669: -- Summary: HDFS Design Doc references commands that no longer exist. Key: HDFS-7669 URL: https://issues.apache.org/jira/browse/HDFS-7669 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

2015-01-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290278#comment-14290278 ] Haohui Mai commented on HDFS-6673: -- -0 bq. ... a fairly large fsimage here. ... I think

[jira] [Commented] (HDFS-7665) Add definition of truncate preconditions/postconditions to filesystem specification

2015-01-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290352#comment-14290352 ] Konstantin Shvachko commented on HDFS-7665: --- Steve, could you mention where

[jira] [Commented] (HDFS-6729) Support maintenance mode for DN

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290402#comment-14290402 ] Hadoop QA commented on HDFS-6729: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6729) Support maintenance mode for DN

2015-01-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6729: Attachment: HDFS-6729.004.patch Updated the patch to: # add {{dfsadmin -setMaintenanceMode}}

[jira] [Commented] (HDFS-6729) Support maintenance mode for DN

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290240#comment-14290240 ] Andrew Wang commented on HDFS-6729: --- Hey Eddy, quick question, this looks like soft state

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290297#comment-14290297 ] Andrew Wang commented on HDFS-6673: --- Oops, realized Eddy still needs to address my

[jira] [Created] (HDFS-7670) HDFS Quota guide has typos, incomplete command lines

2015-01-23 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7670: -- Summary: HDFS Quota guide has typos, incomplete command lines Key: HDFS-7670 URL: https://issues.apache.org/jira/browse/HDFS-7670 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7669) HDFS Design Doc references commands that no longer exist.

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7669: --- Component/s: documentation HDFS Design Doc references commands that no longer exist.

[jira] [Created] (HDFS-7672) Handle write failure for EC blocks

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7672: - Summary: Handle write failure for EC blocks Key: HDFS-7672 URL: https://issues.apache.org/jira/browse/HDFS-7672 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6673) Add Delimited format supports for PB OIV tool

2015-01-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6673: Attachment: HDFS-6673.006.patch Thanks [~andrew.wang] and [~wheat9]. This patch addressed comments

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

2015-01-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290331#comment-14290331 ] Haohui Mai commented on HDFS-6673: -- bq. Also, even a 40GB image easily fits in memory on

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

2015-01-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290329#comment-14290329 ] Konstantin Shvachko commented on HDFS-7659: --- +1. Looks good. Can I ask you to

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-01-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290345#comment-14290345 ] Konstantin Shvachko commented on HDFS-3107: --- Yes HDFS-7659 is ready.

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290238#comment-14290238 ] Andrew Wang commented on HDFS-6673: --- Hey Haohui, Eddy's done performance testing with a

[jira] [Updated] (HDFS-7668) Convert site documentation from apt to markdown

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7668: --- Component/s: documentation Convert site documentation from apt to markdown

[jira] [Created] (HDFS-7668) Convert site documentation from apt to markdown

2015-01-23 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7668: -- Summary: Convert site documentation from apt to markdown Key: HDFS-7668 URL: https://issues.apache.org/jira/browse/HDFS-7668 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7671) hdfs user guide should point to the common rack awareness doc

2015-01-23 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7671: -- Summary: hdfs user guide should point to the common rack awareness doc Key: HDFS-7671 URL: https://issues.apache.org/jira/browse/HDFS-7671 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

2015-01-23 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290294#comment-14290294 ] Andrew Wang commented on HDFS-6673: --- bq. The test is on a 3G fsimage which can easily fit

[jira] [Created] (HDFS-7673) synthetic load generator docs give incorrect/incomplete commands

2015-01-23 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7673: -- Summary: synthetic load generator docs give incorrect/incomplete commands Key: HDFS-7673 URL: https://issues.apache.org/jira/browse/HDFS-7673 Project: Hadoop

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290348#comment-14290348 ] Hadoop QA commented on HDFS-7411: - {color:red}-1 overall{color}. Here are the results of

  1   2   >