[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381470#comment-14381470 ] Xiaoyu Yao commented on HDFS-7824: -- BlockManager#convertLastBlockToUnderConstruction need

[jira] [Commented] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381454#comment-14381454 ] Harsh J commented on HDFS-2964: --- On second thought, this should probably just be logged once

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381430#comment-14381430 ] Zhe Zhang commented on HDFS-7782: - bq. I guess in the end we do not need the serial read? I

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381418#comment-14381418 ] Arpit Agarwal commented on HDFS-7824: - bq. Update patch that fixes the unit test failur

[jira] [Updated] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7824: - Attachment: HDFS-7824.06.patch Update patch that fixes the unit test failure inTestTruncateQuotaUpdate. Th

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381317#comment-14381317 ] Xiaoyu Yao commented on HDFS-7824: -- org.apache.hadoop.hdfs.server.namenode.TestTruncateQuo

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-03-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381305#comment-14381305 ] Ming Ma commented on HDFS-7993: --- Thanks, [~andreina]. Please go ahead. We might want to clar

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381301#comment-14381301 ] Hadoop QA commented on HDFS-7991: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-7992) HTTP request queue size limit can be made configurable

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-7992. -- Resolution: Won't Fix Thanks for reporting this issue. After the DN moves to Netty, the jetty server onl

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-03-25 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381298#comment-14381298 ] J.Andreina commented on HDFS-7993: -- I would like to work on this issue. If you have patch

[jira] [Assigned] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-03-25 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina reassigned HDFS-7993: Assignee: J.Andreina > Incorrect descriptions in fsck when nodes are decommissioned > --

[jira] [Updated] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-03-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7993: -- Description: When you run fsck with "-files" or "-racks", you will get something like below if one of the replic

[jira] [Created] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-03-25 Thread Ming Ma (JIRA)
Ming Ma created HDFS-7993: - Summary: Incorrect descriptions in fsck when nodes are decommissioned Key: HDFS-7993 URL: https://issues.apache.org/jira/browse/HDFS-7993 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381270#comment-14381270 ] Hadoop QA commented on HDFS-7824: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7992) HTTP request queue size limit can be made configurable

2015-03-25 Thread J.Andreina (JIRA)
J.Andreina created HDFS-7992: Summary: HTTP request queue size limit can be made configurable Key: HDFS-7992 URL: https://issues.apache.org/jira/browse/HDFS-7992 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7863) Missing description of parameter fsd in javadoc

2015-03-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381231#comment-14381231 ] Brahma Reddy Battula commented on HDFS-7863: Can somebody review this patch...?

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-25 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381229#comment-14381229 ] Kai Zheng commented on HDFS-7715: - Thanks [~rashmikv] for your clarifying ! bq.it will be a

[jira] [Commented] (HDFS-7981) getStoragePolicy() regards HOT policy as EC policy

2015-03-25 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381213#comment-14381213 ] Takanobu Asanuma commented on HDFS-7981: I understand. Thank you for your help, [~z

[jira] [Commented] (HDFS-7701) Support reporting per storage type quota and usage with hadoop/hdfs shell

2015-03-25 Thread Peter Shi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381201#comment-14381201 ] Peter Shi commented on HDFS-7701: - [~xyao], Ok, please let me do this. > Support reporting

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381154#comment-14381154 ] Hadoop QA commented on HDFS-7748: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7918) Clean up unused code for old web UI in branch-2

2015-03-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381142#comment-14381142 ] Brahma Reddy Battula commented on HDFS-7918: Thanks for review and commit!!! >

[jira] [Updated] (HDFS-7918) Clean up unused code for old web UI in branch-2

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7918: - Resolution: Fixed Status: Resolved (was: Patch Available) I've committed to branch-2. Thanks for t

[jira] [Commented] (HDFS-7918) Clean up unused code for old web UI in branch-2

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381132#comment-14381132 ] Haohui Mai commented on HDFS-7918: -- +1. I'll commit shortly. > Clean up unused code for o

[jira] [Commented] (HDFS-7918) Clean up unused code for old web UI in branch-2

2015-03-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381108#comment-14381108 ] Brahma Reddy Battula commented on HDFS-7918: Thanks for taking a look into this

[jira] [Updated] (HDFS-7918) Clean up unused code for old web UI in branch-2

2015-03-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7918: --- Attachment: HDFS-7918-002.patch > Clean up unused code for old web UI in branch-2 > ---

[jira] [Commented] (HDFS-7616) Add a test for BlockGroup support in FSImage

2015-03-25 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381104#comment-14381104 ] Takuya Fukudome commented on HDFS-7616: --- Thank you for the review and the commit, [~z

[jira] [Commented] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381099#comment-14381099 ] Jing Zhao commented on HDFS-7991: - [~kihwal], do you think this patch can address your comm

[jira] [Updated] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7991: Attachment: HDFS-7991.000.patch Initial patch that # adds a flag in the shell script to allow users to disabl

[jira] [Updated] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7991: Status: Patch Available (was: Open) > Allow users to skip checkpoint when stopping NameNode > --

[jira] [Created] (HDFS-7991) Allow users to skip checkpoint when stopping NameNode

2015-03-25 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7991: --- Summary: Allow users to skip checkpoint when stopping NameNode Key: HDFS-7991 URL: https://issues.apache.org/jira/browse/HDFS-7991 Project: Hadoop HDFS Issue Type: Imp

[jira] [Commented] (HDFS-7989) NFS gateway should shutdown when it can't start UDP or TCP server

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381079#comment-14381079 ] Hadoop QA commented on HDFS-7989: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7969) Erasure coding: lease recovery for striped block groups

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7969: Attachment: HDFS-7969-000.patch Main changes introduced by the patch: # A {{BlockInfoUC}} interface to avoid

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381025#comment-14381025 ] Hadoop QA commented on HDFS-7471: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7989) NFS gateway should shutdown when it can't start UDP or TCP server

2015-03-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7989: - Summary: NFS gateway should shutdown when it can't start UDP or TCP server (was: NFS gateway should shutdo

[jira] [Updated] (HDFS-7989) NFS gateway should shutdown when it can't start UDP or TCP server

2015-03-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7989: - Status: Patch Available (was: Open) > NFS gateway should shutdown when it can't start UDP or TCP server >

[jira] [Updated] (HDFS-7989) NFS gateway should shutdown when it can't bind the serivce ports

2015-03-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7989: - Attachment: HDFS-7989.001.patch > NFS gateway should shutdown when it can't bind the serivce ports > --

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380993#comment-14380993 ] Jing Zhao commented on HDFS-6353: - Had an offline discussion with Suresh and Jitendra. What

[jira] [Updated] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7824: - Attachment: HDFS-7824.05.patch Include the missing file. > GetContentSummary API and its namenode implemen

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380943#comment-14380943 ] Jing Zhao commented on HDFS-6353: - bq. Unlike the namenode start-up, shutdown will now requ

[jira] [Commented] (HDFS-7981) getStoragePolicy() regards HOT policy as EC policy

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380932#comment-14380932 ] Zhe Zhang commented on HDFS-7981: - Thanks [~tasanuma0829] for spotting this. HDFS-7839 trie

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-03-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380931#comment-14380931 ] Allen Wittenauer commented on HDFS-7984: Sort of. Today, WebHDFS's authentication

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380898#comment-14380898 ] Kihwal Lee commented on HDFS-6353: -- While looking at the patch, I thought about issuing th

[jira] [Comment Edited] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380898#comment-14380898 ] Kihwal Lee edited comment on HDFS-6353 at 3/25/15 10:19 PM: Whi

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2015-03-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380899#comment-14380899 ] Daryn Sharp commented on HDFS-7967: --- Providing a more deterministic ordering of blocks ca

[jira] [Created] (HDFS-7990) IBR delete ack should not be delayed

2015-03-25 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-7990: - Summary: IBR delete ack should not be delayed Key: HDFS-7990 URL: https://issues.apache.org/jira/browse/HDFS-7990 Project: Hadoop HDFS Issue Type: Bug Co

[jira] [Updated] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7748: --- Attachment: hdfs-7748.006.patch Re-attaching the same patch so Jira picks up the right patch for the tr

[jira] [Updated] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7748: --- Attachment: (was: hdfs-7748.006.patch) > Separate ECN flags from the Status in the DataTransferPipe

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380866#comment-14380866 ] Hadoop QA commented on HDFS-7748: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7748: --- Attachment: hdfs-7748.branch-2.7.006.patch hdfs-7748.006.patch The last patch failed be

[jira] [Updated] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6353: Attachment: HDFS-6353.002.branch-2.patch Ahh, yes. Thanks for the review, [~kihwal]! Update the branch-2 patc

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380822#comment-14380822 ] Hadoop QA commented on HDFS-7824: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380796#comment-14380796 ] Hadoop QA commented on HDFS-2964: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380794#comment-14380794 ] Kihwal Lee commented on HDFS-6353: -- The second safemode command is supposed to be "leave",

[jira] [Updated] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7824: - Attachment: HDFS-7824.04.patch Thanks [~arpitagarwal]! I've updated patch v04 to suppress the warning of th

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2015-03-25 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380745#comment-14380745 ] Andrew Purtell commented on HDFS-6450: -- bq. I think it's much easier to just implement

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-03-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380738#comment-14380738 ] Chris Nauroth commented on HDFS-7984: - Hi Allen. It's unclear to me what this issue is

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380725#comment-14380725 ] Daryn Sharp commented on HDFS-6658: --- bq. It would be nice if this could help with the goa

[jira] [Updated] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6353: Attachment: HDFS-6353.002.branch-2.patch Patch for branch-2. > Check and make checkpoint before stopping the

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-25 Thread Rashmi Vinayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380708#comment-14380708 ] Rashmi Vinayak commented on HDFS-7715: -- Hi Kai, >I'm wondering if it could get resolv

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380692#comment-14380692 ] Arpit Agarwal commented on HDFS-7824: - +1 for just suppressing the warning for this tes

[jira] [Commented] (HDFS-7824) GetContentSummary API and its namenode implementaion for Storage Type Quota/Usage

2015-03-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380688#comment-14380688 ] Xiaoyu Yao commented on HDFS-7824: -- The javac warning is from TestCount.MockContentSummary

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

2015-03-25 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380682#comment-14380682 ] Rushabh S Shah commented on HDFS-7928: -- Thanks [~kihwal] for reviewing and committing.

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380667#comment-14380667 ] Jing Zhao commented on HDFS-7782: - I guess in the end we do not need the serial read? > Re

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380666#comment-14380666 ] Daryn Sharp commented on HDFS-6658: --- bq. Why did you roll your own bitset instead of usi

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380660#comment-14380660 ] Hudson commented on HDFS-7928: -- FAILURE: Integrated in Hadoop-trunk-Commit #7435 (See [https:

[jira] [Updated] (HDFS-7989) NFS gateway should shutdown when it can't bind the serivce ports

2015-03-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7989: - Description: Unlike the Portmap, Nfs3 class does shutdown when the service can't start. (was: Unlike the P

[jira] [Updated] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7928: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380642#comment-14380642 ] Kihwal Lee commented on HDFS-7928: -- +1 the latest patch looks good. > Scanning blocks fro

[jira] [Created] (HDFS-7989) NFS gateway should shutdown when it can't bind the serivce ports

2015-03-25 Thread Brandon Li (JIRA)
Brandon Li created HDFS-7989: Summary: NFS gateway should shutdown when it can't bind the serivce ports Key: HDFS-7989 URL: https://issues.apache.org/jira/browse/HDFS-7989 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-03-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7471: --- Attachment: PreCommit-HDFS-Build #9898 test - testNumVersionsReportedCorrect [Jenkins].html Thanks for

[jira] [Commented] (HDFS-7617) Add editlog transactions for EC

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380588#comment-14380588 ] Zhe Zhang commented on HDFS-7617: - Thanks for the patch Hui. The 2 tests in the patch look

[jira] [Commented] (HDFS-7616) Add a test for BlockGroup support in FSImage

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380574#comment-14380574 ] Zhe Zhang commented on HDFS-7616: - Thanks Takuya for the work and Nicholas for the review!

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380576#comment-14380576 ] Kihwal Lee commented on HDFS-7959: -- >I think that the right fix is to move delegation toke

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380569#comment-14380569 ] Zhe Zhang commented on HDFS-7891: - [~walter.k.su] Below are my comments about 004 patch: #

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380482#comment-14380482 ] Zhe Zhang commented on HDFS-7891: - Thanks Nicholas and Walter for the discussion! bq. I th

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380457#comment-14380457 ] Zhe Zhang commented on HDFS-7782: - Thanks Jing for the quick feedback! bq. We can first on

[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380435#comment-14380435 ] Jing Zhao commented on HDFS-7782: - Thanks for updating the patch, [~zhz]! I think finally

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380427#comment-14380427 ] Haohui Mai commented on HDFS-7959: -- bq. Besides, not all the components in the current jet

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-25 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380429#comment-14380429 ] Ryan Sasson commented on HDFS-5796: --- This sounds reasonable, my only question is why not

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380413#comment-14380413 ] Kihwal Lee commented on HDFS-7959: -- It is probably a good idea to sanitize the tokens in t

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380405#comment-14380405 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-trunk-Commit #7434 (See [https:

[jira] [Updated] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6353: Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (was: P

[jira] [Updated] (HDFS-7782) Read a striping layout file from client side

2015-03-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7782: Attachment: HDFS-7782-004.patch The new patch has several updates: # Disabled hedged read, leaving it as a TO

[jira] [Commented] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380390#comment-14380390 ] Hudson commented on HDFS-6353: -- FAILURE: Integrated in Hadoop-trunk-Commit #7433 (See [https:

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380385#comment-14380385 ] Ravi Prakash commented on HDFS-7713: Thanks a lot for your detailed and persistent revi

[jira] [Comment Edited] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379293#comment-14379293 ] Haohui Mai edited comment on HDFS-7985 at 3/25/15 5:39 PM: --- I've

[jira] [Updated] (HDFS-6353) Check and make checkpoint before stopping the NameNode

2015-03-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6353: Summary: Check and make checkpoint before stopping the NameNode (was: Handle checkpoint failure more gracefu

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Attachment: HDFS-2964-3.patch > No notice in any logs if dfs.datanode.du.reserved is greater than available > di

[jira] [Commented] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380294#comment-14380294 ] Hadoop QA commented on HDFS-2964: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Component/s: (was: namenode) > No notice in any logs if dfs.datanode.du.reserved is greater than available >

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Affects Version/s: (was: 0.20.2) 2.6.0 > No notice in any logs if dfs.datanode.du.rese

[jira] [Updated] (HDFS-2964) No notice in any logs if dfs.datanode.du.reserved is greater than available disk space

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2964: -- Attachment: HDFS-2964-2.patch +1 on this. I cleaned up the message to be more informative (print path and bytes

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380130#comment-14380130 ] Allen Wittenauer commented on HDFS-7985: (Just so no one else has to look, no, this

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-03-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380097#comment-14380097 ] Kihwal Lee commented on HDFS-7471: -- We've seen this in HDFS-7433. [~daryn] and I thought H

[jira] [Commented] (HDFS-7985) WebHDFS should be always enabled

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380073#comment-14380073 ] Hudson commented on HDFS-7985: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7977) NFS couldn't take percentile intervals

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380075#comment-14380075 ] Hudson commented on HDFS-7977: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7713) Implement mkdirs in the HDFS Web UI

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380081#comment-14380081 ] Hudson commented on HDFS-7713: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380086#comment-14380086 ] Hudson commented on HDFS-7854: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380084#comment-14380084 ] Hudson commented on HDFS-6826: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380074#comment-14380074 ] Hudson commented on HDFS-7961: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2093 (See [htt

  1   2   >