[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518976#comment-14518976 ] Xinwei Qin commented on HDFS-7836: --- Hi [~cmccabe], [~clamb], This is a very meaningful

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518968#comment-14518968 ] surendra singh lilhore commented on HDFS-8277: -- In {{DFSAdmin.java}} class

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518786#comment-14518786 ] Hadoop QA commented on HDFS-8214: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8277) Safemode enter fails when Standby NameNode is down

[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8277: - Attachment: HDFS-8277_1.patch Attached patch , Please review... Safemode enter

[jira] [Updated] (HDFS-8277) Safemode enter fails when Standby NameNode is down

[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8277: - Attachment: HDFS-8277.patch Safemode enter fails when Standby NameNode is down

[jira] [Assigned] (HDFS-8259) Erasure Coding: Test of reading EC file

[ https://issues.apache.org/jira/browse/HDFS-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin reassigned HDFS-8259: - Assignee: Xinwei Qin Erasure Coding: Test of reading EC file

[jira] [Assigned] (HDFS-8262) Erasure Coding: Test of datanode decommission which EC blocks are stored

[ https://issues.apache.org/jira/browse/HDFS-8262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin reassigned HDFS-8262: - Assignee: Xinwei Qin Erasure Coding: Test of datanode decommission which EC blocks are stored

[jira] [Assigned] (HDFS-8260) Erasure Coding: test of writing EC file

[ https://issues.apache.org/jira/browse/HDFS-8260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin reassigned HDFS-8260: - Assignee: Xinwei Qin Erasure Coding: test of writing EC file

[jira] [Assigned] (HDFS-8265) Erasure Coding: Test of Quota calculation for EC files

[ https://issues.apache.org/jira/browse/HDFS-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-8265: -- Assignee: Rakesh R Erasure Coding: Test of Quota calculation for EC files

[jira] [Comment Edited] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518982#comment-14518982 ] Yi Liu edited comment on HDFS-8272 at 4/29/15 10:15 AM: Thanks Jing

[jira] [Updated] (HDFS-8129) Erasure Coding: Maintain consistent naming for Erasure Coding related classes - EC/ErasureCoding

[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-8129: -- Summary: Erasure Coding: Maintain consistent naming for Erasure Coding related classes -

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519127#comment-14519127 ] Rakesh R commented on HDFS-8220: Thanks a lot [~walter.k.su] for the details. IMHO we could

[jira] [Commented] (HDFS-8129) Erasure Coding: Maintain consistent naming for Erasure Coding related classes - EC/ErasureCoding

[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519125#comment-14519125 ] Uma Maheswara Rao G commented on HDFS-8129: --- I checked the class names. Right now

[jira] [Commented] (HDFS-8129) Erasure Coding: Maintain consistent naming for Erasure Coding related classes - EC/ErasureCoding

[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519149#comment-14519149 ] Rakesh R commented on HDFS-8129: I'm adding few more classes for the discussion, please

[jira] [Commented] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519225#comment-14519225 ] Hudson commented on HDFS-8273: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #169 (See

[jira] [Commented] (HDFS-8280) Code Cleanup in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519223#comment-14519223 ] Hudson commented on HDFS-8280: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #169 (See

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519227#comment-14519227 ] Hudson commented on HDFS-8204: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #169 (See

[jira] [Commented] (HDFS-8129) Erasure Coding: Maintain consistent naming for Erasure Coding related classes - EC/ErasureCoding

[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519230#comment-14519230 ] Uma Maheswara Rao G commented on HDFS-8129: --- Actually Nicholas quoted above that,

[jira] [Commented] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519251#comment-14519251 ] Hudson commented on HDFS-8273: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #178 (See

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519253#comment-14519253 ] Hudson commented on HDFS-8204: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #178 (See

[jira] [Commented] (HDFS-8129) Erasure Coding: Maintain consistent naming for Erasure Coding related classes - EC/ErasureCoding

[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519256#comment-14519256 ] Rakesh R commented on HDFS-8129: oops, thanks Uma for pointing out this. Probably it can be

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Status: Patch Available (was: Reopened) Modify NNThroughputBenchmark to be able to operate on a

[jira] [Commented] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519199#comment-14519199 ] Hudson commented on HDFS-8273: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2110 (See

[jira] [Commented] (HDFS-8280) Code Cleanup in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519197#comment-14519197 ] Hudson commented on HDFS-8280: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2110 (See

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519201#comment-14519201 ] Hudson commented on HDFS-8204: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2110 (See

[jira] [Reopened] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb reopened HDFS-7847: Porting to trunk. .004 submitted. Modify NNThroughputBenchmark to be able to operate on a remote

[jira] [Commented] (HDFS-8280) Code Cleanup in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519248#comment-14519248 ] Hudson commented on HDFS-8280: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #178 (See

[jira] [Commented] (HDFS-8129) Erasure Coding: Maintain consistent naming for Erasure Coding related classes - EC/ErasureCoding

[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519263#comment-14519263 ] Kai Zheng commented on HDFS-8129: - Thanks for the discussion. It would be great if we could

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519283#comment-14519283 ] Hudson commented on HDFS-8204: -- FAILURE: Integrated in Hadoop-Yarn-trunk #912 (See

[jira] [Commented] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519281#comment-14519281 ] Hudson commented on HDFS-8273: -- FAILURE: Integrated in Hadoop-Yarn-trunk #912 (See

[jira] [Commented] (HDFS-8280) Code Cleanup in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519279#comment-14519279 ] Hudson commented on HDFS-8280: -- FAILURE: Integrated in Hadoop-Yarn-trunk #912 (See

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519304#comment-14519304 ] Charles Lamb commented on HDFS-8214: The test failure is unrelated. The checkstyle

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Target Version/s: 2.8.0 (was: HDFS-7836) Status: In Progress (was: Patch Available)

[jira] [Updated] (HDFS-8015) Erasure Coding: local and remote block writer for coding work in DataNode

[ https://issues.apache.org/jira/browse/HDFS-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8015: Attachment: HDFS-8015-001.patch Erasure Coding: local and remote block writer for coding work in DataNode

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518754#comment-14518754 ] Zhe Zhang commented on HDFS-7859: - [~aw] Thanks again for bringing in the feature-branch

[jira] [Commented] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518975#comment-14518975 ] surendra singh lilhore commented on HDFS-8276: -- Attached patch, Please review

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518771#comment-14518771 ] Yongjun Zhang commented on HDFS-7281: - Hi [~mingma], Thanks for the new rev and the

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518982#comment-14518982 ] Yi Liu commented on HDFS-8272: -- Thanks Jing for the work and Zhe for the review ! {quote} -

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518992#comment-14518992 ] Brahma Reddy Battula commented on HDFS-8277: [~surendrasingh] Thanks for

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518931#comment-14518931 ] Walter Su commented on HDFS-8220: - ...In your unit test, the cluster has 3 nodes and only 3

[jira] [Updated] (HDFS-8150) Make getFileChecksum fail for blocks under construction

[ https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8150: - Attachment: HDFS-8150.2.patch Attaching the patch after fixing testcase failure. Please review. Make

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518935#comment-14518935 ] Li Bo commented on HDFS-7348: - We can give two working modes to the recovery work, Fast, or

[jira] [Updated] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8276: - Attachment: HDFS-8276.patch LazyPersistFileScrubber should be disabled if

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519015#comment-14519015 ] Rakesh R commented on HDFS-2484: Thanks [~shv] for reporting this. I could see

[jira] [Updated] (HDFS-8277) Safemode enter fails when Standby NameNode is down

[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8277: --- Issue Type: Bug (was: Improvement) Safemode enter fails when Standby NameNode is

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518818#comment-14518818 ] Li Bo commented on HDFS-7613: - hi, Walter HDFS-8220 depends upon this sub task but the current

[jira] [Commented] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

[ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518817#comment-14518817 ] Hadoop QA commented on HDFS-8269: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518918#comment-14518918 ] Li Bo commented on HDFS-7348: - Thanks Yi for the great work! I think decreasing network I/O is

[jira] [Updated] (HDFS-8277) Safemode enter fails when Standby NameNode is down

[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8277: - Status: Patch Available (was: Open) Safemode enter fails when Standby NameNode

[jira] [Commented] (HDFS-8265) Erasure Coding: Test of Quota calculation for EC files

[ https://issues.apache.org/jira/browse/HDFS-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519108#comment-14519108 ] Rakesh R commented on HDFS-8265: Thanks [~demongaorui] for reporting this task. I'm happy

[jira] [Commented] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519571#comment-14519571 ] Hudson commented on HDFS-8273: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2128 (See

[jira] [Commented] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519573#comment-14519573 ] Hudson commented on HDFS-8204: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2128 (See

[jira] [Commented] (HDFS-8280) Code Cleanup in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-8280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519569#comment-14519569 ] Hudson commented on HDFS-8280: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2128 (See

[jira] [Updated] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8272: Summary: Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read) (was: Erasure

[jira] [Assigned] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramtin reassigned HDFS-1950: Assignee: ramtin (was: Uma Maheswara Rao G) Blocks that are under construction are not getting read if

[jira] [Updated] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7281: -- Attachment: HDFS-7281-6.patch Thanks [~yzhangal]. Here is the updated patch. Missing block is marked as

[jira] [Updated] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8272: Attachment: HDFS-8272.002.patch Thanks for the review, Zhe and Yi! I just merged HDFS-8280 into HDFS-7285

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519802#comment-14519802 ] Jing Zhao commented on HDFS-8283: - Thanks for working on this, Nicholas! The patch looks

[jira] [Updated] (HDFS-8283) DataStreamer cleanup and some minor improvement

[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8283: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Created] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

Tsz Wo Nicholas Sze created HDFS-8288: - Summary: Refactor DFSStripedOutputStream and StripedDataStreamer Key: HDFS-8288 URL: https://issues.apache.org/jira/browse/HDFS-8288 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8113) NullPointerException in BlockInfoContiguous causes block report failure

[ https://issues.apache.org/jira/browse/HDFS-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520002#comment-14520002 ] Colin Patrick McCabe commented on HDFS-8113: +1 for HDFS-8113.02.patch. I

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520056#comment-14520056 ] Haohui Mai commented on HDFS-8214: -- {code} + if (v 0) { +return unknown; +

[jira] [Commented] (HDFS-8037) WebHDFS: CheckAccess silently accepts certain malformed FsActions

[ https://issues.apache.org/jira/browse/HDFS-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520064#comment-14520064 ] Haohui Mai commented on HDFS-8037: -- Good catch. Can you please add a unit test? WebHDFS:

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520083#comment-14520083 ] Lei (Eddy) Xu commented on HDFS-7758: - Seems that the checkstyle error is caused by

[jira] [Comment Edited] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520095#comment-14520095 ] Jing Zhao edited comment on HDFS-8272 at 4/29/15 8:03 PM: -- Thanks

[jira] [Created] (HDFS-8286) Scaling out the namespace using KV store

Haohui Mai created HDFS-8286: Summary: Scaling out the namespace using KV store Key: HDFS-8286 URL: https://issues.apache.org/jira/browse/HDFS-8286 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramtin updated HDFS-1950: - Assignee: (was: ramtin) Blocks that are under construction are not getting read if the blocks are more than

[jira] [Updated] (HDFS-8249) Separate HdfsConstants into the client and the server side class

[ https://issues.apache.org/jira/browse/HDFS-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8249: - Attachment: HDFS-8249.001.patch Separate HdfsConstants into the client and the server side class

[jira] [Updated] (HDFS-1950) Blocks that are under construction are not getting read if the blocks are more than 10. Only complete blocks are read properly.

[ https://issues.apache.org/jira/browse/HDFS-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramtin updated HDFS-1950: - Assignee: Uma Maheswara Rao G Blocks that are under construction are not getting read if the blocks are more

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519769#comment-14519769 ] Jing Zhao commented on HDFS-8270: - I think we can use HDFS-6697 to make the lease soft and

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519763#comment-14519763 ] Lei (Eddy) Xu commented on HDFS-7758: - working on fixing checkstyle reports. Retire

[jira] [Commented] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

[ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519834#comment-14519834 ] Jing Zhao commented on HDFS-8269: - The 003 patch looks pretty good to me. +1. The failed

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519827#comment-14519827 ] Hudson commented on HDFS-8283: -- FAILURE: Integrated in Hadoop-trunk-Commit #7699 (See

[jira] [Comment Edited] (HDFS-8273) FSNamesystem#Delete() should not call logSync() when holding the lock

[ https://issues.apache.org/jira/browse/HDFS-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518497#comment-14518497 ] Haohui Mai edited comment on HDFS-8273 at 4/29/15 6:14 PM: --- I've

[jira] [Updated] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

[ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8269: - Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

[ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519880#comment-14519880 ] Hudson commented on HDFS-8269: -- FAILURE: Integrated in Hadoop-trunk-Commit #7700 (See

[jira] [Updated] (HDFS-8286) Scaling out the namespace using KV store

[ https://issues.apache.org/jira/browse/HDFS-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8286: - Attachment: hdfs-kv-design.pdf The attachment outlines the architecture of the HDFS namespace over KV

[jira] [Created] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

Tsz Wo Nicholas Sze created HDFS-8287: - Summary: DFSStripedOutputStream.writeChunk should not wait for writing parity Key: HDFS-8287 URL: https://issues.apache.org/jira/browse/HDFS-8287 Project:

[jira] [Commented] (HDFS-8249) Separate HdfsConstants into the client and the server side class

[ https://issues.apache.org/jira/browse/HDFS-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520261#comment-14520261 ] Hadoop QA commented on HDFS-8249: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

Chris Nauroth created HDFS-8290: --- Summary: WebHDFS calls before namesystem initialization can cause NullPointerException. Key: HDFS-8290 URL: https://issues.apache.org/jira/browse/HDFS-8290 Project:

[jira] [Commented] (HDFS-6697) Make NN lease soft and hard limits configurable

[ https://issues.apache.org/jira/browse/HDFS-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520194#comment-14520194 ] Haohui Mai commented on HDFS-6697: -- What about changing the values through reflection? It

[jira] [Created] (HDFS-8289) DFSStripedOutputStream uses an additional rpc all to getErasureCodingInfo

Tsz Wo Nicholas Sze created HDFS-8289: - Summary: DFSStripedOutputStream uses an additional rpc all to getErasureCodingInfo Key: HDFS-8289 URL: https://issues.apache.org/jira/browse/HDFS-8289

[jira] [Updated] (HDFS-7559) Create unit test to automatically compare HDFS related classes and hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-7559: - Labels: BB2015-05-TBR supportability (was: supportability) Create unit test to automatically compare

[jira] [Commented] (HDFS-7559) Create unit test to automatically compare HDFS related classes and hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520301#comment-14520301 ] Ray Chiang commented on HDFS-7559: -- Both failed tests pass in my tree. Create unit test

[jira] [Updated] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8290: Attachment: HDFS-8290.001.patch I'm attaching a patch that adds a null check and a test. WebHDFS

[jira] [Updated] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8290: Status: Patch Available (was: Open) WebHDFS calls before namesystem initialization can cause

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520358#comment-14520358 ] Jakob Homan commented on HDFS-8290: --- +1. WebHDFS calls before namesystem initialization

[jira] [Work started] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8291 started by Zhongyi Xie. - Modify NN WebUI to display correct unit

[jira] [Commented] (HDFS-8174) Update replication count to live rep count in fsck report

[ https://issues.apache.org/jira/browse/HDFS-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520453#comment-14520453 ] Ming Ma commented on HDFS-8174: --- Thanks [~andreina]. LGTM. Update replication count to live

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: (was: HDFS-7678-HDFS-7285.004.patch) Erasure coding: DFSInputStream with decode

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.004.patch Erasure coding: DFSInputStream with decode functionality

[jira] [Updated] (HDFS-8249) Separate HdfsConstants into the client and the server side class

[ https://issues.apache.org/jira/browse/HDFS-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8249: - Attachment: HDFS-8249.002.patch Separate HdfsConstants into the client and the server side class

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520589#comment-14520589 ] Zhe Zhang commented on HDFS-7348: - Thanks for the discussion Yi and Bo. On the write path:

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520594#comment-14520594 ] Hadoop QA commented on HDFS-7281: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7342) Lease Recovery doesn't happen some times

[ https://issues.apache.org/jira/browse/HDFS-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520401#comment-14520401 ] Ravi Prakash commented on HDFS-7342: I found another\(?) instance in which the lease is

[jira] [Updated] (HDFS-7342) Lease Recovery doesn't happen some times

[ https://issues.apache.org/jira/browse/HDFS-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7342: --- Target Version/s: 2.8.0 (was: 2.6.1) Lease Recovery doesn't happen some times

[jira] [Created] (HDFS-8291) Modify NN WebUI to display correct unit

Zhongyi Xie created HDFS-8291: - Summary: Modify NN WebUI to display correct unit Key: HDFS-8291 URL: https://issues.apache.org/jira/browse/HDFS-8291 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongyi Xie updated HDFS-8291: -- Status: Open (was: Patch Available) Modify NN WebUI to display correct unit

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.003.patch Attaching new patch which based on Andrew's comments. # An

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520458#comment-14520458 ] Zhe Zhang commented on HDFS-8272: - The rest of the patch LGTM, +1 and thanks Jing for the

  1   2   >