[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845193#comment-13845193 ] Hudson commented on HDFS-5580: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4863 (See

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

2013-12-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845204#comment-13845204 ] Junping Du commented on HDFS-5580: -- +1. I have commit this to trunk and branch-2. Thanks

[jira] [Updated] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

2013-12-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5580: - Resolution: Fixed Fix Version/s: 2.4.0 Target Version/s: 2.4.0 Status:

[jira] [Commented] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

2013-12-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845218#comment-13845218 ] Liang Xie commented on HDFS-4273: - {code} - seekToNewSource() add currentNode to

[jira] [Commented] (HDFS-4874) create with OVERWRITE deletes existing file without checking the lease: feature or a bug.

2013-12-11 Thread amol khatri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845244#comment-13845244 ] amol khatri commented on HDFS-4874: --- What will happen in case, 2 clients trying to create

[jira] [Resolved] (HDFS-5646) Exceptions during HDFS failover

2013-12-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-5646. -- Resolution: Fixed HI, I'm afraid you are going to have to take this up with cloudera -if there

[jira] [Commented] (HDFS-5074) Allow starting up from an fsimage checkpoint in the middle of a segment

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845300#comment-13845300 ] Hudson commented on HDFS-5074: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5283) NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845289#comment-13845289 ] Hudson commented on HDFS-5283: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5504) In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845293#comment-13845293 ] Hudson commented on HDFS-5504: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5425) Renaming underconstruction file with snapshots can make NN failure on restart

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845296#comment-13845296 ] Hudson commented on HDFS-5425: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5476) Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845295#comment-13845295 ] Hudson commented on HDFS-5476: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845291#comment-13845291 ] Hudson commented on HDFS-5580: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845292#comment-13845292 ] Hudson commented on HDFS-5428: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5257) addBlock() retry should return LocatedBlock with locations else client will get AIOBE

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845298#comment-13845298 ] Hudson commented on HDFS-5257: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5443) Delete 0-sized block when deleting an under-construction file that is included in snapshot

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845297#comment-13845297 ] Hudson commented on HDFS-5443: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5427) not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845290#comment-13845290 ] Hudson commented on HDFS-5427: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-5474) Deletesnapshot can make Namenode in safemode on NN restarts.

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845294#comment-13845294 ] Hudson commented on HDFS-5474: -- FAILURE: Integrated in Hadoop-Yarn-trunk #418 (See

[jira] [Commented] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

2013-12-11 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845308#comment-13845308 ] Binglin Chang commented on HDFS-4273: - seekToNewSource, not seekToBlockSource Problem

[jira] [Commented] (HDFS-5257) addBlock() retry should return LocatedBlock with locations else client will get AIOBE

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845394#comment-13845394 ] Hudson commented on HDFS-5257: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5425) Renaming underconstruction file with snapshots can make NN failure on restart

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845392#comment-13845392 ] Hudson commented on HDFS-5425: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5427) not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845386#comment-13845386 ] Hudson commented on HDFS-5427: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845387#comment-13845387 ] Hudson commented on HDFS-5580: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5476) Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845391#comment-13845391 ] Hudson commented on HDFS-5476: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5443) Delete 0-sized block when deleting an under-construction file that is included in snapshot

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845393#comment-13845393 ] Hudson commented on HDFS-5443: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5074) Allow starting up from an fsimage checkpoint in the middle of a segment

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845396#comment-13845396 ] Hudson commented on HDFS-5074: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5504) In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845389#comment-13845389 ] Hudson commented on HDFS-5504: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5283) NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845385#comment-13845385 ] Hudson commented on HDFS-5283: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845388#comment-13845388 ] Hudson commented on HDFS-5428: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5474) Deletesnapshot can make Namenode in safemode on NN restarts.

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845390#comment-13845390 ] Hudson commented on HDFS-5474: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1609 (See

[jira] [Commented] (HDFS-5504) In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845444#comment-13845444 ] Hudson commented on HDFS-5504: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5427) not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845441#comment-13845441 ] Hudson commented on HDFS-5427: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5283) NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845440#comment-13845440 ] Hudson commented on HDFS-5283: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5257) addBlock() retry should return LocatedBlock with locations else client will get AIOBE

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845449#comment-13845449 ] Hudson commented on HDFS-5257: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5476) Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845446#comment-13845446 ] Hudson commented on HDFS-5476: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5474) Deletesnapshot can make Namenode in safemode on NN restarts.

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845445#comment-13845445 ] Hudson commented on HDFS-5474: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5074) Allow starting up from an fsimage checkpoint in the middle of a segment

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845451#comment-13845451 ] Hudson commented on HDFS-5074: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5425) Renaming underconstruction file with snapshots can make NN failure on restart

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845447#comment-13845447 ] Hudson commented on HDFS-5425: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845443#comment-13845443 ] Hudson commented on HDFS-5428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5443) Delete 0-sized block when deleting an under-construction file that is included in snapshot

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845448#comment-13845448 ] Hudson commented on HDFS-5443: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Commented] (HDFS-5580) Infinite loop in Balancer.waitForMoveCompletion

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845442#comment-13845442 ] Hudson commented on HDFS-5580: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1635 (See

[jira] [Resolved] (HDFS-4331) checkpoint between NN and SNN (secure cluster) does not happen once NN TGT expires

2013-12-11 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony resolved HDFS-4331. Resolution: Duplicate Release Note: Code already in place checkpoint between NN and SNN

[jira] [Commented] (HDFS-5496) Make replication queue initialization asynchronous

2013-12-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845529#comment-13845529 ] Kihwal Lee commented on HDFS-5496: -- It will be nice if the web UI says something if the

[jira] [Updated] (HDFS-5496) Make replication queue initialization asynchronous

2013-12-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5496: - Assignee: Vinay Make replication queue initialization asynchronous

[jira] [Created] (HDFS-5654) Add lock context support to FSNamesystemLock

2013-12-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5654: - Summary: Add lock context support to FSNamesystemLock Key: HDFS-5654 URL: https://issues.apache.org/jira/browse/HDFS-5654 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-5655) Update FSNamesystem path operations to use a lock context

2013-12-11 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5655: - Summary: Update FSNamesystem path operations to use a lock context Key: HDFS-5655 URL: https://issues.apache.org/jira/browse/HDFS-5655 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-5654) Add lock context support to FSNamesystemLock

2013-12-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-5654: -- Attachment: HDFS-5654.patch Adds an interface for a lock context to {{FSNameSystemLock}}, and provides

[jira] [Updated] (HDFS-5654) Add lock context support to FSNamesystemLock

2013-12-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-5654: -- Status: Patch Available (was: Open) Add lock context support to FSNamesystemLock

[jira] [Commented] (HDFS-5023) TestSnapshotPathINodes.testAllowSnapshot is failing in branch-2

2013-12-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845567#comment-13845567 ] Jonathan Eagles commented on HDFS-5023: --- +1. Jing. If I don't hear anything on this

[jira] [Commented] (HDFS-5496) Make replication queue initialization asynchronous

2013-12-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845580#comment-13845580 ] Kihwal Lee commented on HDFS-5496: -- The following change would have been fine if leaving

[jira] [Commented] (HDFS-5023) TestSnapshotPathINodes.testAllowSnapshot is failing in branch-2

2013-12-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845591#comment-13845591 ] Jing Zhao commented on HDFS-5023: - +1. Thanks Mit!

[jira] [Updated] (HDFS-5350) Name Node should report fsimage transfer time as a metric

2013-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5350: -- Priority: Minor (was: Major) Name Node should report fsimage transfer time as a metric

[jira] [Updated] (HDFS-5647) Merge INodeDirectory.Feature and INodeFile.Feature

2013-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5647: - Attachment: HDFS-5647.003.patch Merge INodeDirectory.Feature and INodeFile.Feature

[jira] [Updated] (HDFS-5650) Remove AclReadFlag and AclWriteFlag in FileSystem API

2013-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5650: - Attachment: HDFS-5650.005.patch Thanks for the comments! Uploading the v5 patch to address the comments

[jira] [Commented] (HDFS-5654) Add lock context support to FSNamesystemLock

2013-12-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845671#comment-13845671 ] Hadoop QA commented on HDFS-5654: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5242) Reduce contention on DatanodeInfo instances

2013-12-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845675#comment-13845675 ] Kihwal Lee commented on HDFS-5242: -- +1 for the patch. However, the contention might have

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845687#comment-13845687 ] Colin Patrick McCabe commented on HDFS-5634: bq. Do we mean to

[jira] [Created] (HDFS-5656) add some configuration keys to hdfs-default.xml

2013-12-11 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5656: -- Summary: add some configuration keys to hdfs-default.xml Key: HDFS-5656 URL: https://issues.apache.org/jira/browse/HDFS-5656 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845689#comment-13845689 ] Colin Patrick McCabe commented on HDFS-5634: update: there are a bunch of

[jira] [Resolved] (HDFS-5650) Remove AclReadFlag and AclWriteFlag in FileSystem API

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5650. - Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) Hadoop Flags: Reviewed +1 for

[jira] [Updated] (HDFS-5650) Remove AclReadFlag and AclWriteFlag in FileSystem API

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5650: Target Version/s: HDFS ACLs (HDFS-4685) Affects Version/s: HDFS ACLs (HDFS-4685) Remove

[jira] [Commented] (HDFS-5650) Remove AclReadFlag and AclWriteFlag in FileSystem API

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845718#comment-13845718 ] Chris Nauroth commented on HDFS-5650: - I have one more note on part of the change here.

[jira] [Updated] (HDFS-5477) Block manager as a service

2013-12-11 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated HDFS-5477: - Attachment: Proposal.pdf Fix formatting problems in PDF. Block manager as a service

[jira] [Updated] (HDFS-5023) TestSnapshotPathINodes.testAllowSnapshot is failing in branch-2

2013-12-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-5023: -- Affects Version/s: 3.0.0 TestSnapshotPathINodes.testAllowSnapshot is failing in branch-2

[jira] [Updated] (HDFS-5023) TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7

2013-12-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-5023: -- Summary: TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7 (was:

[jira] [Updated] (HDFS-5023) TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7

2013-12-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-5023: -- Labels: java7 test (was: test) TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7

[jira] [Updated] (HDFS-5023) TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7

2013-12-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-5023: -- Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 Status:

[jira] [Commented] (HDFS-5023) TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845738#comment-13845738 ] Hudson commented on HDFS-5023: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4868 (See

[jira] [Resolved] (HDFS-5607) libHDFS: add support for recursive flag in ACL functions.

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5607. - Resolution: Fixed I'm resolving this as won't fix. This is no longer relevant after the API

[jira] [Resolved] (HDFS-5599) DistributedFileSystem: add support for recursive flag in ACL methods.

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5599. - Resolution: Won't Fix I'm resolving this as won't fix. This is no longer relevant after the API

[jira] [Reopened] (HDFS-5607) libHDFS: add support for recursive flag in ACL functions.

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-5607: - libHDFS: add support for recursive flag in ACL functions.

[jira] [Resolved] (HDFS-5611) WebHDFS: add support for recursive flag in ACL operations.

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5611. - Resolution: Won't Fix I'm resolving this as won't fix. This is no longer relevant after the API

[jira] [Resolved] (HDFS-5607) libHDFS: add support for recursive flag in ACL functions.

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5607. - Resolution: Won't Fix libHDFS: add support for recursive flag in ACL functions.

[jira] [Updated] (HDFS-4201) NPE in BPServiceActor#sendHeartBeat

2013-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4201: --- Resolution: Fixed Fix Version/s: (was: 3.0.0)

[jira] [Commented] (HDFS-5647) Merge INodeDirectory.Feature and INodeFile.Feature

2013-12-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845746#comment-13845746 ] Hadoop QA commented on HDFS-5647: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5596) Implement RPC stubs

2013-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5596: - Summary: Implement RPC stubs (was: DistributedFileSystem: implement getAcls and setAcl.) Implement RPC

[jira] [Commented] (HDFS-4201) NPE in BPServiceActor#sendHeartBeat

2013-12-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845747#comment-13845747 ] Hudson commented on HDFS-4201: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4869 (See

[jira] [Updated] (HDFS-5596) Implement RPC stubs

2013-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5596: - Description: Implement RPC stubs for both {{DistributedFileSystem}} and {{NameNodeRpcServer}}. (was:

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845751#comment-13845751 ] Colin Patrick McCabe commented on HDFS-5634: bq. DirectBufferPool, would it be

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Attachment: HDFS-5634.003.patch allow BlockReaderLocal to switch between

[jira] [Updated] (HDFS-5596) Implement RPC stubs

2013-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5596: - Attachment: HDFS-5596.000.patch Implement RPC stubs --- Key:

[jira] [Resolved] (HDFS-5597) DistributedFileSystem: implement modifyAclEntries, removeAclEntries and removeAcl.

2013-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-5597. -- Resolution: Duplicate Assignee: Haohui Mai This jira is implemented within the scope of

[jira] [Commented] (HDFS-5431) support cachepool-based limit management in path-based caching

2013-12-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845756#comment-13845756 ] Andrew Wang commented on HDFS-5431: --- The checkLimit flag makes sense to me, except I'd

[jira] [Resolved] (HDFS-5598) DistributedFileSystem: implement removeDefaultAcl.

2013-12-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-5598. -- Resolution: Duplicate Assignee: Haohui Mai This jira is implemented within the scope of

[jira] [Created] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-11 Thread Brandon Li (JIRA)
Brandon Li created HDFS-5657: Summary: race condition causes writeback state error in NFS gateway Key: HDFS-5657 URL: https://issues.apache.org/jira/browse/HDFS-5657 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5658) Implement ACL as a INode feature

2013-12-11 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5658: Summary: Implement ACL as a INode feature Key: HDFS-5658 URL: https://issues.apache.org/jira/browse/HDFS-5658 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-11 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845769#comment-13845769 ] Brandon Li commented on HDFS-5657: -- Here is how the race happens: {noformat} /**

[jira] [Updated] (HDFS-5350) Name Node should report fsimage transfer time as a metric

2013-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5350: -- Attachment: trunk-5350.patch Attached a patch that added metrics for fsimage downloaded/uploaded.

[jira] [Updated] (HDFS-5350) Name Node should report fsimage transfer time as a metric

2013-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HDFS-5350: -- Fix Version/s: 3.0.0 Status: Patch Available (was: Open) Name Node should report fsimage

[jira] [Commented] (HDFS-5350) Name Node should report fsimage transfer time as a metric

2013-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845805#comment-13845805 ] Jimmy Xiang commented on HDFS-5350: --- I tested the patch on my cluster. Here is the new

[jira] [Updated] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5634: --- Attachment: HDFS-5634.004.patch I optimized the CPU consumption a bit by caching the

[jira] [Updated] (HDFS-5648) Get rid of perVolumeReplicaMap

2013-12-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5648: Attachment: h5648.08.patch Updated patch fixes an unrelated bug exposed by the earlier patch.

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-12-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Attachment: h2832_20131211.patch Enable support for heterogeneous storages in HDFS

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845879#comment-13845879 ] Hadoop QA commented on HDFS-5634: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5596) Implement RPC stubs

2013-12-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845915#comment-13845915 ] Chris Nauroth commented on HDFS-5596: - Nice work, Haohui. A few comments: #

[jira] [Commented] (HDFS-5350) Name Node should report fsimage transfer time as a metric

2013-12-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845961#comment-13845961 ] Hadoop QA commented on HDFS-5350: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5634) allow BlockReaderLocal to switch between checksumming and not

2013-12-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845977#comment-13845977 ] Hadoop QA commented on HDFS-5634: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-12-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845992#comment-13845992 ] Hadoop QA commented on HDFS-2832: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-11 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5657: - Attachment: HDFS-5657.001.patch race condition causes writeback state error in NFS gateway

[jira] [Updated] (HDFS-5657) race condition causes writeback state error in NFS gateway

2013-12-11 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5657: - Status: Patch Available (was: Open) race condition causes writeback state error in NFS gateway

[jira] [Commented] (HDFS-4273) Problem in DFSInputStream read retry logic may cause early failure

2013-12-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846002#comment-13846002 ] Liang Xie commented on HDFS-4273: - Oh, my stupid:) Problem in DFSInputStream read retry

  1   2   >