[jira] [Updated] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8038: - Attachment: HDFS-8038.00.patch Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

[jira] [Updated] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8038: - Status: Patch Available (was: Open) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

[jira] [Updated] (HDFS-8037) WebHDFS: CheckAccess silently accepts certain malformed FsActions

2015-04-01 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8037: Attachment: HDFS-8037.001.patch WebHDFS: CheckAccess silently accepts certain malformed FsActions

[jira] [Updated] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8038: - Description: The test assumes Linux path format during verification. The file system path should be

[jira] [Commented] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-04-01 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390142#comment-14390142 ] Kai Sasaki commented on HDFS-7937: -- [~rakeshr] I didn't fully understand how to configure

[jira] [Resolved] (HDFS-7306) can't decommission w/under construction blocks

2015-04-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-7306. --- Resolution: Duplicate This should be resolved via HDFS-5579. can't decommission w/under construction blocks

[jira] [Commented] (HDFS-8037) WebHDFS: CheckAccess silently accepts certain malformed FsActions

2015-04-01 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390194#comment-14390194 ] Walter Su commented on HDFS-8037: - {{fsaction=r-w}} doesn't match POSIX style, but it

[jira] [Created] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8038: Summary: Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows Key: HDFS-8038 URL: https://issues.apache.org/jira/browse/HDFS-8038 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-8038: Assignee: Xiaoyu Yao Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390201#comment-14390201 ] Hadoop QA commented on HDFS-8035: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-04-01 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7937: - Attachment: HDFS-7937.4.patch Erasure Coding: INodeFile quota computation unit tests

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-04-01 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7937: - Status: In Progress (was: Patch Available) Erasure Coding: INodeFile quota computation unit tests

[jira] [Updated] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

2015-04-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7369: Fix Version/s: HDFS-7285 Erasure coding: distribute recovery work for striped blocks to DataNode

[jira] [Commented] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390341#comment-14390341 ] Hadoop QA commented on HDFS-8038: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8029) NPE during disk usage calculation on snapshot directory, after a sub folder is deleted

2015-04-01 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390484#comment-14390484 ] kanaka kumar avvaru commented on HDFS-8029: --- [~xyao] , the steps are same as

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390480#comment-14390480 ] Yi Liu commented on HDFS-7916: -- Thanks Vinay for the patch, it looks good, one comment, +1

[jira] [Commented] (HDFS-7671) hdfs user guide should point to the common rack awareness doc

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390444#comment-14390444 ] Hudson commented on HDFS-7671: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See

[jira] [Commented] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390445#comment-14390445 ] Hudson commented on HDFS-7997: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390439#comment-14390439 ] Hudson commented on HDFS-6945: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See

[jira] [Updated] (HDFS-8037) WebHDFS: CheckAccess silently accepts certain malformed FsActions

2015-04-01 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8037: Status: Patch Available (was: Open) WebHDFS: CheckAccess silently accepts certain malformed FsActions

[jira] [Commented] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390433#comment-14390433 ] Hudson commented on HDFS-7997: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390427#comment-14390427 ] Hudson commented on HDFS-6945: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See

[jira] [Commented] (HDFS-7671) hdfs user guide should point to the common rack awareness doc

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390432#comment-14390432 ] Hudson commented on HDFS-7671: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See

[jira] [Updated] (HDFS-8021) Erasure Coding: restore BlockGroup and schema info from non-stripping coding command

2015-04-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8021: Parent Issue: HDFS-8030 (was: HDFS-7285) Erasure Coding: restore BlockGroup and schema info from

[jira] [Updated] (HDFS-8013) Erasure coding: distribute recovery work for non-stripping erasure coding blocks to DataNode

2015-04-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8013: Parent Issue: HDFS-8030 (was: HDFS-7285) Erasure coding: distribute recovery work for non-stripping

[jira] [Updated] (HDFS-8013) Erasure coding: distribute recovery work for non-stripping erasure coding blocks to DataNode

2015-04-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8013: Summary: Erasure coding: distribute recovery work for non-stripping erasure coding blocks to DataNode (was:

[jira] [Commented] (HDFS-6634) inotify in HDFS

2015-04-01 Thread Benoit Perroud (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390537#comment-14390537 ] Benoit Perroud commented on HDFS-6634: -- [~cmccabe] you probably meant {{EventList}}.

[jira] [Updated] (HDFS-8013) Erasure coding: distribute recovery work for erasure coding blocks to DataNode

2015-04-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8013: Description: Similar to HDFS-7369, for *non-stripping* erasure coding, NameNode may detect some erasure

[jira] [Updated] (HDFS-8018) Erasure Coding: on-demand erasure recovery for erased data serving client request in DataNode

2015-04-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8018: Parent Issue: HDFS-8030 (was: HDFS-7285) Erasure Coding: on-demand erasure recovery for erased data

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390582#comment-14390582 ] Rushabh S Shah commented on HDFS-7916: -- [~hitliuyi]: This standby exception is thrown

[jira] [Commented] (HDFS-8037) WebHDFS: CheckAccess silently accepts certain malformed FsActions

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390614#comment-14390614 ] Hadoop QA commented on HDFS-8037: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390619#comment-14390619 ] Hudson commented on HDFS-6945: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390626#comment-14390626 ] Hudson commented on HDFS-7997: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (HDFS-7671) hdfs user guide should point to the common rack awareness doc

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390625#comment-14390625 ] Hudson commented on HDFS-7671: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390642#comment-14390642 ] Hudson commented on HDFS-7997: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390635#comment-14390635 ] Hudson commented on HDFS-6945: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (HDFS-7671) hdfs user guide should point to the common rack awareness doc

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390641#comment-14390641 ] Hudson commented on HDFS-7671: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390657#comment-14390657 ] Hudson commented on HDFS-6945: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Commented] (HDFS-7671) hdfs user guide should point to the common rack awareness doc

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390663#comment-14390663 ] Hudson commented on HDFS-7671: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Commented] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390664#comment-14390664 ] Hudson commented on HDFS-7997: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Resolved] (HDFS-8029) NPE during disk usage calculation on snapshot directory, after a sub folder is deleted

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-8029. -- Resolution: Fixed Thanks [~kanaka] for the confirmation! I'm resolving this as Fixed by HDFS-7824. NPE

[jira] [Updated] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8039: - Attachment: HDFS-8039.00.patch Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on

[jira] [Updated] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8039: - Status: Patch Available (was: Open) Fix TestDebugAdmin#testRecoverLease and

[jira] [Created] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-01 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8039: Summary: Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows Key: HDFS-8039 URL: https://issues.apache.org/jira/browse/HDFS-8039 Project:

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390812#comment-14390812 ] Hadoop QA commented on HDFS-7916: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390751#comment-14390751 ] Vinayakumar B commented on HDFS-7916: - Yes. [~shahrs87] is right. I had already checked

[jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout

2015-04-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7782: Attachment: HDFS-7782-005.patch 005 patch implements pread (non-hedged). It also moves 2 utility functions

[jira] [Updated] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8036: - Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) I've

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391797#comment-14391797 ] Hudson commented on HDFS-7922: -- FAILURE: Integrated in Hadoop-trunk-Commit #7489 (See

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7888: Attachment: HDFS-7888-trunk-004.patch Thanks Nicholas for the review! Rebased to resolve conflict with

[jira] [Commented] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391849#comment-14391849 ] Brandon Li commented on HDFS-8001: -- I've committed the patch. Thank you, [~rcatherinot]

[jira] [Commented] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391924#comment-14391924 ] Hadoop QA commented on HDFS-7996: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392081#comment-14392081 ] Hadoop QA commented on HDFS-8041: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7622) Erasure Coding: handling file truncation

2015-04-01 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392106#comment-14392106 ] Takuya Fukudome commented on HDFS-7622: --- Hi [~jingzhao], I want to work on this

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391707#comment-14391707 ] Colin Patrick McCabe commented on HDFS-7922: Hi [~rakeshr], I agree that the

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391748#comment-14391748 ] Jing Zhao commented on HDFS-7811: - Thanks for updating the patch, Xiaoyu! The patch looks

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8041: - Attachment: HDFS-8041.v1.patch Consider remaining space during block blockplacement if dfs space is

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Bhat updated HDFS-: - Attachment: HDFS-.001.patch Abort NameNode and DataNode startup if security is enabled but block

[jira] [Updated] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-8001: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-8001: - Fix Version/s: 2.7.0 RpcProgramNfs3 : wrong parsing of dfs.blocksize

[jira] [Updated] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8035: - Attachment: HDFS-8035.003.patch Move checking replication and get client DN to BM and DM respectively

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392044#comment-14392044 ] Hudson commented on HDFS-7916: -- FAILURE: Integrated in Hadoop-trunk-Commit #7492 (See

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392189#comment-14392189 ] Jing Zhao commented on HDFS-8035: - +1 for the latest patch. You may need to update the jira

[jira] [Resolved] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-8040. Resolution: Not a Problem Able to move encryption zone to Trash

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Attachment: HDFS-7811.02.patch I did some simple cleanup based on the current 01 patch. Please see if it's

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391932#comment-14391932 ] Li Bo commented on HDFS-7888: - The changes also look good to me. Thanks for the review of Zhe,

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391991#comment-14391991 ] Hadoop QA commented on HDFS-6481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392099#comment-14392099 ] Takuya Fukudome commented on HDFS-7619: --- Thank you, Jing! I want to work on

[jira] [Updated] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8026: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7916: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391955#comment-14391955 ] Hudson commented on HDFS-8036: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7490 (See

[jira] [Commented] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391954#comment-14391954 ] Hudson commented on HDFS-8001: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7490 (See

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391952#comment-14391952 ] Hudson commented on HDFS-8008: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7490 (See

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392029#comment-14392029 ] Jing Zhao commented on HDFS-7619: - Yes, you're right. I will move the jira to HDFS-8031.

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392071#comment-14392071 ] Hadoop QA commented on HDFS-7811: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392181#comment-14392181 ] Hadoop QA commented on HDFS-8035: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391705#comment-14391705 ] Xiaoyu Yao commented on HDFS-8040: -- Thanks [~clamb] for the explanation. That makes more

[jira] [Assigned] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-8041: Assignee: Kihwal Lee Consider remaining space during block blockplacement if dfs space is highly

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Bhat updated HDFS-: - Target Version/s: 2.6.0, 3.0.0 (was: 3.0.0, 2.6.0) Release Note: The patch has the following

[jira] [Created] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-8041: Summary: Consider remaining space during block blockplacement if dfs space is highly utilized Key: HDFS-8041 URL: https://issues.apache.org/jira/browse/HDFS-8041 Project:

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7888: -- Component/s: hdfs-client Priority: Minor (was: Major) Hadoop Flags:

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391939#comment-14391939 ] Hadoop QA commented on HDFS-8008: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6634) inotify in HDFS

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391733#comment-14391733 ] Colin Patrick McCabe commented on HDFS-6634: Hi [~bperroud], HDFS-7446 changed

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391839#comment-14391839 ] Yi Liu commented on HDFS-7916: -- +1 'reportBadBlocks' from datanodes to standby Node

[jira] [Updated] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7619: Parent Issue: HDFS-8031 (was: HDFS-7285) Erasure Coding: Handling files in snapshots

[jira] [Commented] (HDFS-7622) Erasure Coding: handling file truncation

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392127#comment-14392127 ] Jing Zhao commented on HDFS-7622: - Sure. Thanks for working on this. Erasure Coding:

[jira] [Updated] (HDFS-7622) Erasure Coding: handling file truncation

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7622: Assignee: Takuya Fukudome (was: Jing Zhao) Erasure Coding: handling file truncation

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391814#comment-14391814 ] Tsz Wo Nicholas Sze commented on HDFS-7888: --- Unfortunately, the patch does not

[jira] [Updated] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8008: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391820#comment-14391820 ] Colin Patrick McCabe commented on HDFS-8026: I'm not sure if there is an open

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391810#comment-14391810 ] Colin Patrick McCabe commented on HDFS-7979: Unfortunately, this latest patch

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391935#comment-14391935 ] Hadoop QA commented on HDFS-: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391986#comment-14391986 ] Takuya Fukudome commented on HDFS-7619: --- Hi [~jingzhao], If my understanding is

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391982#comment-14391982 ] Brahma Reddy Battula commented on HDFS-7060: Thanks a lot for taking look into

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392110#comment-14392110 ] Hadoop QA commented on HDFS-7888: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6634) inotify in HDFS

2015-04-01 Thread Benoit Perroud (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392159#comment-14392159 ] Benoit Perroud commented on HDFS-6634: -- Hi [~cmccabe] Cool, HDFS-7446 is exactly what

[jira] [Updated] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7922: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8041: - Status: Patch Available (was: Open) Consider remaining space during block blockplacement if dfs space is

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391750#comment-14391750 ] Vijay Bhat commented on HDFS-: -- [~cnauroth] - great suggestion Chris, thanks! I

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391822#comment-14391822 ] Hadoop QA commented on HDFS-7523: - {color:red}-1 overall{color}. Here are the results of

  1   2   >