[jira] [Created] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-13 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10287: - Summary: MiniDFSCluster should implement AutoCloseable Key: HDFS-10287 URL: https://issues.apache.org/jira/browse/HDFS-10287 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

2016-04-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240631#comment-15240631 ] Xiaoyu Yao commented on HDFS-10286: --- Patch looks good to me. +1 pending Jenkins. > Fix

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240630#comment-15240630 ] Xiaobing Zhou commented on HDFS-10209: -- I have posted v000 patch to HDFS-10286. > Support enable

[jira] [Updated] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

2016-04-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10286: - Attachment: HDFS-10286.000.patch I posted v000 patch, please kindly review, thanks. > Fix

[jira] [Updated] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

2016-04-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10286: - Status: Patch Available (was: Open) > Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties >

[jira] [Commented] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-13 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240618#comment-15240618 ] Jitendra Nath Pandey commented on HDFS-10281: - +1, pending jenkins. >

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240592#comment-15240592 ] Xiaoyu Yao commented on HDFS-10209: --- I opened HDFS-10286 and attached your patch to it. > Support

[jira] [Created] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

2016-04-13 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10286: - Summary: Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties Key: HDFS-10286 URL: https://issues.apache.org/jira/browse/HDFS-10286 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240588#comment-15240588 ] Xiaoyu Yao commented on HDFS-10209: --- [~xiaobingo], please open a separate ticket for the unit test fix

[jira] [Updated] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10209: - Attachment: HDFS-10209-HDFS-9000.UT-fix.patch > Support enable caller context in HDFS namenode

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240575#comment-15240575 ] Xiaobing Zhou commented on HDFS-10209: -- [~xyao] thanks for committing it. I just noticed that one of

[jira] [Commented] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240554#comment-15240554 ] Hadoop QA commented on HDFS-10232: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240544#comment-15240544 ] Hadoop QA commented on HDFS-9016: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi updated HDFS-9412: Attachment: HDFS-9412.0002.patch Fix codestyle, whitespace and unit test. > getBlocks occupies FSLock and

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240506#comment-15240506 ] Hadoop QA commented on HDFS-10216: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9670) DistCp throws NPE when source is root and target exists

2016-04-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9670: - Summary: DistCp throws NPE when source is root and target exists (was: DistCp throws NPE when source is

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-04-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240490#comment-15240490 ] John Zhuge commented on HDFS-9670: -- Source file system can also be different, e.g., {{s3a}}. > DistCp

[jira] [Work started] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-04-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9670 started by John Zhuge. > DistCp throws NPE when source is root "/" > - >

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-04-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240486#comment-15240486 ] John Zhuge commented on HDFS-9670: -- Reproduced test in different ways: * The target dir must exist. * The

[jira] [Updated] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10280: --- Status: Open (was: Patch Available) > Document new dfsadmin command -evictWriters >

[jira] [Updated] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10280: --- Status: Patch Available (was: Open) Jenkins seem to be stucked. Resubmit again. > Document

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-04-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240474#comment-15240474 ] Xiaobing Zhou commented on HDFS-9349: - [~arpitagarwal] is there any reason why this is not in trunk?

[jira] [Commented] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240471#comment-15240471 ] Hadoop QA commented on HDFS-10283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10285) Storage Policy Satisfier in Namenode

2016-04-13 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-10285: -- Summary: Storage Policy Satisfier in Namenode Key: HDFS-10285 URL: https://issues.apache.org/jira/browse/HDFS-10285 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240461#comment-15240461 ] John Zhuge commented on HDFS-10216: --- Very nice. Consider reviewed after 2 tiny updates: * Line 709 is

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240458#comment-15240458 ] Mingliang Liu commented on HDFS-10282: -- Failing test

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Attachment: HDFS-10284.000.patch For testing the safe mode state machine transition

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240455#comment-15240455 ] Walter Su commented on HDFS-9412: - Thank you for updating. The test {{TestGetBlocks}} failed. Do you mind

[jira] [Commented] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240439#comment-15240439 ] Mingliang Liu commented on HDFS-10284: -- I think it's due to mocking {{fsn}} while being concurrently

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Status: Open (was: Patch Available) > distcp -diff relative path exception >

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240438#comment-15240438 ] Takashi Ohnishi commented on HDFS-10216: Thank you, [~jzhuge] for helpful reviewing ! :) I have

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Attachment: HDFS-10216.3.patch > distcp -diff relative path exception >

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Description: *Stacktrace* {code} org.mockito.exceptions.misusing.UnfinishedStubbingException:

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Status: Patch Available (was: Open) > distcp -diff relative path exception >

[jira] [Updated] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10284: - Priority: Minor (was: Major) >

[jira] [Created] (HDFS-10284) o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10284: Summary: o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently Key: HDFS-10284 URL: https://issues.apache.org/jira/browse/HDFS-10284

[jira] [Commented] (HDFS-9772) TestBlockReplacement#testThrottler doesn't work as expected

2016-04-13 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240420#comment-15240420 ] Lin Yiqun commented on HDFS-9772: - Thanks [~walter.k.su] for commit! > TestBlockReplacement#testThrottler

[jira] [Commented] (HDFS-10279) Improve validation of the configured number of tolerated failed volumes

2016-04-13 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240418#comment-15240418 ] Lin Yiqun commented on HDFS-10279: -- Thanks [~andrew.wang] for commit! > Improve validation of the

[jira] [Updated] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10232: Attachment: HDFS-10232-HDFS-7240.002.patch [~arpitagarwal] Thanks for the review. I have fixed the

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Description: This will make it easy for people to use fsck to check block placement when upgrade domain is

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Display upgrade domain information in fsck >

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016.patch Here is the draft patch. Given there is no backward compatibility issue, it seems

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240296#comment-15240296 ] Hudson commented on HDFS-10209: --- SUCCESS: Integrated in Hadoop-trunk-Commit #9606 (See

[jira] [Commented] (HDFS-10279) Improve validation of the configured number of tolerated failed volumes

2016-04-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240295#comment-15240295 ] Hudson commented on HDFS-10279: --- SUCCESS: Integrated in Hadoop-trunk-Commit #9606 (See

[jira] [Updated] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10209: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved

[jira] [Updated] (HDFS-10279) Improve validation of the configured number of tolerated failed volumes

2016-04-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10279: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10279) Improve validation of the configured number of tolerated failed volumes

2016-04-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10279: --- Summary: Improve validation of the configured number of tolerated failed volumes (was: Improve the

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240245#comment-15240245 ] Hudson commented on HDFS-10209: --- FAILURE: Integrated in Hadoop-trunk-Commit #9605 (See

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240216#comment-15240216 ] Hadoop QA commented on HDFS-10208: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240202#comment-15240202 ] Hadoop QA commented on HDFS-10282: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240184#comment-15240184 ] Arpit Agarwal commented on HDFS-10232: -- bq. I wanted to differentiate the SCM keys from ozone keys.

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

2016-04-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240173#comment-15240173 ] Xiaoyu Yao commented on HDFS-10209: --- The test failure does not relate seem to relate to this patch. +1

[jira] [Commented] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240168#comment-15240168 ] Jing Zhao commented on HDFS-10283: -- +1 pending jenkins. >

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10281: - Status: Patch Available (was: Open) > o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages

[jira] [Updated] (HDFS-10281) o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10281: - Status: Open (was: Patch Available) > o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages

[jira] [Updated] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10283: - Attachment: HDFS-10283.000.patch A simple fix is to disable the replace-data-on-failure feature

[jira] [Updated] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10283: - Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240097#comment-15240097 ] Mingliang Liu commented on HDFS-10283: -- It happens in our internal daily UT Jenkins, and recent

[jira] [Created] (HDFS-10283) o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently

2016-04-13 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10283: Summary: o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently Key: HDFS-10283 URL:

[jira] [Commented] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239997#comment-15239997 ] Hadoop QA commented on HDFS-10232: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-04-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239955#comment-15239955 ] Jing Zhao commented on HDFS-9820: - Thanks again for working on this, Yongjun. Some comments: # Even without

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239952#comment-15239952 ] John Zhuge commented on HDFS-10216: --- Great job. Just minor nitpicks: * {{TestDistCpSync.java}} ## 683:

[jira] [Updated] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10282: Attachment: HDFS-10282.002.patch OK. The new revision makes the DirectoryScanner

[jira] [Updated] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10208: --- Attachment: HDFS-10208-5.patch Here is the updated patch. Thank you [~sjlee0] and [~brahmareddy]. > Addendum

[jira] [Commented] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239679#comment-15239679 ] Anu Engineer commented on HDFS-10232: - I wanted to differentiate the SCM keys from ozone keys. Do you

[jira] [Commented] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239670#comment-15239670 ] Arpit Agarwal commented on HDFS-10232: -- Some keys are still missing "ozone" as part of their name.

[jira] [Commented] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239660#comment-15239660 ] Arpit Agarwal commented on HDFS-10232: -- Hi Anu, IMO we don't need the DFS_ prefix for Ozone keys. >

[jira] [Updated] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10232: Attachment: HDFS-10232-HDFS-7240.001.patch > Ozone: Make config key naming consistent >

[jira] [Updated] (HDFS-10232) Ozone: Make config key naming consistent

2016-04-13 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10232: Status: Patch Available (was: Open) > Ozone: Make config key naming consistent >

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239642#comment-15239642 ] Hadoop QA commented on HDFS-9412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239606#comment-15239606 ] Brahma Reddy Battula commented on HDFS-10208: - LGTM,[~sjlee0] thanks for pinging me..

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-04-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239582#comment-15239582 ] Brahma Reddy Battula commented on HDFS-9530: anybody can review the attached patch..? > huge

[jira] [Commented] (HDFS-10270) TestJMXGet:testNameNode() fails

2016-04-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239566#comment-15239566 ] Hudson commented on HDFS-10270: --- FAILURE: Integrated in Hadoop-trunk-Commit #9603 (See

[jira] [Updated] (HDFS-10270) TestJMXGet:testNameNode() fails

2016-04-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10270: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-10270) TestJMXGet:testNameNode() fails

2016-04-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239532#comment-15239532 ] Kihwal Lee commented on HDFS-10270: --- bq. Do you see any disadvantages removing NumOpenConnections

[jira] [Commented] (HDFS-10270) TestJMXGet:testNameNode() fails

2016-04-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239525#comment-15239525 ] Kihwal Lee commented on HDFS-10270: --- bq. In addition playing with timeouts makes a JUnit test more

[jira] [Commented] (HDFS-6600) fsck -move fails in secured clusters.

2016-04-13 Thread Amitabha Karmakar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239420#comment-15239420 ] Amitabha Karmakar commented on HDFS-6600: - Hi, Did we do anything further with this patch ? Right

[jira] [Updated] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10247: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Datanode

[jira] [Commented] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239379#comment-15239379 ] James Clampffer commented on HDFS-10247: Thanks for the reviews and feedback Bob! I've committed

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239297#comment-15239297 ] Hadoop QA commented on HDFS-10216: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239291#comment-15239291 ] stack commented on HDFS-3702: - bq. Suppose we find that the CreateFlag.NO_LOCAL_WRITE is bad. How do we remove

[jira] [Commented] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-13 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239254#comment-15239254 ] Bob Hansen commented on HDFS-10247: --- Fair enough. +1 > libhdfs++: Datanode protocol version mismatch >

[jira] [Commented] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239244#comment-15239244 ] Kihwal Lee commented on HDFS-10280: --- +1 pending jenkins. > Document new dfsadmin command -evictWriters

[jira] [Updated] (HDFS-10280) Document new dfsadmin command -evictWriters

2016-04-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10280: -- Status: Patch Available (was: Open) > Document new dfsadmin command -evictWriters >

[jira] [Comment Edited] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239237#comment-15239237 ] Kihwal Lee edited comment on HDFS-10282 at 4/13/16 1:34 PM: Can you make the

[jira] [Commented] (HDFS-10270) TestJMXGet:testNameNode() fails

2016-04-13 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239238#comment-15239238 ] Andras Bokor commented on HDFS-10270: - In addition playing with timeouts makes a JUnit test more

[jira] [Commented] (HDFS-10282) The VolumeScanner should warn about replica files which are misplaced

2016-04-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239237#comment-15239237 ] Kihwal Lee commented on HDFS-10282: --- Can you make the equivalent log message in DirectoryScanner more

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Attachment: HDFS-10216.2.patch Attached the updated patch. I have added a unit test for

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Status: Patch Available (was: Open) > distcp -diff relative path exception >

[jira] [Updated] (HDFS-10216) distcp -diff relative path exception

2016-04-13 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated HDFS-10216: --- Status: Open (was: Patch Available) > distcp -diff relative path exception >

[jira] [Commented] (HDFS-10276) Different results for exist call for file.ext/name

2016-04-13 Thread Kevin Cox (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239233#comment-15239233 ] Kevin Cox commented on HDFS-10276: -- I have tested on two moderately recent versions of hadoop and the

[jira] [Commented] (HDFS-10270) TestJMXGet:testNameNode() fails

2016-04-13 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239217#comment-15239217 ] Andras Bokor commented on HDFS-10270: - Hi [~kihwal], We do not see the value to check

[jira] [Updated] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi updated HDFS-9412: Attachment: HDFS-9412.0001.patch Rebase against current trunk. > getBlocks occupies FSLock and takes too

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239103#comment-15239103 ] Walter Su commented on HDFS-9412: - One thread holding a readLock too long is very like holding a writeLock.

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239094#comment-15239094 ] Hadoop QA commented on HDFS-9412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9772) TestBlockReplacement#testThrottler doesn't work as expected

2016-04-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239018#comment-15239018 ] Hudson commented on HDFS-9772: -- FAILURE: Integrated in Hadoop-trunk-Commit #9602 (See

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-04-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239002#comment-15239002 ] Steve Loughran commented on HDFS-9525: -- I must have misread it -sorry. Looking forward to the kdiag

[jira] [Updated] (HDFS-9772) TestBlockReplacement#testThrottler doesn't work as expected

2016-04-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9772: Labels: test (was: ) Priority: Minor (was: Major) Issue Type: Test (was: Bug) >

[jira] [Updated] (HDFS-9772) TestBlockReplacement#testThrottler doesn't work as expected

2016-04-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9772: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved (was:

  1   2   >