[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623699#comment-15623699 ] Hadoop QA commented on HDFS-11065: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623810#comment-15623810 ] Xiao Chen edited comment on HDFS-9668 at 10/31/16 11:45 PM: Thanks

[jira] [Reopened] (HDFS-7964) Add support for async edit logging

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-7964: - I think this'd be a very useful addition to branch-2.8 and branch-2.7. Especially since the patch has been

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11065: - Attachment: HDFS-11065.000.patch > Add space quota tests for heterogenous storages >

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11065: - Status: Patch Available (was: Open) > Add space quota tests for heterogenous storages >

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623774#comment-15623774 ] Zhe Zhang commented on HDFS-7964: - The findbug warning is addressed by HDFS-10485. Reported {{TestEditLog}}

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11065: - Description: There are some cases of space quota that need to be tested for heterogenous

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623710#comment-15623710 ] Hadoop QA commented on HDFS-7964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7964: Fix Version/s: 2.8.0 > Add support for async edit logging > -- > >

[jira] [Commented] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623795#comment-15623795 ] Hudson commented on HDFS-11030: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10738 (See

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11065: - Attachment: HDFS-11065.000.patch > Add space quota tests for heterogenous storages >

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11065: - Attachment: (was: HDFS-11065.000.patch) > Add space quota tests for heterogenous storages >

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623673#comment-15623673 ] Xiao Chen commented on HDFS-10756: -- Thank you for the new patch, [~yuanbo]. bq. Hoping we can add

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623700#comment-15623700 ] Mingliang Liu commented on HDFS-11065: -- The patch looks good to me overall. +1 pending on Jenkins

[jira] [Updated] (HDFS-10485) Fix findbugs warning in FSEditLog.java

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10485: - Fix Version/s: 2.8.0 > Fix findbugs warning in FSEditLog.java > -- >

[jira] [Commented] (HDFS-10485) Fix findbugs warning in FSEditLog.java

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623782#comment-15623782 ] Zhe Zhang commented on HDFS-10485: -- Thanks for the work Akira. I just backported to branch-2.8 > Fix

[jira] [Commented] (HDFS-10722) Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623785#comment-15623785 ] Zhe Zhang commented on HDFS-10722: -- Thanks for the work Daryn. I just backported to branch-2.8. > Fix

[jira] [Updated] (HDFS-10722) Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10722: - Fix Version/s: 2.8 > Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs >

[jira] [Commented] (HDFS-10997) Reduce number of path resolving methods

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623349#comment-15623349 ] Hadoop QA commented on HDFS-10997: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7964: Attachment: HDFS-7964-branch-2.8.0.patch > Add support for async edit logging >

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7964: Status: Patch Available (was: Reopened) > Add support for async edit logging >

[jira] [Created] (HDFS-11077) RequestHedgingProxyProvider does not behave correctly with more than 3+ NameNodes

2016-10-31 Thread Sean Mackrory (JIRA)
Sean Mackrory created HDFS-11077: Summary: RequestHedgingProxyProvider does not behave correctly with more than 3+ NameNodes Key: HDFS-11077 URL: https://issues.apache.org/jira/browse/HDFS-11077

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-31 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623489#comment-15623489 ] Jitendra Nath Pandey commented on HDFS-11031: - [~brahmareddy], thanks for reviewing this,

[jira] [Updated] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8709: Fix Version/s: 2.7.4 > Clarify automatic sync in FSEditLog#logEdit >

[jira] [Commented] (HDFS-8709) Clarify automatic sync in FSEditLog#logEdit

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623587#comment-15623587 ] Zhe Zhang commented on HDFS-8709: - Thanks Andrew for the work. I just backported to branch-2.7. It's a

[jira] [Assigned] (HDFS-10802) [SPS]: Add satisfyStoragePolicy API in HdfsAdmin

2016-10-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G reassigned HDFS-10802: -- Assignee: Yuanbo Liu (was: Uma Maheswara Rao G) Hi [~yuanbo], Thank you for

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623682#comment-15623682 ] Hadoop QA commented on HDFS-11065: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10722) Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623801#comment-15623801 ] Zhe Zhang commented on HDFS-10722: -- My bad, after pushing to branch-2.8 I found the JIRA was committed to

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-10-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623810#comment-15623810 ] Xiao Chen commented on HDFS-9668: - Thanks [~jingcheng...@intel.com] for working on this. I'm trying to

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623458#comment-15623458 ] Mingliang Liu commented on HDFS-11065: -- The description is a very detailed list. Thanks for updating

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623459#comment-15623459 ] Xiaobing Zhou commented on HDFS-11065: -- I re-worded the desc, thanks [~liuml07] for reminding me. I

[jira] [Commented] (HDFS-11076) Add unit test for extended Acls

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623551#comment-15623551 ] Hadoop QA commented on HDFS-11076: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-31 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623509#comment-15623509 ] Jitendra Nath Pandey commented on HDFS-11030: - +1. Thanks for the patch [~liuml07] >

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623755#comment-15623755 ] Andrew Wang commented on HDFS-10756: Thanks for the ping, and sorry I missed the earlier one. Yea, I

[jira] [Updated] (HDFS-10722) Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs

2016-10-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10722: - Fix Version/s: (was: 2.8) > Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs >

[jira] [Commented] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624064#comment-15624064 ] Hadoop QA commented on HDFS-10499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-10-31 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624081#comment-15624081 ] Jingcheng Du edited comment on HDFS-9668 at 11/1/16 2:20 AM: - Thanks for

[jira] [Updated] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-10-31 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10756: -- Attachment: HDFS-10756.006.patch > Expose getTrashRoot to HTTPFS and WebHDFS >

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-10-31 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624253#comment-15624253 ] Yuanbo Liu commented on HDFS-10756: --- [~xiaochen] Thanks for your comments. Upload v6 patch. 1. Revert

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624265#comment-15624265 ] Rakesh R commented on HDFS-10885: - Thanks [~zhouwei] for the patch. I've few comments, please take a look

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11065: - Attachment: HDFS-11065.001.patch > Add space quota tests for heterogenous storages >

[jira] [Commented] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-10-31 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623836#comment-15623836 ] Inigo Goiri commented on HDFS-11078: After applying HDFS-9555, this is not that critical but still it

[jira] [Updated] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10633: - Attachment: HDFS-10633.005.patch Rebase the code and post a new patch for this. Pending jenkins. >

[jira] [Assigned] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-10499: Assignee: Yiqun Lin (was: Anu Engineer) > Intermittent test failure >

[jira] [Commented] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-10-31 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624048#comment-15624048 ] Inigo Goiri commented on HDFS-11078: There are no other tests related to the scrubber from what I can

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-10-31 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624081#comment-15624081 ] Jingcheng Du commented on HDFS-9668: Thanks for comments [~xiaochen]! bq. Why AutoCloeableLock#isLocked

[jira] [Commented] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624398#comment-15624398 ] Brahma Reddy Battula commented on HDFS-10499: - [~linyiqun] thanks for working on this. you

[jira] [Updated] (HDFS-10455) Logging the username when deny the setOwner operation

2016-10-31 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10455: Resolution: Fixed Fix Version/s: 3.0.0-alpha2

[jira] [Created] (HDFS-11079) Accelerate TestQuotaByStorageType using shared MiniDFSCluster

2016-10-31 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11079: Summary: Accelerate TestQuotaByStorageType using shared MiniDFSCluster Key: HDFS-11079 URL: https://issues.apache.org/jira/browse/HDFS-11079 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-10-31 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11078: --- Attachment: HDFS-11078.000.patch Checking if the block is not in the system anymore in the

[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-10-31 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11078: --- Status: Patch Available (was: Open) > NPE in LazyPersistFileScrubber >

[jira] [Updated] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10499: - Attachment: (was: HDFS-10499.001.patch) > Intermittent test failure >

[jira] [Updated] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10499: - Attachment: HDFS-10499.001.patch > Intermittent test failure >

[jira] [Commented] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624306#comment-15624306 ] Hadoop QA commented on HDFS-10499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10499: - Status: Patch Available (was: Open) > Intermittent test failure >

[jira] [Updated] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10499: - Attachment: HDFS-10499.001.patch Thanks [~anu]. Attach a initial patch for this. This test has been

[jira] [Commented] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624029#comment-15624029 ] Hadoop QA commented on HDFS-11078: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-31 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624379#comment-15624379 ] Brahma Reddy Battula commented on HDFS-11031: - [~jnp] thanks for reply.. [~liuml07] can you

[jira] [Comment Edited] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624265#comment-15624265 ] Rakesh R edited comment on HDFS-10885 at 11/1/16 5:06 AM: -- Thanks [~zhouwei] for

[jira] [Created] (HDFS-11078) NPE in LazyPersistFileScrubber

2016-10-31 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-11078: -- Summary: NPE in LazyPersistFileScrubber Key: HDFS-11078 URL: https://issues.apache.org/jira/browse/HDFS-11078 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624124#comment-15624124 ] Hadoop QA commented on HDFS-10633: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624449#comment-15624449 ] Xiaobing Zhou commented on HDFS-11065: -- Posted patch v001 to address #1. HDFS-11079 is filed for #2.

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-10-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11076: -- Description: This JIRA tries to add unit tests for extended ACLs in HDFS > Add unit test for extended

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-10-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11076: -- Attachment: HDFS-11076.001.patch > Add unit test for extended Acls > --- >

[jira] [Commented] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623205#comment-15623205 ] Hudson commented on HDFS-11074: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10732 (See

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-10-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11076: -- Status: Patch Available (was: Open) > Add unit test for extended Acls >

[jira] [Updated] (HDFS-11076) Add unit test for extended Acls

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11076: - Target Version/s: 2.8.0 > Add unit test for extended Acls > --- > >

[jira] [Updated] (HDFS-11065) Add space quota tests for heterogenous storages

2016-10-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11065: - Target Version/s: 2.8.0 > Add space quota tests for heterogenous storages >

[jira] [Updated] (HDFS-10941) Improve BlockManager#processMisReplicatesAsync log

2016-10-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10941: -- Attachment: HDFS-10941.002.patch Thanks [~xyao] for the comments! Uploaded v002 patch to fix it. The

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621561#comment-15621561 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10455) Logging the username when deny the setOwner operation

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621668#comment-15621668 ] Hadoop QA commented on HDFS-10455: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10455) Logging the username when deny the setOwner operation

2016-10-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10455: Attachment: HDFS-10455-branch-2.000.patch > Logging the username when deny the setOwner operation >

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621843#comment-15621843 ] Hadoop QA commented on HDFS-10885: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10455) Logging the username when deny the setOwner operation

2016-10-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621388#comment-15621388 ] Rakesh R commented on HDFS-10455: - Thank you [~brahmareddy] for the commits. I've attached patch for

[jira] [Commented] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-10-31 Thread Aliza Itzkowitz (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621981#comment-15621981 ] Aliza Itzkowitz commented on HDFS-4957: --- is this a duplicate of

[jira] [Commented] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-10-31 Thread Aliza Itzkowitz (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621968#comment-15621968 ] Aliza Itzkowitz commented on HDFS-4957: --- What is the status of this issue? This was opened over 3

[jira] [Commented] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622554#comment-15622554 ] Anu Engineer commented on HDFS-10633: - [~linyiqun] Can you please let me know if this still valid ?

[jira] [Commented] (HDFS-9462) DiskBalancer: Add Scan Command

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622568#comment-15622568 ] Anu Engineer commented on HDFS-9462: [~xiaobingo] based on our off-line discussion I am inclined to

[jira] [Commented] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622530#comment-15622530 ] Anu Engineer commented on HDFS-10499: - No I am not, please go ahead and assign this to yourself.

[jira] [Commented] (HDFS-10633) DiskBalancer : Add the description for the new setting dfs.disk.balancer.plan.threshold.percent in HDFSDiskbalancer.md

2016-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622558#comment-15622558 ] Hadoop QA commented on HDFS-10633: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10499) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency.testGenerationStampInFuture

2016-10-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622404#comment-15622404 ] Yiqun Lin commented on HDFS-10499: -- Hi [~anu], I am ready to work on this. I have looked into this, I

[jira] [Commented] (HDFS-10904) Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622596#comment-15622596 ] Anu Engineer commented on HDFS-10904: - [~manojg] I am trying to resolve the parent JIRA and was

[jira] [Commented] (HDFS-10566) Submit plan request should throw exception if Datanode is undergoing an upgrade.

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622589#comment-15622589 ] Anu Engineer commented on HDFS-10566: - [~xiaobingo] Is there anything I can do to expedite this ? I am

[jira] [Updated] (HDFS-10503) DiskBalancer: simplify adding command options

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10503: Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-10576) > DiskBalancer:

[jira] [Updated] (HDFS-9502) DiskBalancer : Replace Node and Data Density with Weighted Mean and Variance

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9502: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-10576) > DiskBalancer :

[jira] [Updated] (HDFS-10577) DiskBalancer: Support building imbalanced MiniDFSCluster from JSON

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10577: Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-10576) > DiskBalancer: Support

[jira] [Commented] (HDFS-9550) DiskBalancer: Add Run Command

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622577#comment-15622577 ] Anu Engineer commented on HDFS-9550: [~xiaobingo] Could please rebase this patch to trunk and post this

[jira] [Updated] (HDFS-10577) DiskBalancer: Support building imbalanced MiniDFSCluster from JSON

2016-10-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10577: Issue Type: Improvement (was: Bug) > DiskBalancer: Support building imbalanced MiniDFSCluster from

[jira] [Commented] (HDFS-9462) DiskBalancer: Add Scan Command

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622819#comment-15622819 ] Xiaobing Zhou commented on HDFS-9462: - [~anu] yes, we should resolve this. We've moved some of the work

[jira] [Updated] (HDFS-10997) Reduce number of path resolving methods

2016-10-31 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10997: --- Attachment: HDFS-10997.branch-2.patch Updated patch to remove EC changes since not in branch-2. Fsck

[jira] [Commented] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622884#comment-15622884 ] Arpit Agarwal commented on HDFS-11074: -- Thanks for the patch [~hanishakoneru]. +1 pending Jenkins.

[jira] [Updated] (HDFS-9462) DiskBalancer: Add Scan Command

2016-10-31 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9462: Resolution: Duplicate Status: Resolved (was: Patch Available) > DiskBalancer: Add Scan

[jira] [Updated] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11074: -- Status: Patch Available (was: Open) > Remove unused method

[jira] [Updated] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11074: -- Attachment: HDFS-11074.000.patch > Remove unused method

[jira] [Commented] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15623147#comment-15623147 ] Hanisha Koneru commented on HDFS-11074: --- Thanks [~arpitagarwal]. The failed junit test

[jira] [Updated] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11074: - Component/s: datanode > Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage >

[jira] [Updated] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11074: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-11074) Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage

2016-10-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11074: - Issue Type: Improvement (was: Bug) > Remove unused method

[jira] [Resolved] (HDFS-4483) Refactor NN WebUI to no longer pass IP addresses in the URL

2016-10-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-4483. --- Resolution: Invalid Resolving this due to the webUI rewrite. > Refactor NN WebUI to no longer pass IP

  1   2   >