[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4025: Status: Patch Available (was: Open) > QJM: Sychronize past log segments to JNs that missed them >

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-08-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446604#comment-15446604 ] Mingliang Liu commented on HDFS-10810: -- The newly added unit test {{testSetReplicationWhenBatchIBR}},

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail when boolean parameters not provided

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446784#comment-15446784 ] John Zhuge commented on HDFS-10684: --- [~loungerdork], I was able to reproduce the problem with NN running

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446711#comment-15446711 ] Andrew Wang commented on HDFS-10784: Checkstyles are because of existing coding style, test failures

[jira] [Commented] (HDFS-4210) NameNode should fail when a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446829#comment-15446829 ] John Zhuge commented on HDFS-4210: -- Change the title to reflect the intended fix and be consistent with

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446954#comment-15446954 ] Yongjun Zhang commented on HDFS-10625: -- Sorry for the delay [~linyiqun]. I'm committing it shortly.

[jira] [Updated] (HDFS-4210) NameNode should fail on JournalNode DNS resolution failure

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: NameNode should fail on JournalNode DNS resolution failure (was: NameNode Format should not fail

[jira] [Assigned] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-4957: Assignee: John Zhuge > NameNode failover should not fail because a DNS entry for a quorum node >

[jira] [Updated] (HDFS-4210) NameNode should fail when a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: NameNode should fail when a DNS entry for a quorum node cannot be resolved (was: NameNode should

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Summary: WebHDFS DataNode calls fail without parameter createparent (was: WebHDFS DataNode calls fail

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail when parameter createparent not provided

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Summary: WebHDFS DataNode calls fail when parameter createparent not provided (was: WebHDFS DataNode

[jira] [Updated] (HDFS-4210) Helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: Helpful exception when DNS entry for JournalNode cannot be resolved (was: NameNode should throw

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446925#comment-15446925 ] Hadoop QA commented on HDFS-4025: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-4210) NameNode should throw UnknownHostException when a DNS entry for a quorum node cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Summary: NameNode should throw UnknownHostException when a DNS entry for a quorum node cannot be resolved

[jira] [Commented] (HDFS-4210) Helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447345#comment-15447345 ] Hadoop QA commented on HDFS-4210: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447348#comment-15447348 ] Hadoop QA commented on HDFS-10808: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-29 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDFS-4025: Assignee: Hanisha Koneru (was: Todd Lipcon) > QJM: Sychronize past log segments to JNs

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-29 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447355#comment-15447355 ] Hanisha Koneru commented on HDFS-4025: -- Assigning the patch to myself. Please let me know if there are

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447388#comment-15447388 ] Lei (Eddy) Xu commented on HDFS-10808: -- [~anu] Thanks for the explanations. * Is

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447153#comment-15447153 ] Jing Zhao commented on HDFS-4025: - Thanks for working on this, [~hanishakoneru]. Some early comments: #

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447205#comment-15447205 ] Arpit Agarwal commented on HDFS-10742: -- IIUC that'd be used like {code} try (AutoCloseable ac = new

[jira] [Comment Edited] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-29 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447279#comment-15447279 ] Hanisha Koneru edited comment on HDFS-10713 at 8/29/16 10:39 PM: - Patch

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-29 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.000.patch > Throttle FsNameSystem lock warnings >

[jira] [Reopened] (HDFS-10255) ByteRangeInputStream.readFully leaks stream handles on failure

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-10255: > ByteRangeInputStream.readFully leaks stream handles on failure >

[jira] [Resolved] (HDFS-10255) ByteRangeInputStream.readFully leaks stream handles on failure

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-10255. Resolution: Duplicate Fix Version/s: (was: 2.8.0) > ByteRangeInputStream.readFully leaks

[jira] [Updated] (HDFS-4210) Helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-4210: - Attachment: HDFS-4210.004.patch Patch 004: * Xiao's comments > Helpful exception when DNS entry for

[jira] [Updated] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10625: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4 Status:

[jira] [Updated] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10808: Attachment: HDFS-10808.001.patch > DiskBalancer does not execute multi-steps plan-redux >

[jira] [Updated] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10808: Status: Patch Available (was: Open) > DiskBalancer does not execute multi-steps plan-redux >

[jira] [Commented] (HDFS-4210) Helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447014#comment-15447014 ] Xiao Chen commented on HDFS-4210: - Thanks John for the patches. 2 comments, other than these LGTM: {code}

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447021#comment-15447021 ] Chris Douglas commented on HDFS-10742: -- bq. I can't be sure other developers will prefer using this

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447083#comment-15447083 ] Hudson commented on HDFS-10625: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10368 (See

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447087#comment-15447087 ] Yongjun Zhang commented on HDFS-10625: -- Committed to trunk, branch-2, branch-2.8 Thanks [~shahrs87]

[jira] [Comment Edited] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-08-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447087#comment-15447087 ] Yongjun Zhang edited comment on HDFS-10625 at 8/29/16 9:31 PM: --- Committed to

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10804: - Fix Version/s: (was: 3.0.0-beta1) > Use finer-granularity lock for ReplicaMap >

[jira] [Commented] (HDFS-9530) ReservedSpace is not cleared for abandoned Blocks

2016-08-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447179#comment-15447179 ] Arpit Agarwal commented on HDFS-9530: - They are independent release lines so iiuc the branch-2.7

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-29 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Status: Patch Available (was: Open) Patch 000 suppresses the write lock warnings for 2 mins

[jira] [Updated] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-4210: Summary: Throw helpful exception when DNS entry for JournalNode cannot be resolved (was: Helpful exception

[jira] [Comment Edited] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447388#comment-15447388 ] Lei (Eddy) Xu edited comment on HDFS-10808 at 8/29/16 11:25 PM: [~anu]

[jira] [Resolved] (HDFS-10254) DfsClient undervalidates args for PositionedReadable operations

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-10254. Resolution: Duplicate Fix Version/s: (was: 2.8.0) > DfsClient undervalidates args for

[jira] [Reopened] (HDFS-10254) DfsClient undervalidates args for PositionedReadable operations

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-10254: > DfsClient undervalidates args for PositionedReadable operations >

[jira] [Commented] (HDFS-10375) Remove redundant TestMiniDFSCluster.testDualClusters

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447401#comment-15447401 ] Andrew Wang commented on HDFS-10375: For future git log greppers, I forgot to include the JIRA #. My

[jira] [Commented] (HDFS-10353) Fix hadoop-hdfs-native-client compilation on Windows

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447397#comment-15447397 ] Andrew Wang commented on HDFS-10353: For future git log greppers, I forgot to put the JIRA ID in the

[jira] [Commented] (HDFS-10568) Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447407#comment-15447407 ] Andrew Wang commented on HDFS-10568: For future git log greppers, this was typo'd as HADOOP-10568 in

[jira] [Commented] (HDFS-7470) SecondaryNameNode need twice memory when calling reloadFromImageFile

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447419#comment-15447419 ] Andrew Wang commented on HDFS-7470: --- For future git log greppers, the JIRA ID was typo'd as HDFS-7570. >

[jira] [Commented] (HDFS-7489) Incorrect locking in FsVolumeList#checkDirs can hang datanodes

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447422#comment-15447422 ] Andrew Wang commented on HDFS-7489: --- FYI for git log greppers, this commit is missing the JIRA ID. >

[jira] [Commented] (HDFS-8085) Move CorruptFileBlockIterator to the hdfs.client.impl package

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447430#comment-15447430 ] Andrew Wang commented on HDFS-8085: --- FYI for future git log greppers, the JIRA ID was typo'd as

[jira] [Resolved] (HDFS-8148) NPE thrown at Namenode startup,.

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8148. --- Resolution: Duplicate Fix Version/s: (was: 2.8.0) > NPE thrown at Namenode startup,. >

[jira] [Reopened] (HDFS-8148) NPE thrown at Namenode startup,.

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-8148: --- > NPE thrown at Namenode startup,. > - > > Key: HDFS-8148

[jira] [Reopened] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-8947: --- > NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service >

[jira] [Resolved] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8947. --- Resolution: Duplicate Fix Version/s: (was: 2.9.0) > NameNode, DataNode and NFS gateway to

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-29 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10809: - Attachment: HDFS-10809.001.patch > getNumEncryptionZones causes NPE in branch-2.7

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447453#comment-15447453 ] Andrew Wang commented on HDFS-9226: --- Note for future git log greppers, JIRA ID typo'd as HDFS-9926. >

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447450#comment-15447450 ] Chris Douglas commented on HDFS-10742: -- bq. That adds a new object allocation for every lock acquire

[jira] [Commented] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-29 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447449#comment-15447449 ] Vinitha Reddy Gankidi commented on HDFS-10809: -- [~zhz] I have uploaded a patch. Please take a

[jira] [Commented] (HDFS-9953) Download File from UI broken after pagination

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447467#comment-15447467 ] Andrew Wang commented on HDFS-9953: --- FYI for git log greppers, this one is missing the JIRA #. >

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447502#comment-15447502 ] Anu Engineer commented on HDFS-10808: - All checkstyle warnings are "hides the field nature". One test

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447515#comment-15447515 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447522#comment-15447522 ] Anu Engineer commented on HDFS-10808: - [~eddyxu] Thanks for your comments. bq. Is clearExitFlag()

[jira] [Updated] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

2016-08-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10794: --- Attachment: HDFS-10800-HDFS-10285-00.patch Attaching the first patch for this JIRA.

[jira] [Created] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-08-29 Thread Eisuke Umeda (JIRA)
Eisuke Umeda created HDFS-10815: --- Summary: The state of the EC file is erroneously recognized when you restart the NameNode. Key: HDFS-10815 URL: https://issues.apache.org/jira/browse/HDFS-10815

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9395: -- Release Note: Audit logs will now only be generated in the following two cases: * When an operation

[jira] [Updated] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-4210: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-4210: Labels: BB2015-05-TBR supportability (was: BB2015-05-TBR) > Throw helpful exception when DNS entry for

[jira] [Updated] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-29 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10814: - Attachment: HDFS-10814.001.patch > Add assertion for getNumEncryptionZones when

[jira] [Updated] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-08-29 Thread Eisuke Umeda (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eisuke Umeda updated HDFS-10815: Description: After carrying out an examination in the following procedures, an EC files came to be

[jira] [Updated] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7645: -- Hadoop Flags: Reviewed (was: Incompatible change,Reviewed) > Rolling upgrade is restoring blocks from

[jira] [Updated] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10808: Attachment: HDFS-10808.002.patch uploading new patch that removes "clearExitFlag" based on review

[jira] [Commented] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447572#comment-15447572 ] Xiao Chen commented on HDFS-4210: - +1 on patch 4, committing soon. > Throw helpful exception when DNS

[jira] [Commented] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448020#comment-15448020 ] Zhe Zhang commented on HDFS-10814: -- Thanks Vinitha for the fix. This will catch future potential NPE

[jira] [Updated] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10814: - Hadoop Flags: Reviewed Target Version/s: 2.7.4 Status: Patch Available (was: Open)

[jira] [Assigned] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-29 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi reassigned HDFS-10814: Assignee: Vinitha Reddy Gankidi > Add assertion for getNumEncryptionZones

[jira] [Created] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-29 Thread Vinitha Reddy Gankidi (JIRA)
Vinitha Reddy Gankidi created HDFS-10814: Summary: Add assertion for getNumEncryptionZones when no EZ is created Key: HDFS-10814 URL: https://issues.apache.org/jira/browse/HDFS-10814 Project:

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447883#comment-15447883 ] Hadoop QA commented on HDFS-10808: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10800) [SPS]: Storage Policy Satisfier daemon thread in Namenode to find the blocks which were placed in wrong storages than what NN is expecting.

2016-08-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10800: --- Affects Version/s: HDFS-10285 > [SPS]: Storage Policy Satisfier daemon thread in

[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7933: -- Release Note: The output of hdfs fsck now also contains information about decommissioning nodes. > fsck

[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2016-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7933: -- Release Note: The output of hdfs fsck now also contains information about decommissioning replicas.

[jira] [Updated] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

2016-08-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10794: --- Attachment: (was: HDFS-10800-HDFS-10285-00.patch) > [SPS]: Provide storage policy

[jira] [Issue Comment Deleted] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

2016-08-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10794: --- Comment: was deleted (was: Attaching the first patch for this JIRA.

[jira] [Updated] (HDFS-10800) [SPS]: Storage Policy Satisfier daemon thread in Namenode to find the blocks which were placed in wrong storages than what NN is expecting.

2016-08-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10800: --- Attachment: HDFS-10800-HDFS-10285-00.patch Attaching the first patch for this JIRA.

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448015#comment-15448015 ] Xiao Chen commented on HDFS-10784: -- Thanks for the new patch, Andrew. Looks pretty good to me. I have a

[jira] [Commented] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448084#comment-15448084 ] Zhe Zhang commented on HDFS-10809: -- Thanks [~redvine]. Is the patch based on branch-2.7? If so could you

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Fix Version/s: 3.0.0-beta1 Release Note: Add a private object for synchronization as

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10804: - Fix Version/s: (was: 3.0.0-beta1) > Use finer-granularity lock for ReplicaMap >

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: HDFS-10804-001.patch > Use finer-granularity lock for ReplicaMap >

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: (was: HDFS-10804-003.patch) > Use finer-granularity lock for ReplicaMap >

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: (was: HDFS-10804-002.patch) > Use finer-granularity lock for ReplicaMap >

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: HDFS-10804-002.patch > Use finer-granularity lock for ReplicaMap >

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15445153#comment-15445153 ] Hadoop QA commented on HDFS-8901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15445231#comment-15445231 ] Hadoop QA commented on HDFS-10804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: HDFS-10804-002.patch > Use finer-granularity lock for ReplicaMap >

[jira] [Commented] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15445139#comment-15445139 ] Hadoop QA commented on HDFS-10804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: HDFS-10804-003.patch > Use finer-granularity lock for ReplicaMap >

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Fix Version/s: 3.0.0-beta1 Status: Patch Available (was: Open) > Use finer-granularity lock

[jira] [Updated] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Status: Open (was: Patch Available) > Use finer-granularity lock for ReplicaMap >

[jira] [Commented] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444984#comment-15444984 ] Hadoop QA commented on HDFS-4210: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444940#comment-15444940 ] Hadoop QA commented on HDFS-10794: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10805) Reduce runtime for append test

2016-08-29 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15445025#comment-15445025 ] Gergely Novák commented on HDFS-10805: -- The attached patch reduced the test's runtime to [10

[jira] [Created] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-29 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10813: Summary: DiskBalancer: Add the getNodeList method in Command Key: HDFS-10813 URL: https://issues.apache.org/jira/browse/HDFS-10813 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15445488#comment-15445488 ] Hadoop QA commented on HDFS-10804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >