[jira] [Updated] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4660: - Summary: Block corruption can happen during pipeline recovery (was: Duplicated checksum on DN in a

[jira] [Commented] (HDFS-8592) SafeModeException never get unwrapped

[ https://issues.apache.org/jira/browse/HDFS-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587981#comment-14587981 ] Hudson commented on HDFS-8592: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2158 (See

[jira] [Commented] (HDFS-8361) Choose SSD over DISK in block placement

[ https://issues.apache.org/jira/browse/HDFS-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587979#comment-14587979 ] Hudson commented on HDFS-8361: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2158 (See

[jira] [Commented] (HDFS-8540) Mover should exit with NO_MOVE_BLOCK if no block can be moved

[ https://issues.apache.org/jira/browse/HDFS-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587973#comment-14587973 ] Hudson commented on HDFS-8540: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2158 (See

[jira] [Commented] (HDFS-8607) TestFileCorruption doesn't work as expected

[ https://issues.apache.org/jira/browse/HDFS-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587978#comment-14587978 ] Hudson commented on HDFS-8607: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2158 (See

[jira] [Commented] (HDFS-8576) Lease recovery should return true if the lease can be released and the file can be closed

[ https://issues.apache.org/jira/browse/HDFS-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587976#comment-14587976 ] Hudson commented on HDFS-8576: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2158 (See

[jira] [Commented] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588055#comment-14588055 ] Kihwal Lee commented on HDFS-4660: -- [~vinodkv] If the commit does not happen today, I will

[jira] [Commented] (HDFS-8610) if set several dirs which belongs to one disk in dfs.datanode.data.dir, NN calculate capacity wrong

[ https://issues.apache.org/jira/browse/HDFS-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587964#comment-14587964 ] Ajith S commented on HDFS-8610: --- Hi [~brahmareddy] Yes you are right. Please refer HDFS-8574

[jira] [Created] (HDFS-8611) Improve the performance of retry cache eviction

Kihwal Lee created HDFS-8611: Summary: Improve the performance of retry cache eviction Key: HDFS-8611 URL: https://issues.apache.org/jira/browse/HDFS-8611 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588053#comment-14588053 ] Kihwal Lee commented on HDFS-4660: -- Thanks for the review, [~vinayrpet]. After stress

[jira] [Commented] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588021#comment-14588021 ] Hadoop QA commented on HDFS-8238: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8361) Choose SSD over DISK in block placement

[ https://issues.apache.org/jira/browse/HDFS-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588132#comment-14588132 ] Hudson commented on HDFS-8361: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #219 (See

[jira] [Commented] (HDFS-8589) Fix unused imports in BPServiceActor and BlockReportLeaseManager

[ https://issues.apache.org/jira/browse/HDFS-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588321#comment-14588321 ] Andrew Wang commented on HDFS-8589: --- +1 thanks Colin Fix unused imports in

[jira] [Commented] (HDFS-8576) Lease recovery should return true if the lease can be released and the file can be closed

[ https://issues.apache.org/jira/browse/HDFS-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588128#comment-14588128 ] Hudson commented on HDFS-8576: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #219 (See

[jira] [Commented] (HDFS-8592) SafeModeException never get unwrapped

[ https://issues.apache.org/jira/browse/HDFS-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588134#comment-14588134 ] Hudson commented on HDFS-8592: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #219 (See

[jira] [Commented] (HDFS-8607) TestFileCorruption doesn't work as expected

[ https://issues.apache.org/jira/browse/HDFS-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588187#comment-14588187 ] Hudson commented on HDFS-8607: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #228 (See

[jira] [Commented] (HDFS-8592) SafeModeException never get unwrapped

[ https://issues.apache.org/jira/browse/HDFS-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588230#comment-14588230 ] Hudson commented on HDFS-8592: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2176 (See

[jira] [Commented] (HDFS-8611) Improve the performance of retry cache eviction

[ https://issues.apache.org/jira/browse/HDFS-8611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588144#comment-14588144 ] Kihwal Lee commented on HDFS-8611: -- {{RetryCache}} is not a typical cache, where only

[jira] [Commented] (HDFS-8592) SafeModeException never get unwrapped

[ https://issues.apache.org/jira/browse/HDFS-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588191#comment-14588191 ] Hudson commented on HDFS-8592: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #228 (See

[jira] [Commented] (HDFS-8576) Lease recovery should return true if the lease can be released and the file can be closed

[ https://issues.apache.org/jira/browse/HDFS-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588185#comment-14588185 ] Hudson commented on HDFS-8576: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #228 (See

[jira] [Commented] (HDFS-8540) Mover should exit with NO_MOVE_BLOCK if no block can be moved

[ https://issues.apache.org/jira/browse/HDFS-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588182#comment-14588182 ] Hudson commented on HDFS-8540: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #228 (See

[jira] [Commented] (HDFS-8361) Choose SSD over DISK in block placement

[ https://issues.apache.org/jira/browse/HDFS-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588188#comment-14588188 ] Hudson commented on HDFS-8361: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #228 (See

[jira] [Commented] (HDFS-8540) Mover should exit with NO_MOVE_BLOCK if no block can be moved

[ https://issues.apache.org/jira/browse/HDFS-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588222#comment-14588222 ] Hudson commented on HDFS-8540: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2176 (See

[jira] [Commented] (HDFS-8576) Lease recovery should return true if the lease can be released and the file can be closed

[ https://issues.apache.org/jira/browse/HDFS-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588225#comment-14588225 ] Hudson commented on HDFS-8576: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2176 (See

[jira] [Commented] (HDFS-8607) TestFileCorruption doesn't work as expected

[ https://issues.apache.org/jira/browse/HDFS-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588227#comment-14588227 ] Hudson commented on HDFS-8607: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2176 (See

[jira] [Commented] (HDFS-8361) Choose SSD over DISK in block placement

[ https://issues.apache.org/jira/browse/HDFS-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588228#comment-14588228 ] Hudson commented on HDFS-8361: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2176 (See

[jira] [Commented] (HDFS-8540) Mover should exit with NO_MOVE_BLOCK if no block can be moved

[ https://issues.apache.org/jira/browse/HDFS-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588125#comment-14588125 ] Hudson commented on HDFS-8540: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #219 (See

[jira] [Commented] (HDFS-8607) TestFileCorruption doesn't work as expected

[ https://issues.apache.org/jira/browse/HDFS-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588130#comment-14588130 ] Hudson commented on HDFS-8607: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #219 (See

[jira] [Commented] (HDFS-8542) WebHDFS getHomeDirectory behavior does not match specification

[ https://issues.apache.org/jira/browse/HDFS-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588430#comment-14588430 ] kanaka kumar avvaru commented on HDFS-8542: --- check style issue reported doesn't

[jira] [Commented] (HDFS-8466) Refactor BlockInfoContiguous and fix NPE in TestBlockInfo#testCopyConstructor()

[ https://issues.apache.org/jira/browse/HDFS-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588389#comment-14588389 ] Uma Maheswara Rao G commented on HDFS-8466: --- +1 Refactor BlockInfoContiguous

[jira] [Commented] (HDFS-8574) When block count for a volume exceeds dfs.blockreport.split.threshold, block report causes exception

[ https://issues.apache.org/jira/browse/HDFS-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588457#comment-14588457 ] Arpit Agarwal commented on HDFS-8574: - Hi [~ajithshetty], I don't expect this limit to

[jira] [Commented] (HDFS-8605) Merge Refactor of DFSOutputStream from HDFS-7285 branch

[ https://issues.apache.org/jira/browse/HDFS-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588484#comment-14588484 ] Andrew Wang commented on HDFS-8605: --- Hey Vinay, couple nitty comments: * Could we spell

[jira] [Updated] (HDFS-8612) org.apache.hadoop.fs.shell.TestCount failing

[ https://issues.apache.org/jira/browse/HDFS-8612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8612: --- Component/s: test org.apache.hadoop.fs.shell.TestCount failing

[jira] [Updated] (HDFS-8591) Remove support for deprecated configuration key dfs.namenode.decommission.nodes.per.interval

[ https://issues.apache.org/jira/browse/HDFS-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8591: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Incompatible change Status:

[jira] [Created] (HDFS-8612) org.apache.hadoop.fs.shell.TestCount failing

Brahma Reddy Battula created HDFS-8612: -- Summary: org.apache.hadoop.fs.shell.TestCount failing Key: HDFS-8612 URL: https://issues.apache.org/jira/browse/HDFS-8612 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8457: Attachment: HDFS-8457-HDFS-7240.06.patch Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic

[jira] [Commented] (HDFS-3743) QJM: improve formatting behavior for JNs

[ https://issues.apache.org/jira/browse/HDFS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588342#comment-14588342 ] Jian Fang commented on HDFS-3743: - Any progress on this Jira? The JN auto format is

[jira] [Updated] (HDFS-8608) Merge HDFS-7912 to trunk (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8608: Attachment: HDFS-8608.01.patch Attaching new patch to address white space and check style warnings. Merge

[jira] [Commented] (HDFS-8580) Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlocksFeature

[ https://issues.apache.org/jira/browse/HDFS-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588530#comment-14588530 ] Jing Zhao commented on HDFS-8580: - # Let's use optional here to avoid incompatibility when

[jira] [Assigned] (HDFS-8057) Move BlockReader implementation to the client implementation package

[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-8057: - Assignee: Takanobu Asanuma (was: Tsz Wo Nicholas Sze) Sure, thanks a lot. Move

[jira] [Updated] (HDFS-8606) Cleanup DFSOutputStream by removing unwanted changes

[ https://issues.apache.org/jira/browse/HDFS-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8606: -- Component/s: hdfs-client Hadoop Flags: Reviewed +1 patch looks good. Cleanup

[jira] [Commented] (HDFS-8591) Remove support for deprecated configuration key dfs.namenode.decommission.nodes.per.interval

[ https://issues.apache.org/jira/browse/HDFS-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588460#comment-14588460 ] Hudson commented on HDFS-8591: -- FAILURE: Integrated in Hadoop-trunk-Commit #8026 (See

[jira] [Commented] (HDFS-8611) Improve the performance of retry cache eviction

[ https://issues.apache.org/jira/browse/HDFS-8611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588479#comment-14588479 ] Andrew Wang commented on HDFS-8611: --- I agree with all that, it's an atypical cache

[jira] [Commented] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588757#comment-14588757 ] Hadoop QA commented on HDFS-8546: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8608) Merge HDFS-7912 to trunk (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588781#comment-14588781 ] Hadoop QA commented on HDFS-8608: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7164) Feature documentation for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588830#comment-14588830 ] Xiaoyu Yao commented on HDFS-7164: -- +1 for v7 patch. Feature documentation for

[jira] [Commented] (HDFS-8608) Merge HDFS-7912 to trunk (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1458#comment-1458 ] Andrew Wang commented on HDFS-8608: --- I looked through this too and LGTM as well, thanks

[jira] [Assigned] (HDFS-3743) QJM: improve formatting behavior for JNs

[ https://issues.apache.org/jira/browse/HDFS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-3743: - Assignee: (was: Todd Lipcon) No progress from my side. This didn't turn out to be a highly

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588775#comment-14588775 ] Rajiv Chittajallu commented on HDFS-7877: - * It would be preferable to have a

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588819#comment-14588819 ] Colin Patrick McCabe commented on HDFS-7923: This change is important for

[jira] [Updated] (HDFS-7164) Feature documentation for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7164: Attachment: HDFS-7164.07.patch Thanks for the detailed review [~xyao]. v7 patch addresses those two

[jira] [Resolved] (HDFS-7453) Namenode does not recognize block is missing on a datanode

[ https://issues.apache.org/jira/browse/HDFS-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-7453. - Resolution: Duplicate As per prior comments, I am resolving this as a duplicate of HDFS-7208.

[jira] [Updated] (HDFS-8608) Merge HDFS-7912 to trunk (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8608: Attachment: HDFS-8608.02.patch Thanks for the reviews from Jing and Andrew! Attaching new patch to address

[jira] [Updated] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8546: -- Attachment: HDFS-8546.006.patch Here's a patch which adds LOG.errors with the path, LMK what you think.

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588763#comment-14588763 ] Andrew Wang commented on HDFS-7923: --- If we're really worried about starvation, we could

[jira] [Updated] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8548: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-8582) Reduce failure messages when running datanode reconfiguration

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8582: Attachment: HDFS-8582.003.patch Thanks a lot for the reviews, [~cmccabe]. I made the following

[jira] [Updated] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8548: - Labels: reviewed (was: ) Minicluster throws NPE on shutdown --

[jira] [Updated] (HDFS-8551) Fix hdfs datanode CLI usage message

[ https://issues.apache.org/jira/browse/HDFS-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8551: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7164) Feature documentation for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588815#comment-14588815 ] Xiaoyu Yao commented on HDFS-7164: -- The rendered site LGTM. +1 for v6 patch with two more

[jira] [Commented] (HDFS-7164) Feature documentation for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588848#comment-14588848 ] Arpit Agarwal commented on HDFS-7164: - Thanks [~xyao], will commit if Jenkins +1s.

[jira] [Updated] (HDFS-8446) Separate safemode related operations in GetBlockLocations()

[ https://issues.apache.org/jira/browse/HDFS-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8446: - Attachment: HDFS-8446.002.patch Separate safemode related operations in GetBlockLocations()

[jira] [Commented] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588611#comment-14588611 ] Tsz Wo Nicholas Sze commented on HDFS-8541: --- Forgot to change exit state to

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588681#comment-14588681 ] Sanjay Radia commented on HDFS-7923: bq. This change is really helpful during startup

[jira] [Updated] (HDFS-8597) Fix TestFSImage#testZeroBlockSize on Windows

[ https://issues.apache.org/jira/browse/HDFS-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8597: Hadoop Flags: Reviewed +1 for the patch. I verified it on Windows. Thank you, Xiaoyu. Fix

[jira] [Updated] (HDFS-8541) Mover should exit with NO_MOVE_PROGRESS if there is no move progress

[ https://issues.apache.org/jira/browse/HDFS-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8541: - Attachment: HDFS-8541.patch Attached initial patch, please review. I think no

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588686#comment-14588686 ] Colin Patrick McCabe commented on HDFS-7923: BTW it would be relatively easy to

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588688#comment-14588688 ] stack commented on HDFS-7966: - bq. The code path is completely separated so it should be few

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588723#comment-14588723 ] Kihwal Lee commented on HDFS-4660: -- Thanks, Nathan. With Vinay's binding +1 and Nathan's

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588663#comment-14588663 ] Colin Patrick McCabe commented on HDFS-7923: Starvation is not a real concern

[jira] [Commented] (HDFS-8608) Merge HDFS-7912 to trunk (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588718#comment-14588718 ] Jing Zhao commented on HDFS-8608: - Thanks for working on this, Zhe! The patch looks pretty

[jira] [Commented] (HDFS-8597) Fix TestFSImage#testZeroBlockSize on Windows

[ https://issues.apache.org/jira/browse/HDFS-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588736#comment-14588736 ] Hudson commented on HDFS-8597: -- FAILURE: Integrated in Hadoop-trunk-Commit #8027 (See

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588661#comment-14588661 ] Kihwal Lee commented on HDFS-7877: -- [~rajive] It will be nice if we can get your

[jira] [Updated] (HDFS-8597) Fix TestFSImage#testZeroBlockSize on Windows

[ https://issues.apache.org/jira/browse/HDFS-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8597: - Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch Available) Thanks

[jira] [Comment Edited] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588663#comment-14588663 ] Colin Patrick McCabe edited comment on HDFS-7923 at 6/16/15 8:14 PM:

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588695#comment-14588695 ] Nathan Roberts commented on HDFS-4660: -- +1 on the patch. I have reviewed the patch

[jira] [Updated] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4660: - Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588961#comment-14588961 ] Hadoop QA commented on HDFS-8457: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8446) Separate safemode related operations in GetBlockLocations()

[ https://issues.apache.org/jira/browse/HDFS-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8446: - Attachment: HDFS-8446.003.patch Separate safemode related operations in GetBlockLocations()

[jira] [Commented] (HDFS-8551) Fix hdfs datanode CLI usage message

[ https://issues.apache.org/jira/browse/HDFS-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588942#comment-14588942 ] Hudson commented on HDFS-8551: -- FAILURE: Integrated in Hadoop-trunk-Commit #8028 (See

[jira] [Commented] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588943#comment-14588943 ] Hudson commented on HDFS-8548: -- FAILURE: Integrated in Hadoop-trunk-Commit #8028 (See

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588940#comment-14588940 ] Hudson commented on HDFS-4660: -- FAILURE: Integrated in Hadoop-trunk-Commit #8028 (See

[jira] [Updated] (HDFS-8192) Eviction should key off used locked memory instead of ram disk free space

[ https://issues.apache.org/jira/browse/HDFS-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8192: Description: Eviction from RAM disk will be triggered when locked memory is insufficient RAM to

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588913#comment-14588913 ] Todd Lipcon commented on HDFS-7966: --- +1 to what Stack said. We already have many access

[jira] [Updated] (HDFS-8608) Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8608: Summary: Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588931#comment-14588931 ] Sanjay Radia commented on HDFS-7923: Starvation I didn't literally mean starvation

[jira] [Updated] (HDFS-8192) Eviction should key off used locked memory instead of ram disk free space

[ https://issues.apache.org/jira/browse/HDFS-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8192: Description: Eviction from RAM disk will be triggered when locked memory is insufficient RAM to

[jira] [Commented] (HDFS-3743) QJM: improve formatting behavior for JNs

[ https://issues.apache.org/jira/browse/HDFS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588972#comment-14588972 ] Jian Fang commented on HDFS-3743: - Unfortunately, this feature is critical for Hadoop

[jira] [Commented] (HDFS-8446) Separate safemode related operations in GetBlockLocations()

[ https://issues.apache.org/jira/browse/HDFS-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588964#comment-14588964 ] Jing Zhao commented on HDFS-8446: - # Printing out the file paths can still be useful here.

[jira] [Commented] (HDFS-7164) Feature documentation for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589100#comment-14589100 ] Hadoop QA commented on HDFS-7164: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8613) Add option to list up allowed hosts that can do any operation to NameNode.

Kai Sasaki created HDFS-8613: Summary: Add option to list up allowed hosts that can do any operation to NameNode. Key: HDFS-8613 URL: https://issues.apache.org/jira/browse/HDFS-8613 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8602) Erasure Coding: Client can't read(decode) the EC files which have corrupt blocks.

[ https://issues.apache.org/jira/browse/HDFS-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589110#comment-14589110 ] Kai Sasaki commented on HDFS-8602: -- Based on the offline discussion with [~jingzhao], for

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589122#comment-14589122 ] Haohui Mai commented on HDFS-7966: -- bq. Should we get Duo Zhang set up w/ commit rights on

[jira] [Updated] (HDFS-8606) Cleanup DFSOutputStream by removing unwanted changes

[ https://issues.apache.org/jira/browse/HDFS-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8606: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589157#comment-14589157 ] Colin Patrick McCabe commented on HDFS-7923: bq. Can a DN's block report be

[jira] [Updated] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8238: --- Status: Open (was: Patch Available) Move ClientProtocol to the hdfs-client

[jira] [Updated] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8238: --- Status: Patch Available (was: Open) Move ClientProtocol to the hdfs-client

[jira] [Resolved] (HDFS-5741) BlockInfo#findDataNode can be removed

[ https://issues.apache.org/jira/browse/HDFS-5741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5741. - Resolution: Done [~jingzhao] fixed this as part of HDFS-7743. Resolving. BlockInfo#findDataNode

[jira] [Commented] (HDFS-8608) Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)

[ https://issues.apache.org/jira/browse/HDFS-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589264#comment-14589264 ] Hadoop QA commented on HDFS-8608: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8446) Separate safemode related operations in GetBlockLocations()

[ https://issues.apache.org/jira/browse/HDFS-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589304#comment-14589304 ] Hadoop QA commented on HDFS-8446: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

  1   2   >