[jira] [Commented] (HDFS-9819) FsVolume should tolerate few times check-dir failed due to deletion by mistake

[ https://issues.apache.org/jira/browse/HDFS-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150077#comment-15150077 ] Hadoop QA commented on HDFS-9819: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9812) Streamer threads leak if failure happens when closing the dfsoutputstream

[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9812: Attachment: HDFS-9812.002.patch Update the latest patch. There are many places doesn't judging

[jira] [Commented] (HDFS-9812) Streamer threads leak if failure happens when closing the dfsoutputstream

[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150169#comment-15150169 ] Hadoop QA commented on HDFS-9812: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-5522) Datanode disk error check may be incorrectly skipped

[ https://issues.apache.org/jira/browse/HDFS-5522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150220#comment-15150220 ] Vinayakumar B commented on HDFS-5522: - bq. So, if one node is down (eg due to a rolling restart or a

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150432#comment-15150432 ] Walter Su commented on HDFS-9816: - The safe length may change if steps 3,4 is included(See HDFS-9173). I

[jira] [Commented] (HDFS-5970) callers of NetworkTopology's chooseRandom method to expect null return value

[ https://issues.apache.org/jira/browse/HDFS-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150485#comment-15150485 ] Oleg Danilov commented on HDFS-5970: We just "reproduced" this issue accidentally using Hadoop 2.3.0:

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150624#comment-15150624 ] Kihwal Lee commented on HDFS-8845: -- +1 for merging to 2.7. > DiskChecker should not traverse the entire

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8845: - Fix Version/s: (was: 2.8.0) 2.7.3 > DiskChecker should not traverse the entire tree

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150630#comment-15150630 ] Kihwal Lee commented on HDFS-8845: -- Cherry-picked to 2.7. > DiskChecker should not traverse the entire

[jira] [Created] (HDFS-9820) Improve distcp to support efficient restore

Yongjun Zhang created HDFS-9820: --- Summary: Improve distcp to support efficient restore Key: HDFS-9820 URL: https://issues.apache.org/jira/browse/HDFS-9820 Project: Hadoop HDFS Issue Type: New

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Summary: Improve distcp to support efficient restore to an earlier snapshot (was: Improve distcp to

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9820: Description: HDFS-4167 intends to restore HDFS to the most recent snapshot, and there are some

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150698#comment-15150698 ] Xiaoyu Yao commented on HDFS-9799: -- Thanks [~zhz] for the explanation. Agree with your changes on

[jira] [Assigned] (HDFS-9817) Use SLF4J in new classes

[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-9817: -- Assignee: Anu Engineer > Use SLF4J in new classes > > >

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150843#comment-15150843 ] Anu Engineer commented on HDFS-9817: Hi [~arpitagarwal], Thanks for filing this, I will take care of

[jira] [Updated] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8786: --- Attachment: HDFS-8786-draft.patch > Erasure coding: DataNode should transfer striped blocks before being >

[jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150908#comment-15150908 ] Rakesh R commented on HDFS-8786: I’ve started analyzing this and attached a draft patch for discussion.

[jira] [Commented] (HDFS-7964) Add support for async edit logging

[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150918#comment-15150918 ] Daryn Sharp commented on HDFS-7964: --- Thanks for the rebase. I'm currently really busy but will get to

Re: [jira] [Commented] (HDFS-8845) DiskChecker should not traverse the entire tree

Thanks kihwal. On Feb 17, 2016 8:50 PM, "Kihwal Lee (JIRA)" wrote: > > [ > https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150630#comment-15150630 > ] > > Kihwal Lee commented on HDFS-8845: >

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.004.patch V004 fixed some check styple issues. > Support

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.004.patch > Support reconfiguring fs.protected.directories without

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: (was: HDFS-9349-HDFS-9000.004.patch) > Support reconfiguring

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150966#comment-15150966 ] Haohui Mai commented on HDFS-9815: -- +1. I'll commit it shortly. > Move o.a.h.fs.Hdfs to

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9815: - Assignee: Vinayakumar B > Move o.a.h.fs.Hdfs to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150969#comment-15150969 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7964) Add support for async edit logging

[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150970#comment-15150970 ] Jing Zhao commented on HDFS-7964: - just merge conflicts. you can compare the diff between the rebased patch

[jira] [Commented] (HDFS-9819) FsVolume should tolerate few times check-dir failed due to deletion by mistake

[ https://issues.apache.org/jira/browse/HDFS-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150978#comment-15150978 ] Kihwal Lee commented on HDFS-9819: -- bq. ... do a delete dir/file operation by mistake in datanode

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9815: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150984#comment-15150984 ] Hudson commented on HDFS-9815: -- FAILURE: Integrated in Hadoop-trunk-Commit #9313 (See

[jira] [Resolved] (HDFS-9813) HDFS Non DFS Used (History server)

[ https://issues.apache.org/jira/browse/HDFS-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-9813. -- Resolution: Invalid > HDFS Non DFS Used (History server) > -- > >

[jira] [Updated] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9608: -- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9813) HDFS Non DFS Used (History server)

[ https://issues.apache.org/jira/browse/HDFS-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151014#comment-15151014 ] Kihwal Lee commented on HDFS-9813: -- Please use user mailing list for usage issues and questions. > HDFS

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151040#comment-15151040 ] Hudson commented on HDFS-9608: -- FAILURE: Integrated in Hadoop-trunk-Commit #9314 (See

[jira] [Updated] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9799: Attachment: HDFS-9799.05.patch Thanks for the suggestion [~xyao]. An API level indication would be a nice. I

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151094#comment-15151094 ] Andrew Wang commented on HDFS-7955: --- Yea, I think we should avoid renaming public APIs, though we do have

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151112#comment-15151112 ] Andrew Wang commented on HDFS-9799: --- The ideal way of doing partial results is something like Optional,

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151128#comment-15151128 ] Xiaoyu Yao commented on HDFS-9711: -- Thanks [~cnauroth] for working on this. The patch looks good to me +1.

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151129#comment-15151129 ] Esteban Gutierrez commented on HDFS-8564: - [~vinayrpet] sounds good we can close it as dup. But I

[jira] [Resolved] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez resolved HDFS-8564. - Resolution: Duplicate > BlockPoolSlice.checkDirs() will trigger excessive IO while

[jira] [Updated] (HDFS-9710) Change DN to send block receipt IBRs in batches

[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9710: -- Attachment: h9710_20160217.patch h9710_20160217.patch: fixes a bug that the wait time is

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151193#comment-15151193 ] Hadoop QA commented on HDFS-9799: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151206#comment-15151206 ] Zhe Zhang commented on HDFS-9816: - Thanks Walter, good point that the safe length will change after the

[jira] [Updated] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9782: --- Attachment: HDFS-9782.002.patch And here's a complete patch. I moved the previous

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151225#comment-15151225 ] Chris Nauroth commented on HDFS-9711: - bq. Can we move WebHdfsFileSystem#getTrimmedStringList() with

[jira] [Updated] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9799: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151255#comment-15151255 ] Hudson commented on HDFS-9799: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9316 (See

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151258#comment-15151258 ] Xiaoyu Yao commented on HDFS-9711: -- LGTM, Thanks [~cnauroth] for the clarification! > Integrate CSRF

[jira] [Updated] (HDFS-9804) Allow long-running Balancer in Kerberized Environments

[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9804: Attachment: HDFS-9804.01.patch Patch 1 attached allows the Balancer to login using a keytab. - New

[jira] [Updated] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Attachment: HDFS-1477-HDFS-9000.006.patch > Support reconfiguring dfs.heartbeat.interval and >

[jira] [Updated] (HDFS-9804) Allow long-running Balancer in Kerberized Environments

[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9804: Labels: supportability (was: ) Status: Patch Available (was: Open) > Allow long-running Balancer in

[jira] [Commented] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151267#comment-15151267 ] Xiaobing Zhou commented on HDFS-1477: - I posted patch 006 rebased on HDFS-9094 and HDFS-9801. Kindly

[jira] [Created] (HDFS-9821) HDFS configuration should accept friendly time units

Arpit Agarwal created HDFS-9821: --- Summary: HDFS configuration should accept friendly time units Key: HDFS-9821 URL: https://issues.apache.org/jira/browse/HDFS-9821 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9821) HDFS configuration should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9821: Description: HDFS configuration keys that define time intervals use units inconsistently (Hours,

[jira] [Updated] (HDFS-9821) HDFS configuration should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9821: Description: HDFS configuration keys that define time intervals use units inconsistently (Hours,

[jira] [Assigned] (HDFS-9821) HDFS configuration should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9821: --- Assignee: Xiaobing Zhou > HDFS configuration should accept friendly time units >

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151311#comment-15151311 ] Zhe Zhang commented on HDFS-7955: - Good points Andrew. I took a closer look at related class and variable

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8831: Hadoop Flags: Reviewed (was: Incompatible change,Reviewed) > Trash Support for deletion in HDFS

[jira] [Updated] (HDFS-9821) HDFS configuration should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9821: Issue Type: Improvement (was: Bug) > HDFS configuration should accept friendly time units >

[jira] [Created] (HDFS-9822) BlockManager.validateReconstructionWork throws AssertionError

Tsz Wo Nicholas Sze created HDFS-9822: - Summary: BlockManager.validateReconstructionWork throws AssertionError Key: HDFS-9822 URL: https://issues.apache.org/jira/browse/HDFS-9822 Project: Hadoop

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151420#comment-15151420 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- The failed tests do not seem related. > On upgrade,

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151427#comment-15151427 ] Chris Nauroth commented on HDFS-9395: - bq. We can skip success auditlog for checkAccess and

[jira] [Commented] (HDFS-8923) Add -source flag to balancer usage message

[ https://issues.apache.org/jira/browse/HDFS-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151428#comment-15151428 ] Tsz Wo Nicholas Sze commented on HDFS-8923: --- {code} + "\n\t[-include [-f | ]]" +

[jira] [Resolved] (HDFS-8050) Separate the client conf key from DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8050. --- Resolution: Duplicate The was done by other subtasks in HDFS-8048. > Separate the

[jira] [Updated] (HDFS-8921) Add an option to Balancer for specifying the k-most over-utilized DNs or all over-utilized DNs as sources.

[ https://issues.apache.org/jira/browse/HDFS-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8921: -- Summary: Add an option to Balancer for specifying the k-most over-utilized DNs or all

[jira] [Updated] (HDFS-9800) Add option to send BlockStateChange logs to alternate async appender

[ https://issues.apache.org/jira/browse/HDFS-9800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9800: Assignee: (was: Arpit Agarwal) > Add option to send BlockStateChange logs to alternate async

[jira] [Updated] (HDFS-8022) Erasure Coding: handle read/write failure for non-stripping coding blocks

[ https://issues.apache.org/jira/browse/HDFS-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8022: -- Assignee: (was: Tsz Wo Nicholas Sze) Component/s: erasure-coding > Erasure

[jira] [Assigned] (HDFS-9800) Add option to send BlockStateChange logs to alternate async appender

[ https://issues.apache.org/jira/browse/HDFS-9800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9800: --- Assignee: Xiaobing Zhou > Add option to send BlockStateChange logs to alternate async

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151467#comment-15151467 ] Chris Nauroth commented on HDFS-8855: - I cherry-picked this to branch-2 and branch-2.8. > Webhdfs

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151468#comment-15151468 ] Zhe Zhang commented on HDFS-9734: - Thanks Kai for the work! The refactor looks clean overall. A few minors:

[jira] [Updated] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9711: Attachment: HDFS-9711-branch-2.005.patch There is a small merge conflict for branch-2, so I'm

[jira] [Commented] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151498#comment-15151498 ] Zhe Zhang commented on HDFS-9818: - Thanks Jing, the 2 points listed above look very good. I don't fully

[jira] [Commented] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151506#comment-15151506 ] Hadoop QA commented on HDFS-1477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

Bob Hansen created HDFS-9823: Summary: libhdfs++: Cancel outstanding operations without calling shutdown Key: HDFS-9823 URL: https://issues.apache.org/jira/browse/HDFS-9823 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

[ https://issues.apache.org/jira/browse/HDFS-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9823: - Attachment: HDFS-9823.HDFS-8707.000.patch Adds a mutex to DataNodeConnection operations and removed

[jira] [Updated] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

[ https://issues.apache.org/jira/browse/HDFS-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9823: - Status: Patch Available (was: Open) > libhdfs++: Cancel outstanding operations without calling shutdown >

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151510#comment-15151510 ] Kai Zheng commented on HDFS-9734: - Thanks Zhe for the nice comments! Using getCorruptionMap sounds better

[jira] [Commented] (HDFS-9710) Change DN to send block receipt IBRs in batches

[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151513#comment-15151513 ] Hadoop QA commented on HDFS-9710: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151519#comment-15151519 ] Jing Zhao commented on HDFS-9818: - The error is that while {{getTargetIndices}} does not really put any

[jira] [Created] (HDFS-9824) Unfriendly message while running rename command if target exists

Xiaobing Zhou created HDFS-9824: --- Summary: Unfriendly message while running rename command if target exists Key: HDFS-9824 URL: https://issues.apache.org/jira/browse/HDFS-9824 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9804) Allow long-running Balancer in Kerberized Environments

[ https://issues.apache.org/jira/browse/HDFS-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151525#comment-15151525 ] Hadoop QA commented on HDFS-9804: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9824) Unfriendly message while running rename command if target exists

[ https://issues.apache.org/jira/browse/HDFS-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9824: Description: In the following case, the message {mv: `/tmp/src/1.log': Input/output error} is not

[jira] [Updated] (HDFS-9824) Unfriendly message while running rename command if target exists

[ https://issues.apache.org/jira/browse/HDFS-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9824: Description: In the following case, the message is not friendly, it's better to show . Source

[jira] [Updated] (HDFS-9824) Unfriendly message while running rename command if target exists

[ https://issues.apache.org/jira/browse/HDFS-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9824: Description: In the following case, the message is not friendly, it's better to show . Source

[jira] [Updated] (HDFS-9671) DiskBalancer : SubmitPlan implementation

[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9671: --- Attachment: HDFS-9671-HDFS-1312.006.patch bq. DiskBalancer#shutdown should wait for the executor to

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HDFS-9734-v7.patch Updated the patch according to review comments. > Refactoring of checksum

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-7661: Attachment: HDFS-EC-file-flush-sync-design-version2.0.pdf Thanks for working on this [~demongaorui].

[jira] [Commented] (HDFS-9819) FsVolume should tolerate few times check-dir failed due to deletion by mistake

[ https://issues.apache.org/jira/browse/HDFS-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151562#comment-15151562 ] Lin Yiqun commented on HDFS-9819: - Thanks [~kihwal] for comments. There are two scenarios that will cause

[jira] [Commented] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

[ https://issues.apache.org/jira/browse/HDFS-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151572#comment-15151572 ] Hadoop QA commented on HDFS-9823: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9819) FsVolume should tolerate few times check-dir failed due to deletion by mistake

[ https://issues.apache.org/jira/browse/HDFS-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151580#comment-15151580 ] Lin Yiqun commented on HDFS-9819: - Overall, one time check-dir failed is not always indicated the volume

[jira] [Created] (HDFS-9825) Balancer should not terminate if only one of the namenodes has error

Tsz Wo Nicholas Sze created HDFS-9825: - Summary: Balancer should not terminate if only one of the namenodes has error Key: HDFS-9825 URL: https://issues.apache.org/jira/browse/HDFS-9825 Project:

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151600#comment-15151600 ] Vinayakumar B commented on HDFS-9815: - Thanks [~wheat9] and [~liuml07]. > Move o.a.h.fs.Hdfs to

[jira] [Updated] (HDFS-9825) Balancer should not terminate if only one of the namenodes has error

[ https://issues.apache.org/jira/browse/HDFS-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9825: -- Attachment: h9825_20160217.patch h9825_20160217.patch: 1st patch. > Balancer should not

[jira] [Updated] (HDFS-9825) Balancer should not terminate if only one of the namenodes has error

[ https://issues.apache.org/jira/browse/HDFS-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9825: -- Status: Patch Available (was: Open) > Balancer should not terminate if only one of the

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151605#comment-15151605 ] Vinayakumar B commented on HDFS-8564: - bq. But I think we still need to rate-limit the DiskChecker.

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151609#comment-15151609 ] Rui Li commented on HDFS-9816: -- Thanks guys for the discussion. I added

[jira] [Commented] (HDFS-9821) HDFS configuration should accept friendly time units

[ https://issues.apache.org/jira/browse/HDFS-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151618#comment-15151618 ] Vinayakumar B commented on HDFS-9821: - This sounds excellent. #1 looks convincing, and similar support

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151628#comment-15151628 ] GAO Rui commented on HDFS-7661: --- [~liuml07], thank you very much to join this task. I will learn your design

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151643#comment-15151643 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151653#comment-15151653 ] Rui Li commented on HDFS-9816: -- [~zhz], I think you mean {{TestBlockRecovery#testSafeLength}} right? If we

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151661#comment-15151661 ] Vinayakumar B commented on HDFS-8578: - +1, Latest patch looks good to me. > On upgrade, Datanode

  1   2   >