[jira] [Updated] (HDFS-3562) Handle disconnect and session timeout events at BKJM

2016-10-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-3562: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Closing as wn't

[jira] [Resolved] (HDFS-3908) In HA mode, when there is a ledger in BK missing, which is generated after the last checkpoint, NN can not restore it.

2016-10-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-3908. Resolution: Won't Fix Closing as wn't fix as per discussion

[jira] [Resolved] (HDFS-4613) Improve BKJM documentation

2016-10-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-4613. Resolution: Won't Fix Closing as wn't fix as per discussion

[jira] [Commented] (HDFS-3399) BookKeeper option support for NN HA

2016-10-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554191#comment-15554191 ] Brahma Reddy Battula commented on HDFS-3399: Going to close all the subtasks as per discussion

[jira] [Updated] (HDFS-10977) Balancer should query NameNode with a timeout

2016-10-06 Thread Senthilkumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Senthilkumar updated HDFS-10977: Attachment: Gmail - HDFS Balancer Stuck after 10 Minz.pdf > Balancer should query NameNode with a

[jira] [Commented] (HDFS-10977) Balancer should query NameNode with a timeout

2016-10-06 Thread Senthilkumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554136#comment-15554136 ] Senthilkumar commented on HDFS-10977: - [~zhz] , When i was working with balancer last month i too

[jira] [Commented] (HDFS-10973) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15554035#comment-15554035 ] Xiaobing Zhou commented on HDFS-10973: -- Thanks [~brahmareddy], you are correct, I just noticed it's

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-06 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553930#comment-15553930 ] Takanobu Asanuma commented on HDFS-10975: - [~jojochuang] Thank you for filing the issue! If you

[jira] [Resolved] (HDFS-10973) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-10973. - Resolution: Duplicate [~xiaobingo] resolving as duplicate of HDFS-10972..Please

[jira] [Assigned] (HDFS-10974) Document replication factor for EC files.

2016-10-06 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-10974: Assignee: Yiqun Lin > Document replication factor for EC files. >

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553665#comment-15553665 ] Mingliang Liu commented on HDFS-10903: -- Test failure {{hadoop.tools.TestHdfsConfigFields}} is

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553642#comment-15553642 ] Hadoop QA commented on HDFS-10903: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10977) Balancer should query NameNode with a timeout

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10977: - Attachment: HDFS-10977-reproduce.patch Uploading a patch to demonstrate the issue (not the solution). Log

[jira] [Created] (HDFS-10977) Balancer should query NameNode with a timeout

2016-10-06 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-10977: Summary: Balancer should query NameNode with a timeout Key: HDFS-10977 URL: https://issues.apache.org/jira/browse/HDFS-10977 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10976) Fsck should mark EC files explicitly

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10976: -- Summary: Fsck should mark EC files explicitly Key: HDFS-10976 URL: https://issues.apache.org/jira/browse/HDFS-10976 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553516#comment-15553516 ] Hadoop QA commented on HDFS-10912: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553483#comment-15553483 ] Wei-Chiu Chuang commented on HDFS-10975: It is also worth noting that without any parameters, the

[jira] [Updated] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10975: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > fsck -list-corruptfileblocks

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553474#comment-15553474 ] Hadoop QA commented on HDFS-10972: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-10-06 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553458#comment-15553458 ] Uma Maheswara Rao G commented on HDFS-10801: Thank you [~rakeshr] for working on this. Overall

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553439#comment-15553439 ] Mingliang Liu commented on HDFS-10972: -- I found most of my comments can be addressed if you refer the

[jira] [Updated] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-5684: - Affects Version/s: (was: 2.2.0) 3.0.0-alpha2 Target

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10903: -- Status: Patch Available (was: Open) > Replace config key literal strings with config key names II:

[jira] [Updated] (HDFS-5684) o.a.h.fs.viewfs.ViewFileSystem.MountPoint has no public methods.

2016-10-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-5684: - Attachment: HDFS-5684.01.patch Attaching v01 patch to expose src and targets from

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553428#comment-15553428 ] Hadoop QA commented on HDFS-10967: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Fix Version/s: 3.0.0-alpha2 > Refactor TestDFSShell by setting up MiniDFSCluser once for all

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553400#comment-15553400 ] Mingliang Liu commented on HDFS-10965: -- Thanks for the patch, [~xiaobingo]. Can you update the patch

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553388#comment-15553388 ] Mingliang Liu commented on HDFS-10972: -- Thanks for the patch. I think this UT is useful. I'll confirm

[jira] [Commented] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553377#comment-15553377 ] Kihwal Lee commented on HDFS-10925: --- [~daryn] Please have a look. > Cache symlinkString in INodeSymlink

[jira] [Updated] (HDFS-10826) Correctly report missing EC blocks in FSCK

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10826: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10826) Correctly report missing EC blocks in FSCK

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553336#comment-15553336 ] Wei-Chiu Chuang commented on HDFS-10826: The code seems to have bug. Please see HDFS-10975 for

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553330#comment-15553330 ] Andrew Wang commented on HDFS-10971: 1, based on this code from S3AFileStatus: {code} // Files

[jira] [Created] (HDFS-10975) fsck -list-corruptfileblocks does not report corrupt EC files

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10975: -- Summary: fsck -list-corruptfileblocks does not report corrupt EC files Key: HDFS-10975 URL: https://issues.apache.org/jira/browse/HDFS-10975 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553311#comment-15553311 ] Hudson commented on HDFS-10955: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10561 (See

[jira] [Updated] (HDFS-10912) Ozone:SCM: Add chill mode support to NodeManager.

2016-10-06 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10912: Attachment: HDFS-10912-HDFS-7240.003.patch [~xyao] Thank you for the comments and apologies for

[jira] [Updated] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10955: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553241#comment-15553241 ] Kihwal Lee commented on HDFS-10955: --- +1 > Pass IIP for FSDirAttr methods >

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553245#comment-15553245 ] Zhe Zhang commented on HDFS-10971: -- Thanks for identifying the issue [~jojochuang] and [~andrew.wang]

[jira] [Issue Comment Deleted] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10955: -- Comment: was deleted (was: +1) > Pass IIP for FSDirAttr methods > -- > >

[jira] [Commented] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553239#comment-15553239 ] Kihwal Lee commented on HDFS-10955: --- +1 > Pass IIP for FSDirAttr methods >

[jira] [Commented] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553234#comment-15553234 ] Xiaobing Zhou commented on HDFS-10972: -- v000 is posted for reviews, thanks. > Add unit test for HDFS

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10972: - Status: Patch Available (was: Open) > Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553236#comment-15553236 ] Wei-Chiu Chuang commented on HDFS-10971: THat's a valid point. Currently HdfsFileStatus has a

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10972: - Attachment: HDFS-10972.000.patch > Add unit test for HDFS command 'dfsadmin -getDatanodeInfo' >

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553164#comment-15553164 ] Andrew Wang commented on HDFS-10971: If the EC policy is showing up as the replication factor in

[jira] [Commented] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553159#comment-15553159 ] Hadoop QA commented on HDFS-10955: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Attachment: HDFS-10967.poc.patch Attaching a PoC patch just to demonstrate the idea. > Add configuration

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Status: Patch Available (was: Open) > Add configuration for BlockPlacementPolicy to avoid near-full

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553120#comment-15553120 ] Hudson commented on HDFS-10939: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10560 (See

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10939: -- Fix Version/s: 3.0.0-alpha2 > Reduce performance penalty of encryption zones >

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553090#comment-15553090 ] Kihwal Lee commented on HDFS-10939: --- Committed it to trunk, but branch-2 merge is not clean. The

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553049#comment-15553049 ] Kihwal Lee commented on HDFS-10939: --- +1 the new patch looks good. > Reduce performance penalty of

[jira] [Commented] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552984#comment-15552984 ] Hadoop QA commented on HDFS-10965: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552978#comment-15552978 ] Hadoop QA commented on HDFS-10939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10955) Pass IIP for FSDirAttr methods

2016-10-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10955: --- Attachment: HDFS-10955.1.patch Not sure how that happened. Fixed. > Pass IIP for FSDirAttr methods

[jira] [Updated] (HDFS-8707) Implement an async pure c++ HDFS client

2016-10-06 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-8707: - Assignee: James Clampffer (was: Bob Hansen) > Implement an async pure c++ HDFS client >

[jira] [Created] (HDFS-10974) Document replication factor for EC files.

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10974: -- Summary: Document replication factor for EC files. Key: HDFS-10974 URL: https://issues.apache.org/jira/browse/HDFS-10974 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552912#comment-15552912 ] Mingliang Liu commented on HDFS-10903: -- +1 pending on Jenkins. > Replace config key literal strings

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552909#comment-15552909 ] Mingliang Liu commented on HDFS-10903: -- {{dfs.namenode.fslock.fair}} is being tracked in [HDFS-5239].

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552903#comment-15552903 ] Wei-Chiu Chuang commented on HDFS-10971: The other place to check is

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-10-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10903: -- Attachment: HDFS-10903.002.patch Uploaded v02 patch. Whether to expose the key of

[jira] [Updated] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10972: - Description: getDatanodeInfo should be tested in admin CLI. > Add unit test for HDFS command

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10971: --- Description: The current erasure coding implementation uses replication refactor field to

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552810#comment-15552810 ] Zhe Zhang commented on HDFS-10967: -- I'd like to discuss a few design perspectives. In general, I think

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10971: --- Description: The current erasure coding implementation uses replication factor field to

[jira] [Created] (HDFS-10973) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10973: Summary: Add unit test for HDFS command 'dfsadmin -getDatanodeInfo' Key: HDFS-10973 URL: https://issues.apache.org/jira/browse/HDFS-10973 Project: Hadoop HDFS

[jira] [Created] (HDFS-10972) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10972: Summary: Add unit test for HDFS command 'dfsadmin -getDatanodeInfo' Key: HDFS-10972 URL: https://issues.apache.org/jira/browse/HDFS-10972 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10965: - Summary: Add unit test for HDFS command 'dfsadmin -getDatanodeInfo' (was: Add unit test for HDFS

[jira] [Updated] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10965: - Summary: Add unit test for HDFS command 'dfsadmin -printTopology' (was: Add unit test for HDFS

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10971: --- Labels: hdfs-ec-3.0-must-do (was: ) > Distcp should not copy replication factor if source file is

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10971: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > Distcp should not copy

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10971: --- Attachment: HDFS-10971.testcase.patch Attach a unit test that demonstrates the failure. The

[jira] [Commented] (HDFS-10963) Reduce log level when network topology cannot find enough datanodes.

2016-10-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552765#comment-15552765 ] Xiao Chen commented on HDFS-10963: -- Thank you [~brahmareddy]! > Reduce log level when network topology

[jira] [Created] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2016-10-06 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10971: -- Summary: Distcp should not copy replication factor if source file is erasure coded Key: HDFS-10971 URL: https://issues.apache.org/jira/browse/HDFS-10971 Project:

[jira] [Updated] (HDFS-9878) Data transfer encryption with AES 192: Invalid key length.

2016-10-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9878: Assignee: Harsh J > Data transfer encryption with AES 192: Invalid key length. >

[jira] [Updated] (HDFS-10965) Add unit test for HDFS command 'dfsadmin -printTopology'

2016-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10965: - Attachment: HDFS-10965.003.patch Posted patch v003, using ToolRunner to invoke it instead of

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10939: --- Attachment: HDFS-10939.2.patch Address kihwal's comments. Had to add another fault injector method

[jira] [Comment Edited] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552636#comment-15552636 ] Erik Krogen edited comment on HDFS-10921 at 10/6/16 5:50 PM: - [~shahrs87], I

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552636#comment-15552636 ] Erik Krogen commented on HDFS-10921: [~shahrs87], I tried that previously, but when running the entire

[jira] [Assigned] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-10967: Assignee: Zhe Zhang > Add configuration for BlockPlacementPolicy to avoid near-full DataNodes >

[jira] [Commented] (HDFS-10970) Update jackson from 1.9.13 to 2.x in hadoop-hdfs

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552575#comment-15552575 ] Hadoop QA commented on HDFS-10970: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10745: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Description: Large production clusters are likely to have heterogeneous nodes in terms of storage

[jira] [Updated] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10967: - Description: Large production clusters are likely to have heterogeneous nodes in terms of storage

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2016-10-06 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552396#comment-15552396 ] Rushabh S Shah commented on HDFS-10921: --- bq. So the only problem that we have is the issue that

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Moved] (HDFS-10970) Update jackson from 1.9.13 to 2.x in hadoop-hdfs

2016-10-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka moved HADOOP-13683 to HDFS-10970: --- Target Version/s: 3.0.0-alpha2 (was: 3.0.0-alpha2)

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552241#comment-15552241 ] Yongjun Zhang commented on HDFS-9820: - Hi [~andrew.wang], As I verbally addressed your question

[jira] [Comment Edited] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552241#comment-15552241 ] Yongjun Zhang edited comment on HDFS-9820 at 10/6/16 3:35 PM: -- Hi

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash (II)

2016-10-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552077#comment-15552077 ] Weiwei Yang commented on HDFS-10922: Sounds good to me, will work on that. I was adding the permission

[jira] [Commented] (HDFS-10957) Retire BKJM from trunk

2016-10-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552052#comment-15552052 ] Hudson commented on HDFS-10957: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10555 (See

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-06 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552022#comment-15552022 ] Daryn Sharp commented on HDFS-10939: Agreed, I wasn't very fond of the locking asymmetry. Original

[jira] [Commented] (HDFS-10957) Retire BKJM from trunk

2016-10-06 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552017#comment-15552017 ] Vinayakumar B commented on HDFS-10957: -- Committed to trunk. Thanks [~brahmareddy] and [~kihwal] And

[jira] [Commented] (HDFS-10957) Retire BKJM from trunk

2016-10-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551954#comment-15551954 ] Brahma Reddy Battula commented on HDFS-10957: - Latest patch looks good to me , +1..Thanks

[jira] [Commented] (HDFS-10963) Reduce log level when network topology cannot find enough datanodes.

2016-10-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551839#comment-15551839 ] Hudson commented on HDFS-10963: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10553 (See

[jira] [Updated] (HDFS-10963) Reduce log level when network topology cannot find enough datanodes.

2016-10-06 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10963: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-9337) Should check required params in WebHDFS to avoid NPE

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551781#comment-15551781 ] Hadoop QA commented on HDFS-9337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10933) Refactor TestFsck

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551747#comment-15551747 ] Hadoop QA commented on HDFS-10933: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9878) Data transfer encryption with AES 192: Invalid key length.

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551661#comment-15551661 ] ASF GitHub Bot commented on HDFS-9878: -- GitHub user QwertyManiac opened a pull request:

[jira] [Updated] (HDFS-9337) Should check required params in WebHDFS to avoid NPE

2016-10-06 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-9337: --- Attachment: HDFS-9337_06.patch Updating with check style fix,pls review > Should check

  1   2   >