[jira] [Comment Edited] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386887#comment-15386887 ] John Zhuge edited comment on HDFS-6962 at 7/21/16 5:41 AM: --- Thanks [~eddyxu] for

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387207#comment-15387207 ] Yuanbo Liu commented on HDFS-10645: --- uploaded v4 patch > Make block report size as a metric and add

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Attachment: HDFS-10645.004.patch > Make block report size as a metric and add this metric to datanode

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387179#comment-15387179 ] Hadoop QA commented on HDFS-10645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386792#comment-15386792 ] Yongjun Zhang edited comment on HDFS-10652 at 7/21/16 5:12 AM: --- Thanks a lot

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387160#comment-15387160 ] Hadoop QA commented on HDFS-10225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387155#comment-15387155 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387153#comment-15387153 ] Hadoop QA commented on HDFS-10660: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387129#comment-15387129 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387094#comment-15387094 ] Hadoop QA commented on HDFS-10654: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387083#comment-15387083 ] Yongjun Zhang commented on HDFS-10587: -- Thanks for your reply [~xupener]. Yes, HDFS-4660 +

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387066#comment-15387066 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387057#comment-15387057 ] Hadoop QA commented on HDFS-10645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10651: - Status: Patch Available (was: Open) Re-submit the patch to trigger the building. > Clean up some

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10651: - Status: Open (was: Patch Available) > Clean up some configuration related codes about legacy block

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-20 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387045#comment-15387045 ] xupeng commented on HDFS-10587: --- Hi [~yzhangal] [~vinayrpet]: Sorry for the late reply, I checked my

[jira] [Comment Edited] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-20 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387045#comment-15387045 ] xupeng edited comment on HDFS-10587 at 7/21/16 2:52 AM: Hi [~yzhangal],

[jira] [Commented] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387042#comment-15387042 ] Yiqun Lin commented on HDFS-10663: -- Thanks [~shahrs87] for reporting this. I found anther two similar

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Attachment: HDFS-10660-01.patch > Expose storage policy apis via HDFSAdmin interface >

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Target Version/s: 2.9.0 (was: 3.0.0-alpha2) > Expose storage policy apis via HDFSAdmin interface >

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387019#comment-15387019 ] Yuanbo Liu commented on HDFS-10645: --- [~ajisakaa] Thanks for your good guidance. I will create a new

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-07-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386985#comment-15386985 ] Yiqun Lin commented on HDFS-10625: -- Hi, [~shahrs87], this jira is similar to HDFS-10626. Some codes are

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-07-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8668: Assignee: SammiChen (was: Kai Zheng) > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386953#comment-15386953 ] Hadoop QA commented on HDFS-10645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386946#comment-15386946 ] Hadoop QA commented on HDFS-10654: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-07-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.003.patch > Modifications to remove the assumption that

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.012.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386922#comment-15386922 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks for the review [~liuml07]. I have

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386911#comment-15386911 ] Hadoop QA commented on HDFS-10225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-10519: -- Attachment: HDFS-10519.009.patch Fix some problems according to Andrew's recent comment. > Add a

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386887#comment-15386887 ] John Zhuge commented on HDFS-6962: -- Thanks [~eddyxu] for the review! Great comments. I will fix the

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-07-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386863#comment-15386863 ] Jing Zhao commented on HDFS-10659: -- I think we do not need to manually recreate the "current" directory

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386845#comment-15386845 ] Konstantin Shvachko commented on HDFS-10301: As I commented earlier I am not in favor of

[jira] [Commented] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386843#comment-15386843 ] Aaron T. Myers commented on HDFS-10654: --- Patch looks good to me. +1 pending Jenkins. Thanks,

[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-07-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10659: -- Description: In my environment I am seeing {{Namenodes}} crashing down after majority of

[jira] [Created] (HDFS-10665) Provide a way to add a new Journalnode to an existing quorum

2016-07-20 Thread Amit Anand (JIRA)
Amit Anand created HDFS-10665: - Summary: Provide a way to add a new Journalnode to an existing quorum Key: HDFS-10665 URL: https://issues.apache.org/jira/browse/HDFS-10665 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386804#comment-15386804 ] Andrew Wang commented on HDFS-10519: Thanks for revving Jiayi. Overall looks good, mostly just nits

[jira] [Comment Edited] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386792#comment-15386792 ] Yongjun Zhang edited comment on HDFS-10652 at 7/20/16 11:29 PM: Thanks a

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10652.003.patch > Add a unit test for HDFS-4660 > -

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: (was: HDFS-10652.003.patch) > Add a unit test for HDFS-4660 >

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10652.003.patch > Add a unit test for HDFS-4660 > -

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386792#comment-15386792 ] Yongjun Zhang commented on HDFS-10652: -- Thanks a lot for the updated rev [~vinayrpet]! I'm uploading

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386791#comment-15386791 ] Arpit Agarwal commented on HDFS-10664: -- Yeah I have come across this too and it is a harmless

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386782#comment-15386782 ] Andrew Wang commented on HDFS-10301: My understanding of PB is that we have a fixed 4 bits for tags,

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-07-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386773#comment-15386773 ] Zhe Zhang commented on HDFS-10584: -- Thanks Rakesh. The patch looks good overall (pretty much the same

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386767#comment-15386767 ] Lei (Eddy) Xu commented on HDFS-6962: - Hi, [~jzhuge] Thanks for providing the patch: *

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386763#comment-15386763 ] Akira Ajisaka commented on HDFS-10645: -- {code} // need to keep maxDataLength up-to-date, this is

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386756#comment-15386756 ] Rakesh R commented on HDFS-10660: - Test case failure is unrelated to the patch, please ignore it. >

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386748#comment-15386748 ] Akira Ajisaka commented on HDFS-10645: -- Thank you for the update. # blockReportSizes must be

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386747#comment-15386747 ] Hadoop QA commented on HDFS-10660: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386399#comment-15386399 ] John Zhuge edited comment on HDFS-6962 at 7/20/16 10:40 PM: [~cnauroth] and

[jira] [Commented] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386708#comment-15386708 ] Hadoop QA commented on HDFS-10649: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386702#comment-15386702 ] Konstantin Shvachko commented on HDFS-10301: My general approach to protobuf structures is to

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386697#comment-15386697 ] Hadoop QA commented on HDFS-6962: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386685#comment-15386685 ] Chris Nauroth commented on HDFS-10664: -- [~aanand001c], thank you for filing this. I had an old note

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386686#comment-15386686 ] Hadoop QA commented on HDFS-10287: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386656#comment-15386656 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10664: -- Description: After a cluster is upgraded I see a mismatch in {{layoutVersion}} between NN VERSION file

[jira] [Created] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Amit Anand (JIRA)
Amit Anand created HDFS-10664: - Summary: layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade Key: HDFS-10664 URL: https://issues.apache.org/jira/browse/HDFS-10664

[jira] [Commented] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386645#comment-15386645 ] Hadoop QA commented on HDFS-10658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386644#comment-15386644 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Status: Open (was: Patch Available) I am canceling patch available, because Jenkins

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386538#comment-15386538 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386547#comment-15386547 ] Hadoop QA commented on HDFS-10658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386477#comment-15386477 ] Rushabh S Shah commented on HDFS-10625: --- [~yzhangal] [~jojochuang]: any further comments on the

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10662: --- Status: Patch Available (was: Open) > Optimize UTF8 string/byte conversions >

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10662: --- Attachment: HDFS-10662.patch > Optimize UTF8 string/byte conversions >

[jira] [Commented] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386440#comment-15386440 ] Chen Liang commented on HDFS-10649: --- Did not notice how applyUMask was implemented in parent class

[jira] [Updated] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10649: -- Attachment: HDFS-10649.002.patch > Remove unused PermissionStatus#applyUMask >

[jira] [Commented] (HDFS-10425) Clean up NNStorage and TestSaveNamespace

2016-07-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386406#comment-15386406 ] Hudson commented on HDFS-10425: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10126 (See

[jira] [Commented] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386398#comment-15386398 ] Hadoop QA commented on HDFS-10658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: HDFS-6962.007.patch [~cnauroth] and [~eddyxu] Please review patch 007. Diff from 006: * Add

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10287: - Priority: Minor (was: Trivial) > MiniDFSCluster should implement AutoCloseable >

[jira] [Updated] (HDFS-10616) Improve performance of path handling

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10616: --- Attachment: 2.6-2.7.1-heap.png Here's an illustration how the GC characteristics on a moderated sized

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386388#comment-15386388 ] Akira Ajisaka commented on HDFS-10287: -- Hi [~boky01], would you rebase the patch for the latest

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Status: Patch Available (was: Open) > Expose storage policy apis via HDFSAdmin interface >

[jira] [Commented] (HDFS-10661) Make MiniDFSCluster AutoCloseable

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386377#comment-15386377 ] Akira Ajisaka commented on HDFS-10661: -- Thanks [~jzhuge] for the information and closing this issue.

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Description: I was chasing a bug where the namenode didn't declare a datanode dead even when

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Description: I was chasing a bug where the namenode didn't declare a datanode dead even when

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386374#comment-15386374 ] Rakesh R commented on HDFS-10660: - Attached patch to support storage policy apis in {{HdfsAdmin}}.

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Summary: Comparison of two System.nanoTime methods return values are against standard java

[jira] [Resolved] (HDFS-10661) Make MiniDFSCluster AutoCloseable

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10661. --- Resolution: Duplicate [~ajisakaa] Looks like a dup of HDFS-10287. Please re-open if you think

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Attachment: HDFS-10660-00.patch > Expose storage policy apis via HDFSAdmin interface >

[jira] [Created] (HDFS-10663) Comparison of two System.nanoTimes methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-10663: - Summary: Comparison of two System.nanoTimes methods return values are against standard java recoemmendations. Key: HDFS-10663 URL:

[jira] [Commented] (HDFS-10616) Improve performance of path handling

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386358#comment-15386358 ] Daryn Sharp commented on HDFS-10616: I chose 2.9 solely because branch-2 and trunk have drifted often

[jira] [Created] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10662: -- Summary: Optimize UTF8 string/byte conversions Key: HDFS-10662 URL: https://issues.apache.org/jira/browse/HDFS-10662 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386342#comment-15386342 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386306#comment-15386306 ] Colin P. McCabe commented on HDFS-10301: bq. [~redvine] asked: Colin P. McCabe Doesn't TCP ignore

[jira] [Created] (HDFS-10661) Make MiniDFSCluster AutoCloseable

2016-07-20 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-10661: Summary: Make MiniDFSCluster AutoCloseable Key: HDFS-10661 URL: https://issues.apache.org/jira/browse/HDFS-10661 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-07-20 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-10544: --- Fix Version/s: (was: 2.7.3) 2.7.4 2.7.3 was already

[jira] [Updated] (HDFS-10425) Clean up NNStorage and TestSaveNamespace

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10425: - Priority: Minor (was: Trivial) > Clean up NNStorage and TestSaveNamespace >

[jira] [Updated] (HDFS-10425) Clean up NNStorage and TestSaveNamespace

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10425: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10425) Clean up NNStorage and TestSaveNamespace

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386270#comment-15386270 ] Akira Ajisaka commented on HDFS-10425: -- LGTM, +1. > Clean up NNStorage and TestSaveNamespace >

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386262#comment-15386262 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386258#comment-15386258 ] Hadoop QA commented on HDFS-10658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-8914) Document HA support in the HDFS HdfsDesign.md

2016-07-20 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved HDFS-8914. --- Resolution: Fixed Closing this again. > Document HA support in the HDFS

[jira] [Commented] (HDFS-10616) Improve performance of path handling

2016-07-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386239#comment-15386239 ] Zhe Zhang commented on HDFS-10616: -- Thanks much for posting the JIRAs / patches Daryn. Quick question:

[jira] [Created] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
Rakesh R created HDFS-10660: --- Summary: Expose storage policy apis via HDFSAdmin interface Key: HDFS-10660 URL: https://issues.apache.org/jira/browse/HDFS-10660 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10613) Wrong real size when a DSQuotaExceededException occur

2016-07-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15386213#comment-15386213 ] Chen Liang commented on HDFS-10613: --- Hi Xiaohe, Yes! That's exactly how you got 384M : 3 block

[jira] [Work started] (HDFS-10657) testAclCLI.xml inherit default ACL to dir test should expect mask r-x

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10657 started by John Zhuge. - > testAclCLI.xml inherit default ACL to dir test should expect mask r-x >

  1   2   >