[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156877#comment-16156877 ] Kai Zheng commented on HDFS-7859: - Thanks Sammi for the update. The patch seems in much better form. 1. Do

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager and related codes

2017-09-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12402: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156883#comment-16156883 ] Kai Zheng commented on HDFS-12402: -- The patch LGTM and +1. Will commit it shortly. > Refactor

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156802#comment-16156802 ] Hadoop QA commented on HDFS-1: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12399) Improve erasure coding codec framework adding more unit tests

2017-09-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12399: - Summary: Improve erasure coding codec framework adding more unit tests (was: Improve erasure coding

[jira] [Commented] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-09-07 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156817#comment-16156817 ] steven-wugang commented on HDFS-12353: -- [~eddyxu]ok,thanks for your review. I will add a test for

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager and related codes

2017-09-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12402: - Summary: Refactor ErasureCodingPolicyManager and related codes (was: Refactor

[jira] [Updated] (HDFS-10787) libhdfs++: Public API should expose configuration parser

2017-09-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10787: --- Resolution: Fixed Status: Resolved (was: Patch Available) LGTM, +1. Committed to

[jira] [Updated] (HDFS-10787) libhdfs++: Public API should expose configuration parser

2017-09-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10787: --- Summary: libhdfs++: Public API should expose configuration parser (was: libhdfs++:

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-09-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157122#comment-16157122 ] Sean Mackrory commented on HDFS-11096: -- {quote} It would be good to document the order of running the

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-09-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157192#comment-16157192 ] Allen Wittenauer commented on HDFS-11096: - {code} set -e {code} I'm really not a fan of using set

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-07 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157346#comment-16157346 ] Lei (Eddy) Xu commented on HDFS-7859: - Hi, [~Sammi] Thanks for the newly updated patch. It is much

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-09-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157421#comment-16157421 ] Ajay Kumar commented on HDFS-12350: --- [~anu], Thanks for review and commit. > Support meta tags in

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157475#comment-16157475 ] Xiaoyu Yao commented on HDFS-12387: --- [~anu], Thanks for the patch. Can you rebase the patch to latest

[jira] [Updated] (HDFS-12376) Enable JournalNode Sync by default

2017-09-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12376: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Comment Edited] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-09-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157192#comment-16157192 ] Allen Wittenauer edited comment on HDFS-11096 at 9/7/17 4:42 PM: - {code}

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-09-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157330#comment-16157330 ] Hanisha Koneru commented on HDFS-12376: --- Thank you [~arpitagarwal], [~liuml07] and [~jingzhao] for

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-09-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157370#comment-16157370 ] Anu Engineer commented on HDFS-12350: - +1, There are some checkstyle issues. I will fix them while

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157205#comment-16157205 ] Wei-Chiu Chuang commented on HDFS-12400: Very trivial nit: {code} LOG.info("Re-encryption using

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157353#comment-16157353 ] Yongjun Zhang commented on HDFS-12357: -- Many thanks to [~asuresh], [~chris.douglas], [~daryn],

[jira] [Commented] (HDFS-12403) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157216#comment-16157216 ] Wei-Chiu Chuang commented on HDFS-12403: Hi [~yangjiandan] thanks for reporting the issue. It

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157349#comment-16157349 ] Yongjun Zhang commented on HDFS-12369: -- +1 on rev3. Thanks Xiao. > Edit log corruption due to hard

[jira] [Comment Edited] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-07 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157346#comment-16157346 ] Lei (Eddy) Xu edited comment on HDFS-7859 at 9/7/17 6:08 PM: - Hi, [~Sammi]

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157614#comment-16157614 ] Anu Engineer commented on HDFS-12387: - bq. Thanks for the patch. Can you rebase the patch to latest

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Attachment: HDFS-12384-HDFS-10467-005.patch Removing {curator-framework} from {hadoop-hdfs}. This

[jira] [Updated] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12357: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157609#comment-16157609 ] Anu Engineer commented on HDFS-12387: - [~nandakumar131] Thanks for your valuable comments. bq. Case

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467.011.patch > Federation Metrics > -- > >

[jira] [Commented] (HDFS-12388) A bad error message in DFSStripedOutputStream

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157688#comment-16157688 ] Hudson commented on HDFS-12388: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157690#comment-16157690 ] Hudson commented on HDFS-12359: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157685#comment-16157685 ] Hudson commented on HDFS-12383: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12392) Writing striped file failed due to different cell size

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157694#comment-16157694 ] Hudson commented on HDFS-12392: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157693#comment-16157693 ] Hudson commented on HDFS-12377: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-11882) Precisely calculate acked length of striped block groups in updatePipeline

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157691#comment-16157691 ] Hudson commented on HDFS-11882: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12404) Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attributes.provider

2017-09-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157753#comment-16157753 ] Yongjun Zhang commented on HDFS-12404: -- Thank you very much [~manojg] for helping to take care of

[jira] [Assigned] (HDFS-12404) Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attribute.provider

2017-09-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-12404: - Assignee: Manoj Govindassamy > Name of config introduced by HDFS-12357 need to

[jira] [Updated] (HDFS-12404) Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attributes.provider

2017-09-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12404: - Summary: Name of config introduced by HDFS-12357 need to be changed from authorization.provider

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-07 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157570#comment-16157570 ] Surendra Singh Lilhore commented on HDFS-12291: --- Attached v3 patch. Please review... bq. An

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-07 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-03.patch > [SPS]: Provide a mechanism to

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157618#comment-16157618 ] Anu Engineer commented on HDFS-12387: - [~nandakumar131] I will also add a high level doc to this JIRA,

[jira] [Created] (HDFS-12404) Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attribute.provider

2017-09-07 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12404: Summary: Name of config introduced by HDFS-12357 need to be changed from authorization.provider to attribute.provider Key: HDFS-12404 URL:

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Description: Build is failing because of changes in {{ClientProtocol}} and dependencies from

[jira] [Comment Edited] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157625#comment-16157625 ] Íñigo Goiri edited comment on HDFS-12384 at 9/7/17 8:49 PM: Removing

[jira] [Updated] (HDFS-12376) Enable JournalNode Sync by default

2017-09-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12376: - Fix Version/s: (was: 3.0.0-beta1) 3.1.0 > Enable JournalNode Sync by

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157706#comment-16157706 ] Hudson commented on HDFS-12357: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157710#comment-16157710 ] Hudson commented on HDFS-12350: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157705#comment-16157705 ] Hudson commented on HDFS-12376: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12402) Refactor ErasureCodingPolicyManager and related codes

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157704#comment-16157704 ] Hudson commented on HDFS-12402: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12811 (See

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-09-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157720#comment-16157720 ] Andrew Wang commented on HDFS-1: Hi Huafeng, thanks for revving, I was most of the way through

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157734#comment-16157734 ] Andrew Wang commented on HDFS-12349: Thanks for the rev Eddy, LGTM +1 pending this little nit: *

[jira] [Updated] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12400: - Attachment: HDFS-12400.02.patch > Provide a way for NN to drain the local key cache before re-encryption

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157761#comment-16157761 ] Xiao Chen commented on HDFS-12400: -- Thank you for the review Wei-Chiu! bq. nit That only happens for

[jira] [Updated] (HDFS-12404) Name of config introduced by HDFS-12357 need to be changed from authorization.provider to inode.attributes.provider

2017-09-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12404: - Summary: Name of config introduced by HDFS-12357 need to be changed from authorization.provider

[jira] [Comment Edited] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157761#comment-16157761 ] Xiao Chen edited comment on HDFS-12400 at 9/7/17 10:13 PM: --- Thank you for the

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-09-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12350: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Target

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157633#comment-16157633 ] Kai Zheng commented on HDFS-7859: - bq. Checking file / directory that is using this particular policy is a

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Fixing compilation issue with

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-07 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Attachment: HDFS-12349.02.patch Hi, [~andrew.wang] Thanks for the review, addressed your

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157723#comment-16157723 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467.012.patch > Federation Metrics > -- > >

[jira] [Updated] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12404: -- Affects Version/s: 3.0.0-beta1 Target Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157790#comment-16157790 ] Hadoop QA commented on HDFS-12291: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157836#comment-16157836 ] Wei-Chiu Chuang commented on HDFS-12400: Okay I see. For cancellation,

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.3 3.0.0-beta1

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157876#comment-16157876 ] Hudson commented on HDFS-12369: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12813 (See

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12395: - Summary: Support erasure coding policy operations in namenode edit log (was: Support erasure coding

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157942#comment-16157942 ] Manoj Govindassamy commented on HDFS-12357: --- hdfs-default.xml is missing the right config param

[jira] [Commented] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157944#comment-16157944 ] Hudson commented on HDFS-12404: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12815 (See

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157976#comment-16157976 ] Hadoop QA commented on HDFS-12400: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157982#comment-16157982 ] Hudson commented on HDFS-12349: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12817 (See

[jira] [Updated] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12404: -- Description: HDFS-12357 introduced a new config

[jira] [Commented] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157805#comment-16157805 ] Yongjun Zhang commented on HDFS-12404: -- Thanks [~manojg]. LGTM. +1. > Rename hdfs config

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157908#comment-16157908 ] Wei-Chiu Chuang commented on HDFS-12400: +1 pending Jenkins > Provide a way for NN to drain the

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157936#comment-16157936 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-09-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157958#comment-16157958 ] Íñigo Goiri commented on HDFS-12335: Finally! The build came almost clean! The unit tests don't seem

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-07 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12404: -- Attachment: HDFS-12404.01.patch [~yzhangal], please take a look at the attached patch.

[jira] [Comment Edited] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file which has snapshots

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154913#comment-16154913 ] Xiao Chen edited comment on HDFS-12369 at 9/7/17 10:57 PM: --- Thanks for the

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157850#comment-16157850 ] Xiaoyu Yao commented on HDFS-12387: --- Thanks for working on this. The patch looks good to me overall.

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157903#comment-16157903 ] Hadoop QA commented on HDFS-12349: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157915#comment-16157915 ] Hudson commented on HDFS-12218: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12814 (See

[jira] [Updated] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12404: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was:

[jira] [Work started] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12404 started by Manoj Govindassamy. - > Rename hdfs config authorization.provider.bypass.users to >

[jira] [Updated] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12218: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157978#comment-16157978 ] Hadoop QA commented on HDFS-12404: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11744) Ozone: Implement the trace ID generator

2017-09-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158058#comment-16158058 ] Yiqun Lin edited comment on HDFS-11744 at 9/8/17 3:05 AM: -- Hi [~anu], bq. We have

[jira] [Commented] (HDFS-12385) Ozone: OzoneClient: Refactoring OzoneClient API

2017-09-07 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158072#comment-16158072 ] Nandakumar commented on HDFS-12385: --- Ping [~anu] & [~xyao]. > Ozone: OzoneClient: Refactoring

[jira] [Updated] (HDFS-12403) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-07 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12403: - Description: In our cluster, when found NodeManager frequently FullGC when decommissioning

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12235: --- Attachment: HDFS-12235-HDFS-7240.010.patch > Ozone: DeleteKey-3: KSM SCM block deletion message and

[jira] [Commented] (HDFS-12403) The size of dataQueue and ackQueue in DataStreamer has no limit when writer thread is interrupted

2017-09-07 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158004#comment-16158004 ] Jiandan Yang commented on HDFS-12403: -- Every version has this issue, the code above is

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-09-07 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158013#comment-16158013 ] Huafeng Wang commented on HDFS-1: - Hi Andrew, I agree with you. I'll update the patch soon. > Add

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158049#comment-16158049 ] Weiwei Yang commented on HDFS-12235: Hi [~nandakumar131] I have renamed the classes to {{BlockGroup}}

[jira] [Updated] (HDFS-12222) Add EC information to BlockLocation

2017-09-07 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-1: Attachment: HDFS-1.005.patch > Add EC information to BlockLocation >

[jira] [Commented] (HDFS-11744) Ozone: Implement the trace ID generator

2017-09-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158058#comment-16158058 ] Yiqun Lin commented on HDFS-11744: -- Hi [~anu], bq. We have trace ID on each call since the xciever client

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158076#comment-16158076 ] Xiao Chen commented on HDFS-12400: -- I think the timed out {{TestReencryptionWithKMS}} is more likely env:

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158078#comment-16158078 ] Xiao Chen commented on HDFS-12400: -- Committing this, thanks much [~jojochuang]! > Provide a way for NN

[jira] [Updated] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12400: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158093#comment-16158093 ] Hudson commented on HDFS-12400: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12820 (See

[jira] [Commented] (HDFS-11744) Ozone: Implement the trace ID generator

2017-09-07 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158118#comment-16158118 ] Mukul Kumar Singh commented on HDFS-11744: -- [~anu] & [~linyiqun], yes this bug has been solved.

[jira] [Commented] (HDFS-11948) Ozone: change TestRatisManager to check cluster with data

2017-09-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158146#comment-16158146 ] Tsz Wo Nicholas Sze commented on HDFS-11948: Sure, will update the patch. > Ozone: change

  1   2   >