[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045409#comment-16045409 ] John Zhuge commented on HDFS-11804: --- [~shahrs87] Should this JIRA be moved to project "Hadoop Common"

[jira] [Commented] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045387#comment-16045387 ] Rakesh R commented on HDFS-11670: - FYI, I've updated the jira subject line & description to reflect the

[jira] [Updated] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11670: Description: This jira to discuss and implement set of satisfy storage policy sub-commands. Following are

[jira] [Updated] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11782: - Status: Patch Available (was: Open) > Ozone: KSM: Add listKey > --- > >

[jira] [Updated] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11782: - Attachment: HDFS-11782-HDFS-7240.001.patch Attach the initial patch. Since HDFS-11926 has already done

[jira] [Updated] (HDFS-11964) Fix TestDFSStripedInputStreamWithRandomECPolicy#testPreadWithDNFailure failure

2017-06-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11964: - Component/s: erasure-coding > Fix

[jira] [Moved] (HDFS-11964) Fix TestDFSStripedInputStreamWithRandomECPolicy#testPreadWithDNFailure failure

2017-06-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu moved HADOOP-14517 to HDFS-11964: --- Affects Version/s: (was: 3.0.0-alpha3)

[jira] [Issue Comment Deleted] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11962: --- Comment: was deleted (was: I can work on this, just one question, do we need to add ozone start/stop

[jira] [Commented] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045327#comment-16045327 ] Weiwei Yang commented on HDFS-11962: I can work on this, just one question, do we need to add ozone

[jira] [Assigned] (HDFS-11961) Ozone: Add start-ozone.sh to quickly start ozone.

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11961: -- Assignee: Weiwei Yang > Ozone: Add start-ozone.sh to quickly start ozone. >

[jira] [Assigned] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11962: -- Assignee: Weiwei Yang > Ozone: Add stop-ozone.sh script > --- > >

[jira] [Commented] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045302#comment-16045302 ] Hadoop QA commented on HDFS-11939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Labels: hdfs-ec-3.0-nice-to-have (was: ) Priority: Critical (was: Major) I'm bumping the

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045256#comment-16045256 ] Hadoop QA commented on HDFS-11907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11963: --- Assignee: Anu Engineer > Ozone: Documentation: Add getting started page >

[jira] [Created] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-09 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11963: --- Summary: Ozone: Documentation: Add getting started page Key: HDFS-11963 URL: https://issues.apache.org/jira/browse/HDFS-11963 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Status: In Progress (was: Patch Available) > Enable POSIX ACL inheritance by default >

[jira] [Commented] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045179#comment-16045179 ] Hadoop QA commented on HDFS-11939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-06-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045163#comment-16045163 ] Manoj Govindassamy edited comment on HDFS-11682 at 6/9/17 10:48 PM:

[jira] [Comment Edited] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-06-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045163#comment-16045163 ] Manoj Govindassamy edited comment on HDFS-11682 at 6/9/17 10:48 PM:

[jira] [Commented] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-06-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045163#comment-16045163 ] Manoj Govindassamy commented on HDFS-11682: --- [~eddyxu], >From your explanation it looks like it

[jira] [Updated] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11962: Description: This script should stop the cluster along with all ozone services. -- # run

[jira] [Created] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11962: --- Summary: Ozone: Add stop-ozone.sh script Key: HDFS-11962 URL: https://issues.apache.org/jira/browse/HDFS-11962 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11961) Ozone: Add start-ozone.sh to quickly start ozone.

2017-06-09 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11961: --- Summary: Ozone: Add start-ozone.sh to quickly start ozone. Key: HDFS-11961 URL: https://issues.apache.org/jira/browse/HDFS-11961 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.003.patch fixing a bug in v003 patch. > Ozone : add read/write random

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045121#comment-16045121 ] Hadoop QA commented on HDFS-11907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045116#comment-16045116 ] Andrew Wang commented on HDFS-11907: LGTM +1, thanks Chen, Arpit! > Add metric for time taken by

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11907: - Summary: Add metric for time taken by NameNode resource check (was: NameNodeResourceChecker

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11907: - Description: Add a metric to measure the time taken by the NameNode Resource Check. (was:

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045105#comment-16045105 ] Arpit Agarwal commented on HDFS-11907: -- +1 for the v6 patch. Thanks Chen. [~andrew.wang] do you have

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.006.patch Thanks [~arpitagarwal] for pointing out offline that,

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045096#comment-16045096 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 9:59 PM: --- Thanks

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045047#comment-16045047 ] Daryn Sharp commented on HDFS-11960: Looks like a good fix but there really should be a test to

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.002.patch Post v002 patch to fix checkstyle warnining. > Ozone : add

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045015#comment-16045015 ] Hadoop QA commented on HDFS-11804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045012#comment-16045012 ] Kihwal Lee commented on HDFS-11960: --- All failed tests were fine when reran. {noformat}

[jira] [Commented] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044989#comment-16044989 ] Hadoop QA commented on HDFS-11939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044987#comment-16044987 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 8:37 PM: --- Thanks

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.005.patch Thanks [~andrew.wang] for the comments. Based on Andrew's comments,

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044985#comment-16044985 ] Hadoop QA commented on HDFS-11960: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11670) [SPS]: Add storagepolicy command to check the status of storage policy Satisfier

2017-06-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044923#comment-16044923 ] Rakesh R commented on HDFS-11670: - We can make it simple command {{-isSPSRunning}} -> result could be

[jira] [Commented] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044877#comment-16044877 ] Hadoop QA commented on HDFS-11958: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Attachment: HDFS-11960.patch > Successfully closed files can stay under-replicated. >

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Status: Patch Available (was: Open) > Successfully closed files can stay under-replicated. >

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044847#comment-16044847 ] John Zhuge commented on HDFS-11957: --- Yes [~vagarychen], ACL test failures are related. > Enable POSIX

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044831#comment-16044831 ] Anu Engineer commented on HDFS-7240: I have opened an ozone channel at the ASF slack. Since we are

[jira] [Updated] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-11804: -- Attachment: HDFS-11804-trunk-5.patch > KMS client needs retry logic >

[jira] [Updated] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-11804: -- Status: Patch Available (was: Open) > KMS client needs retry logic >

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044816#comment-16044816 ] Rushabh S Shah commented on HDFS-11804: --- Thanks [~xiaochen] for the review. bq. Not introduced by

[jira] [Commented] (HDFS-11933) The function composePolicyName should judge arguments not NULL

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044803#comment-16044803 ] Chen Liang commented on HDFS-11933: --- Thanks [~figo] for the patch. v001 patch looks reasonable to me, I

[jira] [Updated] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11958: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11845: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044779#comment-16044779 ] Chen Liang commented on HDFS-11957: --- Thanks [~jzhuge] for the patch. The change itself in v001 patch

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044775#comment-16044775 ] Kihwal Lee commented on HDFS-11960: --- The simplest fix will be not letting {{addBlock()}} remove a

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.001.patch > Ozone : add read/write random access to Chunks of a key >

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Status: Patch Available (was: Open) > Ozone : add read/write random access to Chunks of a key >

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044755#comment-16044755 ] Kihwal Lee commented on HDFS-11960: --- Details of the step 6). {{processIncrementalBlockReport()}} calls

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Summary: Successfully closed files can stay under-replicated. (was: Successfully closed file can stay

[jira] [Assigned] (HDFS-11960) Successfully closed file can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-11960: - Assignee: Kihwal Lee > Successfully closed file can stay under-replicated. >

[jira] [Moved] (HDFS-11960) Successfully closed file can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee moved HADOOP-14514 to HDFS-11960: Target Version/s: 2.8.2 (was: 2.8.2) Key: HDFS-11960

[jira] [Commented] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044746#comment-16044746 ] Anu Engineer commented on HDFS-11845: - +1, I think we set small values for ease of unit testing. You

[jira] [Commented] (HDFS-11947) When constructing a thread name, BPOfferService may print a bogus warning message

2017-06-09 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044744#comment-16044744 ] Hanisha Koneru commented on HDFS-11947: --- Thanks [~cheersyang] for fixing it. +1 (non-binding) for

[jira] [Commented] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044741#comment-16044741 ] Anu Engineer commented on HDFS-11958: - +1, I will commit this shortly. > Ozone: Ensure KSM is

[jira] [Updated] (HDFS-11185) Ozone: remove disabled tests

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11185: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044731#comment-16044731 ] Hadoop QA commented on HDFS-11957: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11955) Ozone: Set proper parameter default values for listBuckets http request

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044697#comment-16044697 ] Weiwei Yang commented on HDFS-11955: Tested on a cluster, when list buckets without any parameter, I

[jira] [Updated] (HDFS-11185) Ozone: remove disabled tests

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11185: Summary: Ozone: remove disabled tests (was: Ozone: Fix disabled tests) > Ozone: remove disabled

[jira] [Created] (HDFS-11959) Ozone: Audit Logs

2017-06-09 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11959: -- Summary: Ozone: Audit Logs Key: HDFS-11959 URL: https://issues.apache.org/jira/browse/HDFS-11959 Project: Hadoop HDFS Issue Type: Sub-task Components:

[jira] [Updated] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11958: --- Status: Patch Available (was: Open) > Ozone: Ensure KSM is initiated using ProtobufRpcEngine >

[jira] [Updated] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11958: --- Attachment: HDFS-11958-HDFS-7240.001.patch > Ozone: Ensure KSM is initiated using ProtobufRpcEngine >

[jira] [Created] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11958: -- Summary: Ozone: Ensure KSM is initiated using ProtobufRpcEngine Key: HDFS-11958 URL: https://issues.apache.org/jira/browse/HDFS-11958 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Attachment: HDFS-11957.001.patch Patch 001 * Update DFS_NAMENODE_POSIX_ACL_INHERITANCE_ENABLED_DEFAULT

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Status: Patch Available (was: Open) > Enable POSIX ACL inheritance by default >

[jira] [Commented] (HDFS-11185) Ozone: Fix disabled tests

2017-06-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044559#comment-16044559 ] Xiaoyu Yao commented on HDFS-11185: --- Thanks [~anu] for working on this. Patch LGTM. +1. > Ozone: Fix

[jira] [Created] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11957: - Summary: Enable POSIX ACL inheritance by default Key: HDFS-11957 URL: https://issues.apache.org/jira/browse/HDFS-11957 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Release Note: The original implementation of HDFS ACLs applied the client's umask to the permissions

[jira] [Updated] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Release Note: The original implementation of HDFS ACLs applied the client's umask to the permissions

[jira] [Updated] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-11804: -- Status: Open (was: Patch Available) > KMS client needs retry logic >

[jira] [Commented] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044513#comment-16044513 ] Yiqun Lin commented on HDFS-11951: -- Thanks for your comment, [~cheersyang]. The comment makes sense to

[jira] [Commented] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044511#comment-16044511 ] Yiqun Lin commented on HDFS-11782: -- Hi [~anu], I am working on this now and will attach the patch in one

[jira] [Commented] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044496#comment-16044496 ] Weiwei Yang commented on HDFS-11845: [~anu], [~xyao] please kindly review. Thanks. > Ozone: Output

[jira] [Commented] (HDFS-11945) Internal lease recovery may not be retried for a long time

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044490#comment-16044490 ] Kihwal Lee commented on HDFS-11945: --- Thanks, [~liuml07]! > Internal lease recovery may not be retried

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044343#comment-16044343 ] Hadoop QA commented on HDFS-11647: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044336#comment-16044336 ] Hadoop QA commented on HDFS-11646: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044281#comment-16044281 ] Hadoop QA commented on HDFS-11647: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-06-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044279#comment-16044279 ] Surendra Singh Lilhore commented on HDFS-11726: --- Thanks [~rakeshr] for review and commit..

[jira] [Commented] (HDFS-11711) DN should not delete the block On "Too many open files" Exception

2017-06-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044239#comment-16044239 ] Brahma Reddy Battula commented on HDFS-11711: - bq.it should just throw a new type of exception

How to monitor dfs.datanode.handler.count

2017-06-09 Thread sandeep vura
Hi Team, We had recently increased datanode handler count in our cluster. But how do we monitor handler count in Cloudera Manager using charts. or any other method. Please advise. Regards, SP

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11646: - Attachment: (was: HADOOP-11646.patch) > Add -E option in 'ls' to list erasure coding policy of each

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11647: - Attachment: HDFS-11647-002.patch > Add -E option in hdfs "count" command to show erasure policy

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11646: - Attachment: HDFS-11646-002.patch > Add -E option in 'ls' to list erasure coding policy of each file and

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11647: - Attachment: (was: HADOOP-11647.patch) > Add -E option in hdfs "count" command to show erasure policy

[jira] [Updated] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-06-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11726: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available)

[jira] [Assigned] (HDFS-9924) [umbrella] Nonblocking HDFS Access

2017-06-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang reassigned HDFS-9924: --- Assignee: Duo Zhang (was: Xiaobing Zhou) > [umbrella] Nonblocking HDFS Access >

[jira] [Commented] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044131#comment-16044131 ] Hadoop QA commented on HDFS-11845: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11185) Ozone: Fix disabled tests

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044129#comment-16044129 ] Hadoop QA commented on HDFS-11185: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9924) [umbrella] Nonblocking HDFS Access

2017-06-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HDFS-9924: Attachment: HDFS-9924-POC.patch A simple rpc client built on netty. Test mkdirs and getFileInfo in

[jira] [Commented] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044122#comment-16044122 ] Hadoop QA commented on HDFS-11646: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11647: - Attachment: HDFS-11647-001.patch > Add -E option in hdfs "count" command to show erasure policy

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11646: - Attachment: HDFS-11646-001.patch > Add -E option in 'ls' to list erasure coding policy of each file and

  1   2   >