[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045012#comment-16045012 ] Kihwal Lee commented on HDFS-11960: --- All failed tests were fine when reran. {noformat}

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.006.patch Thanks [~arpitagarwal] for pointing out offline that,

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045096#comment-16045096 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 9:59 PM: --- Thanks

[jira] [Updated] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11962: Description: This script should stop the cluster along with all ozone services. -- # run

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Status: In Progress (was: Patch Available) > Enable POSIX ACL inheritance by default >

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045047#comment-16045047 ] Daryn Sharp commented on HDFS-11960: Looks like a good fix but there really should be a test to

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.003.patch fixing a bug in v003 patch. > Ozone : add read/write random

[jira] [Commented] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-06-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045163#comment-16045163 ] Manoj Govindassamy commented on HDFS-11682: --- [~eddyxu], >From your explanation it looks like it

[jira] [Comment Edited] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-06-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045163#comment-16045163 ] Manoj Govindassamy edited comment on HDFS-11682 at 6/9/17 10:48 PM:

[jira] [Comment Edited] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-06-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045163#comment-16045163 ] Manoj Govindassamy edited comment on HDFS-11682 at 6/9/17 10:48 PM:

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Labels: hdfs-ec-3.0-nice-to-have (was: ) Priority: Critical (was: Major) I'm bumping the

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045015#comment-16045015 ] Hadoop QA commented on HDFS-11804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045116#comment-16045116 ] Andrew Wang commented on HDFS-11907: LGTM +1, thanks Chen, Arpit! > Add metric for time taken by

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045256#comment-16045256 ] Hadoop QA commented on HDFS-11907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044989#comment-16044989 ] Hadoop QA commented on HDFS-11939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11961) Ozone: Add start-ozone.sh to quickly start ozone.

2017-06-09 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11961: --- Summary: Ozone: Add start-ozone.sh to quickly start ozone. Key: HDFS-11961 URL: https://issues.apache.org/jira/browse/HDFS-11961 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11907: -- Attachment: HDFS-11907.005.patch Thanks [~andrew.wang] for the comments. Based on Andrew's comments,

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044987#comment-16044987 ] Chen Liang edited comment on HDFS-11907 at 6/9/17 8:37 PM: --- Thanks

[jira] [Created] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-09 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11963: --- Summary: Ozone: Documentation: Add getting started page Key: HDFS-11963 URL: https://issues.apache.org/jira/browse/HDFS-11963 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11963: --- Assignee: Anu Engineer > Ozone: Documentation: Add getting started page >

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.002.patch Post v002 patch to fix checkstyle warnining. > Ozone : add

[jira] [Commented] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045121#comment-16045121 ] Hadoop QA commented on HDFS-11907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045302#comment-16045302 ] Hadoop QA commented on HDFS-11939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11907: - Description: Add a metric to measure the time taken by the NameNode Resource Check. (was:

[jira] [Updated] (HDFS-11907) Add metric for time taken by NameNode resource check

2017-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11907: - Summary: Add metric for time taken by NameNode resource check (was: NameNodeResourceChecker

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045105#comment-16045105 ] Arpit Agarwal commented on HDFS-11907: -- +1 for the v6 patch. Thanks Chen. [~andrew.wang] do you have

[jira] [Commented] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045179#comment-16045179 ] Hadoop QA commented on HDFS-11939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044985#comment-16044985 ] Hadoop QA commented on HDFS-11960: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11962: --- Summary: Ozone: Add stop-ozone.sh script Key: HDFS-11962 URL: https://issues.apache.org/jira/browse/HDFS-11962 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Assigned] (HDFS-11956) Fix BlockToken compatibility with Hadoop 2.x clients

2017-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-11956: -- Assignee: Chris Douglas Assigning to Chris since he expressed interest over on HDFS-9807.

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-06-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043989#comment-16043989 ] Andrew Wang commented on HDFS-9807: --- Thanks Chris. I've filed HDFS-11956 for release tracking purposes,

[jira] [Created] (HDFS-11956) Fix BlockToken compatibility with Hadoop 2.x clients

2017-06-09 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11956: -- Summary: Fix BlockToken compatibility with Hadoop 2.x clients Key: HDFS-11956 URL: https://issues.apache.org/jira/browse/HDFS-11956 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9924) [umbrella] Nonblocking HDFS Access

2017-06-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HDFS-9924: Attachment: HDFS-9924-POC.patch A simple rpc client built on netty. Test mkdirs and getFileInfo in

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11646: - Attachment: (was: HADOOP-11646.patch) > Add -E option in 'ls' to list erasure coding policy of each

How to monitor dfs.datanode.handler.count

2017-06-09 Thread sandeep vura
Hi Team, We had recently increased datanode handler count in our cluster. But how do we monitor handler count in Cloudera Manager using charts. or any other method. Please advise. Regards, SP

[jira] [Commented] (HDFS-11711) DN should not delete the block On "Too many open files" Exception

2017-06-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044239#comment-16044239 ] Brahma Reddy Battula commented on HDFS-11711: - bq.it should just throw a new type of exception

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044281#comment-16044281 ] Hadoop QA commented on HDFS-11647: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-06-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044279#comment-16044279 ] Surendra Singh Lilhore commented on HDFS-11726: --- Thanks [~rakeshr] for review and commit..

[jira] [Commented] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044122#comment-16044122 ] Hadoop QA commented on HDFS-11646: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11185) Ozone: Fix disabled tests

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044129#comment-16044129 ] Hadoop QA commented on HDFS-11185: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-06-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11726: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044094#comment-16044094 ] Weiwei Yang commented on HDFS-11845: This issue is because the RPC timeout was too small (100ms), the

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11646: - Attachment: HDFS-11646-001.patch > Add -E option in 'ls' to list erasure coding policy of each file and

[jira] [Commented] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044131#comment-16044131 ] Hadoop QA commented on HDFS-11845: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-9924) [umbrella] Nonblocking HDFS Access

2017-06-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang reassigned HDFS-9924: --- Assignee: Duo Zhang (was: Xiaobing Zhou) > [umbrella] Nonblocking HDFS Access >

[jira] [Commented] (HDFS-11726) [SPS] : StoragePolicySatisfier should not select same storage type as source and destination in same datanode.

2017-06-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044069#comment-16044069 ] Uma Maheswara Rao G commented on HDFS-11726: [~rakeshr] sure. > [SPS] :

[jira] [Comment Edited] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044094#comment-16044094 ] Weiwei Yang edited comment on HDFS-11845 at 6/9/17 7:41 AM: This issue is

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11647: - Attachment: HDFS-11647-001.patch > Add -E option in hdfs "count" command to show erasure policy

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11647: - Attachment: (was: HADOOP-11647.patch) > Add -E option in hdfs "count" command to show erasure policy

[jira] [Updated] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11845: --- Attachment: HDFS-11845-HDFS-7240.001.patch > Ozone: Output error when DN handshakes with SCM >

[jira] [Updated] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11845: --- Status: Patch Available (was: Open) > Ozone: Output error when DN handshakes with SCM >

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11646: - Attachment: HDFS-11646-002.patch > Add -E option in 'ls' to list erasure coding policy of each file and

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11647: - Attachment: HDFS-11647-002.patch > Add -E option in hdfs "count" command to show erasure policy

[jira] [Commented] (HDFS-11945) Internal lease recovery may not be retried for a long time

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044490#comment-16044490 ] Kihwal Lee commented on HDFS-11945: --- Thanks, [~liuml07]! > Internal lease recovery may not be retried

[jira] [Commented] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044511#comment-16044511 ] Yiqun Lin commented on HDFS-11782: -- Hi [~anu], I am working on this now and will attach the patch in one

[jira] [Updated] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Release Note: The original implementation of HDFS ACLs applied the client's umask to the permissions

[jira] [Updated] (HDFS-6962) ACL inheritance conflicts with umaskmode

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Release Note: The original implementation of HDFS ACLs applied the client's umask to the permissions

[jira] [Created] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11957: - Summary: Enable POSIX ACL inheritance by default Key: HDFS-11957 URL: https://issues.apache.org/jira/browse/HDFS-11957 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11185) Ozone: Fix disabled tests

2017-06-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044559#comment-16044559 ] Xiaoyu Yao commented on HDFS-11185: --- Thanks [~anu] for working on this. Patch LGTM. +1. > Ozone: Fix

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Status: Patch Available (was: Open) > Enable POSIX ACL inheritance by default >

[jira] [Updated] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11957: -- Attachment: HDFS-11957.001.patch Patch 001 * Update DFS_NAMENODE_POSIX_ACL_INHERITANCE_ENABLED_DEFAULT

[jira] [Commented] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044496#comment-16044496 ] Weiwei Yang commented on HDFS-11845: [~anu], [~xyao] please kindly review. Thanks. > Ozone: Output

[jira] [Commented] (HDFS-11951) Ozone: Handle potential inconsistent states while listing keys

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044513#comment-16044513 ] Yiqun Lin commented on HDFS-11951: -- Thanks for your comment, [~cheersyang]. The comment makes sense to

[jira] [Updated] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-11804: -- Status: Open (was: Patch Available) > KMS client needs retry logic >

[jira] [Created] (HDFS-11959) Ozone: Audit Logs

2017-06-09 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11959: -- Summary: Ozone: Audit Logs Key: HDFS-11959 URL: https://issues.apache.org/jira/browse/HDFS-11959 Project: Hadoop HDFS Issue Type: Sub-task Components:

[jira] [Updated] (HDFS-11185) Ozone: remove disabled tests

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11185: Summary: Ozone: remove disabled tests (was: Ozone: Fix disabled tests) > Ozone: remove disabled

[jira] [Commented] (HDFS-11955) Ozone: Set proper parameter default values for listBuckets http request

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044697#comment-16044697 ] Weiwei Yang commented on HDFS-11955: Tested on a cluster, when list buckets without any parameter, I

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044731#comment-16044731 ] Hadoop QA commented on HDFS-11957: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11185) Ozone: remove disabled tests

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11185: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Issue Comment Deleted] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11962: --- Comment: was deleted (was: I can work on this, just one question, do we need to add ozone start/stop

[jira] [Commented] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045327#comment-16045327 ] Weiwei Yang commented on HDFS-11962: I can work on this, just one question, do we need to add ozone

[jira] [Updated] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11670: Description: This jira to discuss and implement set of satisfy storage policy sub-commands. Following are

[jira] [Assigned] (HDFS-11961) Ozone: Add start-ozone.sh to quickly start ozone.

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11961: -- Assignee: Weiwei Yang > Ozone: Add start-ozone.sh to quickly start ozone. >

[jira] [Assigned] (HDFS-11962) Ozone: Add stop-ozone.sh script

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11962: -- Assignee: Weiwei Yang > Ozone: Add stop-ozone.sh script > --- > >

[jira] [Moved] (HDFS-11964) Fix TestDFSStripedInputStreamWithRandomECPolicy#testPreadWithDNFailure failure

2017-06-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu moved HADOOP-14517 to HDFS-11964: --- Affects Version/s: (was: 3.0.0-alpha3)

[jira] [Commented] (HDFS-11804) KMS client needs retry logic

2017-06-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045409#comment-16045409 ] John Zhuge commented on HDFS-11804: --- [~shahrs87] Should this JIRA be moved to project "Hadoop Common"

[jira] [Updated] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11782: - Status: Patch Available (was: Open) > Ozone: KSM: Add listKey > --- > >

[jira] [Updated] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11782: - Attachment: HDFS-11782-HDFS-7240.001.patch Attach the initial patch. Since HDFS-11926 has already done

[jira] [Updated] (HDFS-11964) Fix TestDFSStripedInputStreamWithRandomECPolicy#testPreadWithDNFailure failure

2017-06-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11964: - Component/s: erasure-coding > Fix

[jira] [Commented] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045387#comment-16045387 ] Rakesh R commented on HDFS-11670: - FYI, I've updated the jira subject line & description to reflect the

[jira] [Commented] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044336#comment-16044336 ] Hadoop QA commented on HDFS-11646: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044343#comment-16044343 ] Hadoop QA commented on HDFS-11647: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11958: -- Summary: Ozone: Ensure KSM is initiated using ProtobufRpcEngine Key: HDFS-11958 URL: https://issues.apache.org/jira/browse/HDFS-11958 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11958: --- Attachment: HDFS-11958-HDFS-7240.001.patch > Ozone: Ensure KSM is initiated using ProtobufRpcEngine >

[jira] [Updated] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11958: --- Status: Patch Available (was: Open) > Ozone: Ensure KSM is initiated using ProtobufRpcEngine >

[jira] [Moved] (HDFS-11960) Successfully closed file can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee moved HADOOP-14514 to HDFS-11960: Target Version/s: 2.8.2 (was: 2.8.2) Key: HDFS-11960

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044755#comment-16044755 ] Kihwal Lee commented on HDFS-11960: --- Details of the step 6). {{processIncrementalBlockReport()}} calls

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Status: Patch Available (was: Open) > Ozone : add read/write random access to Chunks of a key >

[jira] [Updated] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11939: -- Attachment: HDFS-11939-HDFS-7240.001.patch > Ozone : add read/write random access to Chunks of a key >

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044775#comment-16044775 ] Kihwal Lee commented on HDFS-11960: --- The simplest fix will be not letting {{addBlock()}} remove a

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-06-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044779#comment-16044779 ] Chen Liang commented on HDFS-11957: --- Thanks [~jzhuge] for the patch. The change itself in v001 patch

[jira] [Updated] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11958: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11845: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Attachment: HDFS-11960.patch > Successfully closed files can stay under-replicated. >

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Status: Patch Available (was: Open) > Successfully closed files can stay under-replicated. >

[jira] [Commented] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044877#comment-16044877 ] Hadoop QA commented on HDFS-11958: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11845) Ozone: Output error when DN handshakes with SCM

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044746#comment-16044746 ] Anu Engineer commented on HDFS-11845: - +1, I think we set small values for ease of unit testing. You

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Summary: Successfully closed files can stay under-replicated. (was: Successfully closed file can stay

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044831#comment-16044831 ] Anu Engineer commented on HDFS-7240: I have opened an ozone channel at the ASF slack. Since we are

[jira] [Commented] (HDFS-11958) Ozone: Ensure KSM is initiated using ProtobufRpcEngine

2017-06-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044741#comment-16044741 ] Anu Engineer commented on HDFS-11958: - +1, I will commit this shortly. > Ozone: Ensure KSM is

  1   2   >