[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.007.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: (was: HDFS-14313.007.patch) > Get hdfs used space from

[jira] [Work logged] (HDDS-1654) Ensure container state on datanode gets synced to disk whenever state change happens

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1654?focusedWorklogId=278885=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278885 ] ASF GitHub Bot logged work on HDDS-1654: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-1780) TestFailureHandlingByClient tests are flaky

2019-07-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887861#comment-16887861 ] Hudson commented on HDDS-1780: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16947 (See

[jira] [Updated] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14313: --- Attachment: HDFS-14313.007.patch > Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in

[jira] [Updated] (HDDS-1780) TestFailureHandlingByClient tests are flaky

2019-07-18 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-1780: -- Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Work logged] (HDDS-1780) TestFailureHandlingByClient tests are flaky

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1780?focusedWorklogId=278883=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278883 ] ASF GitHub Bot logged work on HDDS-1780: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1780) TestFailureHandlingByClient tests are flaky

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1780?focusedWorklogId=278882=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278882 ] ASF GitHub Bot logged work on HDDS-1780: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du

2019-07-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887859#comment-16887859 ] Lisheng Sun commented on HDFS-14313: Thank [~linyiqun] for your suggestions.   {quote} why not use

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-18 Thread Chen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887857#comment-16887857 ] Chen Zhang commented on HDFS-13783: --- Thanks [~xkrogen] for your detailed comment and suggestion, I'll

[jira] [Commented] (HDFS-14257) NPE when given the Invalid path to create target dir

2019-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887828#comment-16887828 ] Hadoop QA commented on HDFS-14257: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDDS-1824) IllegalArgumentException in NetworkTopologyImpl causes SCM to shutdown

2019-07-18 Thread Lokesh Jain (JIRA)
Lokesh Jain created HDDS-1824: - Summary: IllegalArgumentException in NetworkTopologyImpl causes SCM to shutdown Key: HDDS-1824 URL: https://issues.apache.org/jira/browse/HDDS-1824 Project: Hadoop

[jira] [Commented] (HDFS-14625) Make DefaultAuditLogger class in FSnamesystem to Abstract

2019-07-18 Thread hemanthboyina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887807#comment-16887807 ] hemanthboyina commented on HDFS-14625: -- yes [~elgoiri] , TestDirectoryScanner  was even failing in

[jira] [Commented] (HDDS-1767) ContainerStateMachine should have its own executors for executing applyTransaction calls

2019-07-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887783#comment-16887783 ] Hudson commented on HDDS-1767: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16946 (See

[jira] [Updated] (HDDS-1767) ContainerStateMachine should have its own executors for executing applyTransaction calls

2019-07-18 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-1767: -- Resolution: Fixed Status: Resolved (was: Patch Available) > ContainerStateMachine should have

[jira] [Work logged] (HDDS-1767) ContainerStateMachine should have its own executors for executing applyTransaction calls

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1767?focusedWorklogId=278849=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278849 ] ASF GitHub Bot logged work on HDDS-1767: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1767) ContainerStateMachine should have its own executors for executing applyTransaction calls

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1767?focusedWorklogId=278848=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278848 ] ASF GitHub Bot logged work on HDDS-1767: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1811) Prometheus metrics are broken for datanodes due to an invalid metric

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1811?focusedWorklogId=278844=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278844 ] ASF GitHub Bot logged work on HDDS-1811: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1481) Cleanup BasicOzoneFileSystem#mkdir

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1481?focusedWorklogId=278845=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278845 ] ASF GitHub Bot logged work on HDDS-1481: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1481) Cleanup BasicOzoneFileSystem#mkdir

2019-07-18 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-1481: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Cleanup BasicOzoneFileSystem#mkdir

[jira] [Commented] (HDDS-1481) Cleanup BasicOzoneFileSystem#mkdir

2019-07-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887776#comment-16887776 ] Hudson commented on HDDS-1481: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16945 (See

[jira] [Work logged] (HDDS-1481) Cleanup BasicOzoneFileSystem#mkdir

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1481?focusedWorklogId=278841=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278841 ] ASF GitHub Bot logged work on HDDS-1481: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1481) Cleanup BasicOzoneFileSystem#mkdir

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1481?focusedWorklogId=278839=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278839 ] ASF GitHub Bot logged work on HDDS-1481: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887740#comment-16887740 ] He Xiaoqiao commented on HDFS-10927: Thanks for your reporting, this is interesting issue. It is

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887738#comment-16887738 ] Hadoop QA commented on HDFS-14034: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-1803) shellcheck.sh does not work on Mac

2019-07-18 Thread Doroszlai, Attila (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doroszlai, Attila updated HDDS-1803: Target Version/s: 0.5.0 > shellcheck.sh does not work on Mac >

[jira] [Commented] (HDFS-14660) [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider

2019-07-18 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887723#comment-16887723 ] Ayush Saxena commented on HDFS-14660: - Thanx Chao!!! bq. For this case, we should check whether the

[jira] [Resolved] (HDDS-1821) BlockOutputStream#watchForCommit fails with UnsupportedOperationException when one DN is down

2019-07-18 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-1821. --- Resolution: Duplicate Assignee: Shashikant Banerjee >

[jira] [Commented] (HDFS-14621) Distcp can not preserve timestamp with -delete option

2019-07-18 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887716#comment-16887716 ] Ayush Saxena commented on HDFS-14621: - Thanx [~pilchard] for the patch. Seems fair enough.

[jira] [Updated] (HDDS-1823) RatisPipelineProvider#initializePipeline logging needs to be verbose on failures/errors

2019-07-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-1823: Summary: RatisPipelineProvider#initializePipeline logging needs to be verbose on

[jira] [Created] (HDDS-1823) RatisPipelineProvider#initializePipeline logging needs to be verbose on debugging

2019-07-18 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1823: --- Summary: RatisPipelineProvider#initializePipeline logging needs to be verbose on debugging Key: HDDS-1823 URL: https://issues.apache.org/jira/browse/HDDS-1823

[jira] [Updated] (HDDS-1821) BlockOutputStream#watchForCommit fails with UnsupportedOperationException when one DN is down

2019-07-18 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1821: -- Labels: blockade (was: ) > BlockOutputStream#watchForCommit fails with UnsupportedOperationException

[jira] [Updated] (HDDS-1821) BlockOutputStream#watchForCommit fails with UnsupportedOperationException when one DN is down

2019-07-18 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-1821: -- Description: When one of the datanode from the ratis pipeline is excluded by introducing network

[jira] [Created] (HDDS-1822) NPE in SCMCommonPolicy.chooseDatanodes

2019-07-18 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDDS-1822: --- Summary: NPE in SCMCommonPolicy.chooseDatanodes Key: HDDS-1822 URL: https://issues.apache.org/jira/browse/HDDS-1822 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-1821) BlockOutputStream#watchForCommit fails with UnsupportedOperationException when one DN is down

2019-07-18 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887710#comment-16887710 ] Nanda kumar commented on HDDS-1821: --- The issue can be reproduced with

[jira] [Created] (HDDS-1821) BlockOutputStream#watchForCommit fails with UnsupportedOperationException when one DN is down

2019-07-18 Thread Nanda kumar (JIRA)
Nanda kumar created HDDS-1821: - Summary: BlockOutputStream#watchForCommit fails with UnsupportedOperationException when one DN is down Key: HDDS-1821 URL: https://issues.apache.org/jira/browse/HDDS-1821

[jira] [Work logged] (HDDS-1713) ReplicationManager fail to find proper node topology based on Datanode details from heartbeat

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1713?focusedWorklogId=278786=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278786 ] ASF GitHub Bot logged work on HDDS-1713: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1782) Add an option to MiniOzoneChaosCluster to read files multiple times.

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1782?focusedWorklogId=278780=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278780 ] ASF GitHub Bot logged work on HDDS-1782: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1780) TestFailureHandlingByClient tests are flaky

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1780?focusedWorklogId=278776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278776 ] ASF GitHub Bot logged work on HDDS-1780: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1779) TestWatchForCommit tests are flaky

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1779?focusedWorklogId=278771=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278771 ] ASF GitHub Bot logged work on HDDS-1779: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1811) Prometheus metrics are broken for datanodes due to an invalid metric

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1811?focusedWorklogId=278766=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278766 ] ASF GitHub Bot logged work on HDDS-1811: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1811) Prometheus metrics are broken for datanodes due to an invalid metric

2019-07-18 Thread Doroszlai, Attila (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doroszlai, Attila updated HDDS-1811: Status: Patch Available (was: In Progress) > Prometheus metrics are broken for datanodes

[jira] [Work logged] (HDDS-1811) Prometheus metrics are broken for datanodes due to an invalid metric

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1811?focusedWorklogId=278765=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-278765 ] ASF GitHub Bot logged work on HDDS-1811: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1811) Prometheus metrics are broken for datanodes due to an invalid metric

2019-07-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1811: - Labels: pull-request-available (was: ) > Prometheus metrics are broken for datanodes due to an

[jira] [Updated] (HDFS-14257) NPE when given the Invalid path to create target dir

2019-07-18 Thread hemanthboyina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14257: - Attachment: HDFS-14257.002.patch > NPE when given the Invalid path to create target dir >

[jira] [Commented] (HDFS-14646) Standby NameNode should terminate the FsImage put process immediately if the peer NN is not in the appropriate state to receive an image.

2019-07-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887659#comment-16887659 ] Hadoop QA commented on HDFS-14646: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14257) NPE when given the Invalid path to create target dir

2019-07-18 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887656#comment-16887656 ] Surendra Singh Lilhore commented on HDFS-14257: --- Thanks [~hemanthboyina] for patch.

<    1   2   3