[jira] [Commented] (HDFS-12716) 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available

2018-06-27 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525922#comment-16525922 ] Ranith Sardar commented on HDFS-12716: -- Hi [~brahmareddy] , I have updated the patch. Please review 

[jira] [Updated] (HDFS-12716) 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available

2018-06-27 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranith Sardar updated HDFS-12716: - Attachment: HDFS-12716.002.patch > 'dfs.datanode.failed.volumes.tolerated' to support minimum

[jira] [Updated] (HDDS-198) Create AuditLogger mechanism to be used by OM, SCM and Datanode

2018-06-27 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-198: --- Status: Patch Available (was: In Progress) > Create AuditLogger mechanism to be used by OM,

[jira] [Commented] (HDDS-198) Create AuditLogger mechanism to be used by OM, SCM and Datanode

2018-06-27 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525889#comment-16525889 ] Dinesh Chitlangia commented on HDDS-198: [~anu] , [~xyao] - Please help to review patch and share

[jira] [Commented] (HDDS-187) Command status publisher for datanode

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525887#comment-16525887 ] genericqa commented on HDDS-187: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-198) Create AuditLogger mechanism to be used by OM, SCM and Datanode

2018-06-27 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-198: --- Attachment: HDDS-198.001.patch > Create AuditLogger mechanism to be used by OM, SCM and

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525875#comment-16525875 ] Erik Krogen commented on HDFS-12976: I think to pursue an approach like [~shv]'s, we need to define

[jira] [Updated] (HDDS-187) Command status publisher for datanode

2018-06-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-187: Status: Patch Available (was: Open) > Command status publisher for datanode >

[jira] [Updated] (HDDS-198) Create AuditLogger mechanism to be used by OM, SCM and Datanode

2018-06-27 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-198: --- Description: This Jira tracks the work to create a custom AuditLogger which can be used by

[jira] [Updated] (HDDS-198) Create AuditLogger mechanism to be used by OM, SCM and Datanode

2018-06-27 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-198: --- Summary: Create AuditLogger mechanism to be used by OM, SCM and Datanode (was: Create

[jira] [Commented] (HDFS-6525) FsShell supports HDFS TTL

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525847#comment-16525847 ] genericqa commented on HDFS-6525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-187) Command status publisher for datanode

2018-06-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-187: Attachment: HDDS-187.00.patch > Command status publisher for datanode >

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525841#comment-16525841 ] genericqa commented on HDDS-195: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525822#comment-16525822 ] Todd Lipcon commented on HDFS-13703: Different set of random tests failed this time. I am guessing

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525820#comment-16525820 ] Todd Lipcon commented on HDFS-13702: The test failure seems unrelated. Given I have a +1 on this from

[jira] [Commented] (HDFS-13524) Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525802#comment-16525802 ] genericqa commented on HDFS-13524: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525800#comment-16525800 ] Elek, Marton commented on HDDS-195: --- Thank you very much the comments [~anu] 1. I agree. 2. True, I

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Attachment: HDDS-195.004.patch > Create generic CommandWatcher utility >

[jira] [Created] (HDDS-201) Add name for LeaseManager

2018-06-27 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-201: - Summary: Add name for LeaseManager Key: HDDS-201 URL: https://issues.apache.org/jira/browse/HDDS-201 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Commented] (HDFS-13704) Support expiry time in AdlFileSystem

2018-06-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525792#comment-16525792 ] Íñigo Goiri commented on HDFS-13704: HDFS-6525 currently is defined within HDFS-6382 as supporting

[jira] [Updated] (HDFS-13704) Support expiry time in AdlFileSystem

2018-06-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13704: --- Description: ADLS supports setting an expiration time for a file. We can leverage Xattr in

[jira] [Created] (HDFS-13704) Support expiry time in AdlFileSystem

2018-06-27 Thread JIRA
Íñigo Goiri created HDFS-13704: -- Summary: Support expiry time in AdlFileSystem Key: HDFS-13704 URL: https://issues.apache.org/jira/browse/HDFS-13704 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525770#comment-16525770 ] genericqa commented on HDFS-12976: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13485) DataNode WebHDFS endpoint throws NPE

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525766#comment-16525766 ] genericqa commented on HDFS-13485: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525760#comment-16525760 ] Anu Engineer commented on HDDS-195: --- Looks good overall. Some minor comments. +1 after fixing them. *

[jira] [Comment Edited] (HDDS-183) Integrate Volumeset, ContainerSet and HddsDispatcher

2018-06-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525744#comment-16525744 ] Bharat Viswanadham edited comment on HDDS-183 at 6/27/18 11:56 PM: --- Hi

[jira] [Commented] (HDDS-183) Integrate Volumeset, ContainerSet and HddsDispatcher

2018-06-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525744#comment-16525744 ] Bharat Viswanadham commented on HDDS-183: - Hi [~hanishakoneru] Thanks for review. Addressed

[jira] [Updated] (HDDS-183) Integrate Volumeset, ContainerSet and HddsDispatcher

2018-06-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-183: Attachment: HDDS-183-HDDS-48.04.patch > Integrate Volumeset, ContainerSet and HddsDispatcher

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525729#comment-16525729 ] genericqa commented on HDDS-173: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525723#comment-16525723 ] genericqa commented on HDFS-13702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525720#comment-16525720 ] genericqa commented on HDFS-13703: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13485) DataNode WebHDFS endpoint throws NPE

2018-06-27 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525707#comment-16525707 ] Siyao Meng commented on HDFS-13485: --- Added sanity check for argument newValue in function

[jira] [Comment Edited] (HDFS-13524) Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize

2018-06-27 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525689#comment-16525689 ] Siyao Meng edited comment on HDFS-13524 at 6/27/18 10:32 PM: - Increased the

[jira] [Comment Edited] (HDFS-13524) Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize

2018-06-27 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525689#comment-16525689 ] Siyao Meng edited comment on HDFS-13524 at 6/27/18 10:32 PM: - Increased the

[jira] [Updated] (HDFS-13524) Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize

2018-06-27 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13524: -- Attachment: HDFS-13524.001.patch Status: Patch Available (was: In Progress) Increased the

[jira] [Work started] (HDFS-13524) Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize

2018-06-27 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13524 started by Siyao Meng. - > Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize >

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525677#comment-16525677 ] Hudson commented on HDDS-193: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14491 (See

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525660#comment-16525660 ] Hudson commented on HDDS-94: SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14490 (See

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525658#comment-16525658 ] Ajay Kumar commented on HDDS-186: - [~xyao] thanks for review and commit. > Create under replicated queue >

[jira] [Updated] (HDFS-13485) DataNode WebHDFS endpoint throws NPE

2018-06-27 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-13485: -- Fix Version/s: 3.0.0 Attachment: HDFS-13485.001.patch Status: Patch Available (was:

[jira] [Commented] (HDDS-167) Rename KeySpaceManager to OzoneManager

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525656#comment-16525656 ] genericqa commented on HDDS-167: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDDS-193: -- Resolution: Fixed Status: Resolved (was: Patch Available) [~elek] Thanks for taking care of

[jira] [Commented] (HDDS-170) Fix TestBlockDeletingService#testBlockDeletionTimeout

2018-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525640#comment-16525640 ] Hudson commented on HDDS-170: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14489 (See

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525639#comment-16525639 ] Hudson commented on HDDS-186: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14489 (See

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525630#comment-16525630 ] Hanisha Koneru commented on HDDS-173: - Fixed Junit test failures from last run in patch v05. >

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: HDDS-173-HDDS-48.005.patch > Refactor Dispatcher and implement Handler for new

[jira] [Updated] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDDS-94: - Resolution: Fixed Status: Resolved (was: Patch Available) [~elek] Thanks for review and additions.

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525612#comment-16525612 ] stack commented on HDFS-13702: -- bq. I do want a trace layer in there; I do want it broader than just HDFS,

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525611#comment-16525611 ] Hudson commented on HDDS-194: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14488 (See

[jira] [Comment Edited] (HDDS-170) Fix TestBlockDeletingService#testBlockDeletionTimeout

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525601#comment-16525601 ] Xiaoyu Yao edited comment on HDDS-170 at 6/27/18 9:02 PM: -- Thanks [~ljain] for

[jira] [Updated] (HDDS-170) Fix TestBlockDeletingService#testBlockDeletionTimeout

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-170: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~ljain] for the contribution.

[jira] [Comment Edited] (HDDS-170) Fix TestBlockDeletingService#testBlockDeletionTimeout

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525601#comment-16525601 ] Xiaoyu Yao edited comment on HDDS-170 at 6/27/18 8:55 PM: -- Thanks [~ljain] for

[jira] [Comment Edited] (HDDS-170) Fix TestBlockDeletingService#testBlockDeletionTimeout

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525601#comment-16525601 ] Xiaoyu Yao edited comment on HDDS-170 at 6/27/18 8:54 PM: -- Thanks [~ljain] for

[jira] [Commented] (HDDS-170) Fix TestBlockDeletingService#testBlockDeletionTimeout

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525601#comment-16525601 ] Xiaoyu Yao commented on HDDS-170: - Thanks [~ljain] for fixing this. I've tested it locally with/without the

[jira] [Updated] (HDDS-186) Create under replicated queue

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-186: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~ajayydv] for the contribution.

[jira] [Comment Edited] (HDDS-183) Integrate Volumeset, ContainerSet and HddsDispatcher

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525589#comment-16525589 ] Hanisha Koneru edited comment on HDDS-183 at 6/27/18 8:40 PM: -- Thanks for

[jira] [Commented] (HDDS-183) Integrate Volumeset, ContainerSet and HddsDispatcher

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525589#comment-16525589 ] Hanisha Koneru commented on HDDS-183: - Thanks for working on this [~bharatviswa]. A few comments: *

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525591#comment-16525591 ] Xiaoyu Yao commented on HDDS-194: - The previous commit accidentally included some of the changes from

[jira] [Comment Edited] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525574#comment-16525574 ] Chao Sun edited comment on HDFS-12976 at 6/27/18 8:28 PM: -- Thanks for the

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525574#comment-16525574 ] Chao Sun commented on HDFS-12976: - Thanks for the comments [~xkrogen] and [~shv]! [~xkrogen]: yes we can

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525569#comment-16525569 ] Todd Lipcon commented on HDFS-13702: {quote}I do want a trace layer in there; I do want it broader

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525564#comment-16525564 ] Xiaoyu Yao commented on HDDS-186: - +1 for v3 patch. I will commit it shortly. > Create under replicated

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Attachment: HDFS-12976-HDFS-12943.005.patch > Introduce ObserverReadProxyProvider >

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525540#comment-16525540 ] Steve Loughran commented on HDFS-13702: --- This is something to talk about at a broader level than a

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525536#comment-16525536 ] Todd Lipcon commented on HDFS-13702: Perhaps using '-nsu' on all the patch builds? Would be nice if

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525532#comment-16525532 ] Hudson commented on HDDS-194: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14487 (See

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525533#comment-16525533 ] genericqa commented on HDDS-173: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525528#comment-16525528 ] Sean Busbey commented on HDFS-13702: {quote} Then, when it ran the hadoop-hdfs tests, they ran

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525525#comment-16525525 ] Sean Busbey commented on HDFS-13702: well I started another run but the Hadoop related precommit jobs

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525524#comment-16525524 ] Todd Lipcon commented on HDFS-13702: Looked into this a bit more and found the issue: the build

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-27 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525521#comment-16525521 ] Sean Busbey commented on HDFS-13702: Todd got me to the log {code} [INFO]

[jira] [Updated] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-194: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~elek] for the contribution. I've

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525498#comment-16525498 ] Todd Lipcon commented on HDFS-13703: Reattached the same patch to re-run Jenkins > Avoid allocation

[jira] [Updated] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13703: --- Attachment: hdfs-13703.patch > Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525467#comment-16525467 ] genericqa commented on HDDS-186: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525466#comment-16525466 ] Xiaoyu Yao commented on HDDS-194: - Thanks [~elek] for working on this. +1 for v2 patch. I will commit it

[jira] [Created] (HDDS-200) Create CloseContainerWatcher

2018-06-27 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-200: --- Summary: Create CloseContainerWatcher Key: HDDS-200 URL: https://issues.apache.org/jira/browse/HDDS-200 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Work started] (HDDS-182) CleanUp Reimplemented classes

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDDS-182 started by Hanisha Koneru. --- > CleanUp Reimplemented classes > - > >

[jira] [Updated] (HDDS-182) CleanUp Reimplemented classes

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-182: Description: Cleanup container-service's ozone.container.common package. The following classes have

[jira] [Updated] (HDDS-182) CleanUp Reimplemented classes

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-182: Summary: CleanUp Reimplemented classes (was: Integrate HddsDispatcher) > CleanUp Reimplemented

[jira] [Updated] (HDDS-183) Integrate Volumeset, ContainerSet and HddsDispatcher

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-183: Summary: Integrate Volumeset, ContainerSet and HddsDispatcher (was: Integrate Volumeset,

[jira] [Commented] (HDFS-13076) [SPS]: Merge work for HDFS-10285

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525357#comment-16525357 ] genericqa commented on HDFS-13076: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work started] (HDFS-13485) DataNode WebHDFS endpoint throws NPE

2018-06-27 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13485 started by Siyao Meng. - > DataNode WebHDFS endpoint throws NPE > > >

[jira] [Updated] (HDDS-199) Implement ReplicationManager to replicate ClosedContainers

2018-06-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-199: -- Summary: Implement ReplicationManager to replicate ClosedContainers (was: Implement ReplicationManager

[jira] [Assigned] (HDDS-199) Implement ReplicationManager to replicate ClosedContainer

2018-06-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton reassigned HDDS-199: - Assignee: Elek, Marton > Implement ReplicationManager to replicate ClosedContainer >

[jira] [Created] (HDDS-199) Implement ReplicationManager to replicate ClosedContainer

2018-06-27 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-199: - Summary: Implement ReplicationManager to replicate ClosedContainer Key: HDDS-199 URL: https://issues.apache.org/jira/browse/HDDS-199 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525316#comment-16525316 ] Elek, Marton commented on HDDS-194: --- I believe that

[jira] [Commented] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-06-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525318#comment-16525318 ] Chen Liang commented on HDFS-13617: --- Thanks [~xkrogen] for the great comments! I think v002 patch has

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525314#comment-16525314 ] Elek, Marton commented on HDDS-193: --- I believe that

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525312#comment-16525312 ] Hanisha Koneru commented on HDDS-173: - Thanks [~xyao]. Fixed the Findbug errors and JUnit test failures

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: HDDS-173-HDDS-48.004.patch > Refactor Dispatcher and implement Handler for new

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525306#comment-16525306 ] Ajay Kumar commented on HDDS-186: - [~xyao] thanks for review. Addressed them in patch v3. Replaced

[jira] [Assigned] (HDFS-13524) Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize

2018-06-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-13524: -- Assignee: Siyao Meng > Occasional "All datanodes are bad" error in

[jira] [Updated] (HDDS-186) Create under replicated queue

2018-06-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-186: Attachment: HDDS-186.03.patch > Create under replicated queue > - > >

[jira] [Assigned] (HDFS-13485) DataNode WebHDFS endpoint throws NPE

2018-06-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-13485: -- Assignee: Siyao Meng (was: Wei-Chiu Chuang) > DataNode WebHDFS endpoint throws NPE >

[jira] [Updated] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-06-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13617: -- Attachment: HDFS-13617.003.patch > Allow wrapping NN QOP into token in encrypted message >

[jira] [Assigned] (HDFS-13485) DataNode WebHDFS endpoint throws NPE

2018-06-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-13485: -- Assignee: Wei-Chiu Chuang > DataNode WebHDFS endpoint throws NPE >

[jira] [Commented] (HDFS-13076) [SPS]: Merge work for HDFS-10285

2018-06-27 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525292#comment-16525292 ] Uma Maheswara Rao G commented on HDFS-13076: [~rakeshr] Please use this Jira for merge

[jira] [Commented] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

2018-06-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525272#comment-16525272 ] genericqa commented on HDFS-13672: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-27 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525271#comment-16525271 ] Ajay Kumar commented on HDDS-175: - failure in TestContainerStateManager is related to this patch, will fix

  1   2   >