[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523784#comment-16523784 ] genericqa commented on HDFS-10664: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13697) EDEK decrypt fails due to proxy user being lost because of empty AccessControllerContext

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523824#comment-16523824 ] genericqa commented on HDFS-13697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13665) Move RPC response serialization into Server.doResponse

2018-06-26 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-13665: Attachment: HDFS-13665-HDFS-12943.001.patch > Move RPC response serialization into

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.002.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Updated] (HDDS-167) Rename KeySpaceManager to OzoneManager

2018-06-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-167: --- Attachment: HDDS-167.05.patch > Rename KeySpaceManager to OzoneManager >

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523841#comment-16523841 ] genericqa commented on HDFS-13700: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-175: Attachment: HDDS-175.07.patch > Refactor ContainerInfo to remove Pipeline object from it >

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Status: Patch Available (was: Open) > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Commented] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523946#comment-16523946 ] Ajay Kumar commented on HDDS-175: - [~nandakumar131] thanks for review, Patch v7 removes dnList from

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523900#comment-16523900 ] genericqa commented on HDFS-10664: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-13635: -- Attachment: HDFS-13635.003.patch > Incorrect message when block is not found >

[jira] [Commented] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523972#comment-16523972 ] Gabor Bota commented on HDFS-13635: --- Since all places that could throw ReplicaNotFoundException with

[jira] [Commented] (HDFS-13610) [Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523765#comment-16523765 ] genericqa commented on HDFS-13610: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523946#comment-16523946 ] Ajay Kumar edited comment on HDDS-175 at 6/26/18 4:35 PM: -- [~nandakumar131] thanks

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Status: Open (was: Patch Available) > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Updated] (HDDS-186) Create under replicated queue

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-186: Attachment: HDDS-186.02.patch > Create under replicated queue > - > >

[jira] [Commented] (HDDS-167) Rename KeySpaceManager to OzoneManager

2018-06-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523966#comment-16523966 ] Arpit Agarwal commented on HDDS-167: v05 - rebase to trunk, fix more acceptance tests. > Rename

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524069#comment-16524069 ] genericqa commented on HDDS-186: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524130#comment-16524130 ] genericqa commented on HDDS-175: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524128#comment-16524128 ] Todd Lipcon commented on HDFS-13702: Removing all the HTrace stuff from the block reader path

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524134#comment-16524134 ] genericqa commented on HDDS-193: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524178#comment-16524178 ] Hanisha Koneru commented on HDDS-173: - Thanks for the review [~xyao]. I have addressed the comments in

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524147#comment-16524147 ] Todd Lipcon commented on HDFS-13702: Here are some perf results based on a 180GB teravalidate on a

[jira] [Created] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-195: - Summary: Create generic CommandWatcher utility Key: HDDS-195 URL: https://issues.apache.org/jira/browse/HDDS-195 Project: Hadoop Distributed Data Store Issue

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524149#comment-16524149 ] Anu Engineer commented on HDFS-13703: - {quote} TeraValidate job by about 10% {quote} Awesome. Looking

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524156#comment-16524156 ] stack commented on HDFS-13702: -- bq. what do you think? I think we need to be able to trace end-to-end

[jira] [Updated] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13703: --- Status: Patch Available (was: Open) > Avoid allocation of CorruptedBlocks hashmap when no corrupted

[jira] [Updated] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13703: --- Attachment: hdfs-13703.patch > Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks

[jira] [Updated] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13702: --- Attachment: hdfs-13702.patch > HTrace hooks taking 10-15% CPU in DFS client when disabled >

[jira] [Comment Edited] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523946#comment-16523946 ] Ajay Kumar edited comment on HDDS-175 at 6/26/18 5:15 PM: -- [~nandakumar131] thanks

[jira] [Commented] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524074#comment-16524074 ] genericqa commented on HDFS-13635: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13665) Move RPC response serialization into Server.doResponse

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524126#comment-16524126 ] genericqa commented on HDFS-13665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-13703: -- Summary: Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit Key: HDFS-13703 URL: https://issues.apache.org/jira/browse/HDFS-13703 Project:

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: (was: HDDS-173-HDDS-48.003.patch) > Refactor Dispatcher and implement Handler for

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: HDDS-173-HDDS-48.003.patch > Refactor Dispatcher and implement Handler for new

[jira] [Created] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-13702: -- Summary: HTrace hooks taking 10-15% CPU in DFS client when disabled Key: HDFS-13702 URL: https://issues.apache.org/jira/browse/HDFS-13702 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13702: --- Attachment: hdfs-13702.patch > HTrace hooks taking 10-15% CPU in DFS client when disabled >

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524176#comment-16524176 ] Todd Lipcon commented on HDFS-13703: Before/after perf stat results from teravalidate running on LJR

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524182#comment-16524182 ] Todd Lipcon commented on HDFS-13703: BTW would be better if we could entirely avoid allocating the

[jira] [Created] (HDFS-13701) Removal of logging guards regressed performance

2018-06-26 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-13701: -- Summary: Removal of logging guards regressed performance Key: HDFS-13701 URL: https://issues.apache.org/jira/browse/HDFS-13701 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-194: -- Attachment: HDDS-194.001.patch > Remove NodePoolManager and node pool handling from SCM >

[jira] [Updated] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-194: -- Status: Patch Available (was: Open) > Remove NodePoolManager and node pool handling from SCM >

[jira] [Updated] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13702: --- Status: Patch Available (was: Open) > HTrace hooks taking 10-15% CPU in DFS client when disabled >

[jira] [Assigned] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-13702: -- Assignee: Todd Lipcon > HTrace hooks taking 10-15% CPU in DFS client when disabled >

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: HDDS-173-HDDS-48.003.patch > Refactor Dispatcher and implement Handler for new

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523342#comment-16523342 ] Xiaoyu Yao commented on HDDS-173: - Thanks [~hanishakoneru] for working on this and [~bharatviswa] for the

[jira] [Commented] (HDDS-178) DeleteBlocks should not be handled by open containers

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523345#comment-16523345 ] Xiaoyu Yao commented on HDDS-178: - Thanks [~ljain] for working on this. An alternative is to let Ratis

[jira] [Commented] (HDFS-13643) Implement basic async rpc client

2018-06-26 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523411#comment-16523411 ] Duo Zhang commented on HDFS-13643: -- Seems no response... Anyway, the architecture of async dfs client

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523422#comment-16523422 ] Erik Krogen commented on HDFS-12976: Would the flag be something like {{allowObserverReads}}? I am

[jira] [Created] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-13700: --- Summary: The process of loading image can be done in a pipeline model Key: HDFS-13700 URL: https://issues.apache.org/jira/browse/HDFS-13700 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11753) Multiple JournalNode Daemons Coexist

2018-06-26 Thread Doris Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523463#comment-16523463 ] Doris Gu commented on HDFS-11753: - [~brahmareddy] Sorry for late and thank you, I confirm HDFS-12407,

[jira] [Commented] (HDFS-13697) EDEK decrypt fails due to proxy user being lost because of empty AccessControllerContext

2018-06-26 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523510#comment-16523510 ] Zsolt Venczel commented on HDFS-13697: -- Hi [~xiaochen]! Thank you very much for the thorough review

[jira] [Updated] (HDFS-13697) EDEK decrypt fails due to proxy user being lost because of empty AccessControllerContext

2018-06-26 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13697: - Attachment: HDFS-13697.03.patch > EDEK decrypt fails due to proxy user being lost because of

[jira] [Comment Edited] (HDFS-13697) EDEK decrypt fails due to proxy user being lost because of empty AccessControllerContext

2018-06-26 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523510#comment-16523510 ] Zsolt Venczel edited comment on HDFS-13697 at 6/26/18 10:05 AM: Hi

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523520#comment-16523520 ] zhouyingchao commented on HDFS-13700: - [~brahmareddy], thank you for telling me about HDFS-7784.  I

[jira] [Assigned] (HDFS-11753) Multiple JournalNode Daemons Coexist

2018-06-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-11753: --- Assignee: Doris Gu > Multiple JournalNode Daemons Coexist >

[jira] [Commented] (HDFS-11753) Multiple JournalNode Daemons Coexist

2018-06-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523471#comment-16523471 ] Brahma Reddy Battula commented on HDFS-11753: - Thanks for confirmation. Added you as HDFS

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523500#comment-16523500 ] Brahma Reddy Battula commented on HDFS-13700: - Thanks for reporting, HDFS-7784 can address

[jira] [Updated] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-13700: Attachment: HDFS-13700-001.patch Status: Patch Available (was: Open) > The process of

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523522#comment-16523522 ] zhouyingchao commented on HDFS-13700: - Test the patch against a fsimage of a 70PB 2.4 cluster

[jira] [Commented] (HDFS-13690) Improve error message when creating encryption zone while KMS is unreachable

2018-06-26 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523632#comment-16523632 ] Kitti Nanasi commented on HDFS-13690: - Thank you [~xiaochen] for the comments! * This Jira only

[jira] [Commented] (HDFS-13643) Implement basic async rpc client

2018-06-26 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524429#comment-16524429 ] stack commented on HDFS-13643: -- Yeah, we can take a look at [~daryn] stuff when it shows up. On the patch,

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524440#comment-16524440 ] Konstantin Shvachko commented on HDFS-12976: Hey [~csun]. Took me some time, sorry. So when

[jira] [Updated] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-196: Status: Open (was: Patch Available) > PipelineManager should choose datanodes based on

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Attachment: HDDS-195.002.patch > Create generic CommandWatcher utility >

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524526#comment-16524526 ] Elek, Marton commented on HDDS-195: --- The second version (2nd + whitespace fix = 3rd) is more extensible.

[jira] [Updated] (HDFS-13536) [PROVIDED Storage] HA for InMemoryAliasMap

2018-06-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13536: -- Status: Open (was: Patch Available) > [PROVIDED Storage] HA for InMemoryAliasMap >

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524459#comment-16524459 ] genericqa commented on HDFS-12976: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524487#comment-16524487 ] Elek, Marton commented on HDDS-194: --- Patch is re-uploaded to get more clean view about the test failures.

[jira] [Updated] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-194: -- Attachment: HDDS-194.002.patch > Remove NodePoolManager and node pool handling from SCM >

[jira] [Updated] (HDDS-187) Command status publisher for datanode

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-187: Description: Currently SCM sends set of commands for DataNode. DataNode executes them via CommandHandler.

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524430#comment-16524430 ] Anu Engineer commented on HDDS-94: -- +1, the acceptance tests are green in Jenkins, I will commit this now.

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12976: --- Attachment: HDFS-12976-HDFS-12943.004.patch > Introduce ObserverReadProxyProvider >

[jira] [Updated] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-196: Status: Patch Available (was: Open) > PipelineManager should choose datanodes based on

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524451#comment-16524451 ] genericqa commented on HDDS-94: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime

[jira] [Commented] (HDFS-13665) Move RPC response serialization into Server.doResponse

2018-06-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524466#comment-16524466 ] Konstantin Shvachko commented on HDFS-13665: +1 looks good. > Move RPC response

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524480#comment-16524480 ] genericqa commented on HDDS-193: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Attachment: HDDS-195.003.patch > Create generic CommandWatcher utility >

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.004.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524486#comment-16524486 ] Elek, Marton commented on HDDS-193: --- Unit test failures should be independent. Re-uploading the v4 patch

[jira] [Updated] (HDDS-187) Command status publisher for datanode

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-187: Summary: Command status publisher for datanode (was: Create over replicated queue) > Command status

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524551#comment-16524551 ] genericqa commented on HDDS-195: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524270#comment-16524270 ] Sean Busbey commented on HDFS-13702: {quote} I think we should commit this patch, +1, and then we can

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524339#comment-16524339 ] genericqa commented on HDFS-13703: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524319#comment-16524319 ] Elek, Marton commented on HDDS-94: -- Thank you very much the update. Unfortunately the ozonefs acceptance

[jira] [Updated] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-94: - Attachment: HDDS-94.005.patch > Change ozone datanode command to start the standalone datanode plugin >

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.004.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Commented] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524361#comment-16524361 ] Wei-Chiu Chuang commented on HDFS-13635: Thanks [~gabor.bota] +1 > Incorrect message when block

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524221#comment-16524221 ] genericqa commented on HDFS-13702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton reassigned HDDS-195: - Assignee: Elek, Marton > Create generic CommandWatcher utility >

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Attachment: HDDS-195.001.patch > Create generic CommandWatcher utility >

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Status: Patch Available (was: Open) > Create generic CommandWatcher utility >

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Description: In some cases we need a class which can track the status of the outgoing commands. The

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524385#comment-16524385 ] Sean Busbey commented on HDFS-13702: Why do you think it didn't apply the latest patch? the reported

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524249#comment-16524249 ] genericqa commented on HDDS-194: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-196: --- Summary: PipelineManager should choose datanodes based on ContainerPlacementPolicy Key: HDDS-196 URL: https://issues.apache.org/jira/browse/HDDS-196 Project: Hadoop

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524312#comment-16524312 ] genericqa commented on HDDS-173: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.003.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524351#comment-16524351 ] Todd Lipcon commented on HDFS-13703: Anyone know if the failed tests are known flakes? Doesn't seem

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524376#comment-16524376 ] Todd Lipcon commented on HDFS-13702: Not sure what's up with the above precommit. It appears like it

  1   2   >