[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.006.patch > In some cases, erasure blocks are corruption when they are reconstruct. >

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954245#comment-16954245 ] guojh commented on HDFS-14699: -- [~surendrasingh] The UT testChooseSrcDatanodesWithDupEC in class

[jira] [Commented] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954221#comment-16954221 ] Mukul Kumar Singh commented on HDDS-2323: - cc: [~dchitlangia] > Mem allocation: Optimise

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954239#comment-16954239 ] Surendra Singh Lilhore commented on HDFS-14768: --- {quote}I don't understand why the code

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954278#comment-16954278 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-17 Thread Supratim Deka (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Supratim Deka updated HDDS-2208: Status: Patch Available (was: Open) > Propagate System Exceptions from OM transaction apply phase

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.005.patch > In some cases, erasure blocks are corruption when they are reconstruct. >

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954261#comment-16954261 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2323: --- Labels: performance (was: ) > Mem allocation: Optimise AuditMessage::build() >

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-10-17 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954241#comment-16954241 ] Surendra Singh Lilhore commented on HDFS-14699: --- Where it is failing, can you give the link

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: HDFS-14852.004.patch > Remove of LowRedundancyBlocks do NOT remove the block from all queues >

[jira] [Created] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HDDS-2323: -- Summary: Mem allocation: Optimise AuditMessage::build() Key: HDDS-2323 URL: https://issues.apache.org/jira/browse/HDDS-2323 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2323: --- Component/s: Ozone Manager > Mem allocation: Optimise AuditMessage::build() >

[jira] [Updated] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2311: - Labels: pull-request-available (was: ) > Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

[jira] [Work logged] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?focusedWorklogId=330261=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330261 ] ASF GitHub Bot logged work on HDDS-2311: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-10-17 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravuri Sushma sree updated HDFS-14442: -- Attachment: HDFS-14442.001.patch > Disagreement between HAUtil.getAddressOfActive and

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: (was: HDFS-14768.006.patch) > In some cases, erasure blocks are corruption when they are

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: (was: HDFS-14768.005.patch) > In some cases, erasure blocks are corruption when they are

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-10-17 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954248#comment-16954248 ] Ravuri Sushma sree commented on HDFS-14442: --- [~xkrogen], Thank you so much for your valuable

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954273#comment-16954273 ] Fei Hui commented on HDFS-14852: Upload v004 patch. * move test to TestLowRedundancyBlockQueues *

[jira] [Updated] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-2323: -- Status: Patch Available (was: Open) > Mem allocation: Optimise AuditMessage::build() >

[jira] [Updated] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-2323: -- Attachment: HDDS-2323.01.patch > Mem allocation: Optimise AuditMessage::build() >

[jira] [Assigned] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-2323: - Assignee: Siddharth Wagle > Mem allocation: Optimise AuditMessage::build() >

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: (was: HDFS-14768.006.patch) > In some cases, erasure blocks are corruption when they are

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954257#comment-16954257 ] guojh commented on HDFS-14768: -- [~surendrasingh] Sorry about my thoughtless and thanks for you review. > In

[jira] [Updated] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2208: - Labels: pull-request-available (was: ) > Propagate System Exceptions from OM transaction apply

[jira] [Work logged] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?focusedWorklogId=329629=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329629 ] ASF GitHub Bot logged work on HDDS-2208: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953450#comment-16953450 ] Ayush Saxena commented on HDFS-14847: - if that is just for readability, I must say we should not do

[jira] [Updated] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-17 Thread Supratim Deka (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Supratim Deka updated HDDS-2208: Description: The change for HDDS-2206 tracks system exceptions during preExecute phase of OM

[jira] [Updated] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-17 Thread Supratim Deka (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Supratim Deka updated HDDS-2208: Summary: Propagate System Exceptions from OM transaction apply phase (was:

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953445#comment-16953445 ] Fei Hui commented on HDFS-14847: [~ayushtkn] Thanks for your review! {quote} Can this be avoided, seems

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953447#comment-16953447 ] guojh commented on HDFS-14768: -- [~ayushtkn] [~surendrasingh] Could you help review the code? I can drop the

[jira] [Comment Edited] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953450#comment-16953450 ] Ayush Saxena edited comment on HDFS-14847 at 10/17/19 6:59 AM: --- if that is

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953456#comment-16953456 ] guojh commented on HDFS-14768: -- [~surendrasingh] I put a new patch. Please review it. > In some cases,

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.004.patch > In some cases, erasure blocks are corruption when they are reconstruct. >

[jira] [Updated] (HDDS-2322) DoubleBuffer flush termination and OM shutdown's after that.

2019-10-17 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2322: - Summary: DoubleBuffer flush termination and OM shutdown's after that. (was: DoubleBuffer

[jira] [Assigned] (HDDS-2322) DoubleBuffer flush termination and OM is shutdown

2019-10-17 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-2322: Assignee: Bharat Viswanadham > DoubleBuffer flush termination and OM is shutdown >

[jira] [Created] (HDDS-2322) DoubleBuffer flush termination and OM is shutdown

2019-10-17 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2322: Summary: DoubleBuffer flush termination and OM is shutdown Key: HDDS-2322 URL: https://issues.apache.org/jira/browse/HDDS-2322 Project: Hadoop Distributed

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954183#comment-16954183 ] guojh commented on HDFS-14768: -- [~surendrasingh] Thanks for your review. I don't understand why the code

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.004.patch > In some cases, erasure blocks are corruption when they are reconstruct. >

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: (was: HDFS-14768.004.patch) > In some cases, erasure blocks are corruption when they are

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.005.patch > In some cases, erasure blocks are corruption when they are reconstruct. >

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954193#comment-16954193 ] guojh commented on HDFS-14699: -- [~zhaoyim] [~surendrasingh] In you test case, why you set the priority to 

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.006.patch > In some cases, erasure blocks are corruption when they are reconstruct. >

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954202#comment-16954202 ] guojh commented on HDFS-14768: -- [~surendrasingh] I put a new path06, please review it. > In some cases,

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: (was: HDFS-14768.006.patch) > In some cases, erasure blocks are corruption when they are

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.006.patch > In some cases, erasure blocks are corruption when they are reconstruct. >

[jira] [Updated] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14854: - Attachment: HDFS-14854.011.patch > Create improved decommission monitor implementation >

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953443#comment-16953443 ] guojh commented on HDFS-14768: -- [~ayushtkn] Thanks for you reply, This patch try to fix two problem, one is

[jira] [Updated] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14847: --- Attachment: HDFS-14847.003.patch > Erasure Coding: Blocks are over-replicated while EC decommissioning >

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953460#comment-16953460 ] Fei Hui commented on HDFS-14802: [~ste...@apache.org][~ayushtkn] Thanks {quote} For rename() we'd just

[jira] [Work logged] (HDDS-2221) Monitor datanodes in ozoneperf compose cluster

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2221?focusedWorklogId=329888=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329888 ] ASF GitHub Bot logged work on HDDS-2221: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1985) Fix listVolumes API

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1985?focusedWorklogId=329887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329887 ] ASF GitHub Bot logged work on HDDS-1985: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-1985) Fix listVolumes API

2019-10-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-1985: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Fix

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953828#comment-16953828 ] Stephen O'Donnell commented on HDFS-14854: -- [~elgoiri] I have addressed all the latest comments,

[jira] [Resolved] (HDDS-2221) Monitor datanodes in ozoneperf compose cluster

2019-10-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2221. --- Fix Version/s: 0.5.0 Resolution: Fixed > Monitor datanodes in ozoneperf compose cluster >

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953862#comment-16953862 ] Hadoop QA commented on HDFS-14852: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-2309) Optimise OzoneManagerDoubleBuffer::flushTransactions to flush in batches

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2309: --- Labels: performance (was: ) > Optimise OzoneManagerDoubleBuffer::flushTransactions to flush

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-17 Thread Chris Teoh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953724#comment-16953724 ] Chris Teoh commented on HDDS-1847: -- I'm unclear on this issue. The bottom 2 keys are HDFS specific, not

[jira] [Commented] (HDDS-1570) Refactor heartbeat reports to report all the pipelines that are open

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953672#comment-16953672 ] Li Cheng commented on HDDS-1570: As I look into this JIRA, I would like discuss some bout this JIRA: 1.

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: HDFS-14852.003.patch > Remove of LowRedundancyBlocks do NOT remove the block from all queues >

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-10-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953622#comment-16953622 ] Steve Loughran commented on HDFS-14802: --- see "Recursive delete of non-empty root directory" maybe

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953703#comment-16953703 ] Fei Hui commented on HDFS-14852: [~kihwal] Thanks Upload v003 patch. Unconditionally try to remove the

[jira] [Assigned] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2318: --- Assignee: Bharat Viswanadham > Avoid proto::tostring in preconditions to save CPU

[jira] [Commented] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953743#comment-16953743 ] Mukul Kumar Singh commented on HDDS-2318: - cc [~arp], [~nanda], [~bharat], [~hanishakoneru] >

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: HDFS-14852.004.patch > Remove of LowRedundancyBlocks do NOT remove the block from all queues >

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: (was: HDFS-14852.004.patch) > Remove of LowRedundancyBlocks do NOT remove the block from all

[jira] [Updated] (HDDS-2301) Write path: Reduce read contention in rocksDB

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2301: --- Labels: performance (was: ) > Write path: Reduce read contention in rocksDB >

[jira] [Updated] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2318: --- Labels: performance (was: ) > Avoid proto::tostring in preconditions to save CPU cycles >

[jira] [Assigned] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-17 Thread Chris Teoh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Teoh reassigned HDDS-1847: Assignee: Chris Teoh > Datanode Kerberos principal and keytab config key looks inconsistent >

[jira] [Created] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HDDS-2318: -- Summary: Avoid proto::tostring in preconditions to save CPU cycles Key: HDDS-2318 URL: https://issues.apache.org/jira/browse/HDDS-2318 Project: Hadoop Distributed

[jira] [Commented] (HDFS-14880) Balancer sequence of statistics & exit message is not correct

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953474#comment-16953474 ] Hadoop QA commented on HDFS-14880: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDDS-2275) In BatchOperation.SingleOperation, do not clone byte[]

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2275?focusedWorklogId=329714=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329714 ] ASF GitHub Bot logged work on HDDS-2275: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-2275) In BatchOperation.SingleOperation, do not clone byte[]

2019-10-17 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953544#comment-16953544 ] Tsz-wo Sze commented on HDDS-2275: -- Thanks [~hanishakoneru] for reviewing the patch. I have committed

[jira] [Issue Comment Deleted] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2186: --- Comment: was deleted (was: [https://github.com/apache/hadoop/pull/1431]) > Fix tests using MiniOzoneCluster

[jira] [Issue Comment Deleted] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2186: --- Comment: was deleted (was: [https://github.com/apache/hadoop/pull/1431]) > Fix tests using MiniOzoneCluster

[jira] [Commented] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953568#comment-16953568 ] Li Cheng commented on HDDS-2186: Try to resolve this in [https://github.com/apache/hadoop-ozone/pull/28]

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953545#comment-16953545 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-2275) In BatchOperation.SingleOperation, do not clone byte[]

2019-10-17 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2275: - Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Available) > In

[jira] [Commented] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953570#comment-16953570 ] Li Cheng commented on HDDS-1569: PR [https://github.com/apache/hadoop-ozone/pull/28] is under review. >

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953571#comment-16953571 ] Hadoop QA commented on HDFS-14847: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14909) DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953902#comment-16953902 ] Íñigo Goiri commented on HDFS-14909: I see [~ayushtkn] narrowed it down to HDFS-14492. I'll open a

[jira] [Created] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Jira
Íñigo Goiri created HDFS-14910: -- Summary: TestRenameWithSnapshots#testRename2PreDescendant failing consistently Key: HDFS-14910 URL: https://issues.apache.org/jira/browse/HDFS-14910 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14887) RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable

2019-10-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14887: Attachment: 14887.008.png > RBF: In Router Web UI, Observer Namenode Information

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953903#comment-16953903 ] Stephen O'Donnell commented on HDFS-14854: -- Let me have a look at that Configuration change too

[jira] [Created] (HDDS-2319) CLI command to perform on-demand data scan of a specific container

2019-10-17 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2319: -- Summary: CLI command to perform on-demand data scan of a specific container Key: HDDS-2319 URL: https://issues.apache.org/jira/browse/HDDS-2319 Project: Hadoop

[jira] [Commented] (HDFS-14384) When lastLocatedBlock token expire, it will take 1~3s second to refetch it.

2019-10-17 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953971#comment-16953971 ] Surendra Singh Lilhore commented on HDFS-14384: --- Thanks [~vinayakumarb]  for review. Will

[jira] [Updated] (HDFS-14810) Review FSNameSystem editlog sync

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14810: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-14810) Review FSNameSystem editlog sync

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953891#comment-16953891 ] Ayush Saxena commented on HDFS-14810: - Committed to trunk. Thanx [~hexiaoqiao] for the

[jira] [Commented] (HDFS-14909) DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953898#comment-16953898 ] Íñigo Goiri commented on HDFS-14909: +1 on [^HDFS-14909.003.patch]. Does anybody know what's

[jira] [Commented] (HDFS-14810) Review FSNameSystem editlog sync

2019-10-17 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953914#comment-16953914 ] Hudson commented on HDFS-14810: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17545 (See

[jira] [Work logged] (HDDS-2240) Command line tool for OM Admin

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2240?focusedWorklogId=330005=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330005 ] ASF GitHub Bot logged work on HDDS-2240: Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14910: -- Assignee: Wei-Chiu Chuang > TestRenameWithSnapshots#testRename2PreDescendant failing

[jira] [Updated] (HDFS-14909) DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope

2019-10-17 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-14909: -- Fix Version/s: 3.2.2 3.1.4 3.3.0

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953892#comment-16953892 ] Íñigo Goiri commented on HDFS-14854: Thanks for the changes, [^HDFS-14854.011.patch] looks good to

[jira] [Commented] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953904#comment-16953904 ] Íñigo Goiri commented on HDFS-14910: [~ayushsaxena] narrowed it down to HDFS-14492. [~weichiu],

[jira] [Commented] (HDFS-14887) RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable

2019-10-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953909#comment-16953909 ] Takanobu Asanuma commented on HDFS-14887: - Thanks for the discussion and updating the patch,

[jira] [Commented] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953916#comment-16953916 ] Ayush Saxena commented on HDFS-14910: - The this.removeFeature(..) is getting called two times in

[jira] [Updated] (HDDS-2319) CLI command to perform on-demand data scan of a specific container

2019-10-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2319: --- Description: On-demand data scan for a specific container might be a useful debug tool.

[jira] [Commented] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953929#comment-16953929 ] Attila Doroszlai commented on HDDS-2318: Using a supplier with the right {{toString()}} method

  1   2   >