[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955092#comment-16955092 ] Hadoop QA commented on HDFS-14847: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955089#comment-16955089 ] Hadoop QA commented on HDFS-14913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955088#comment-16955088 ] Lisheng Sun commented on HDFS-14913: [^HDFS-14913-02.patch] LGTM +1. > Correct the v

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-18 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955068#comment-16955068 ] Mukul Kumar Singh commented on HDFS-14884: -- [~xyao] [~daryn] [~weichiu] I have u

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-18 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-14884: - Status: Patch Available (was: Open) > Add sanity check that zone key equals feinfo key w

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-18 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-14884: - Attachment: HDFS-14884.001.patch > Add sanity check that zone key equals feinfo key while

[jira] [Updated] (HDDS-2333) Enable sync option for OM non-HA

2019-10-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2333: - Description: In OM non-HA when double buffer flushes, it should commit with sync turned on

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955013#comment-16955013 ] Tsz-wo Sze commented on HDDS-2331: -- [~adoroszlai], thanks for discovering the problem. T

[jira] [Updated] (HDDS-2333) Enable sync option for OM non-HA

2019-10-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2333: - Description: In OM non-HA when double buffer flushes, it should commit with sync turned on

[jira] [Work logged] (HDDS-2333) Enable sync option for OM non-HA

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2333?focusedWorklogId=330821&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330821 ] ASF GitHub Bot logged work on HDDS-2333: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2333) Enable sync option for OM non-HA

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2333: - Labels: pull-request-available (was: ) > Enable sync option for OM non-HA >

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955011#comment-16955011 ] Tsz-wo Sze commented on HDDS-2331: -- >From https://issues.apache.org/jira/secure/attachmen

[jira] [Created] (HDDS-2333) Enable sync option for OM non-HA

2019-10-18 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2333: Summary: Enable sync option for OM non-HA Key: HDDS-2333 URL: https://issues.apache.org/jira/browse/HDDS-2333 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14912) Set dfs.image.string-tables.expanded default to false in branch-2.7

2019-10-18 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955002#comment-16955002 ] Wei-Chiu Chuang commented on HDFS-14912: Started one for you: https://builds.apac

[jira] [Commented] (HDFS-14912) Set dfs.image.string-tables.expanded default to false in branch-2.7

2019-10-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954984#comment-16954984 ] Siyao Meng commented on HDFS-14912: --- [~weichiu] I doubt if there's still automated yetu

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-10-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954964#comment-16954964 ] Erik Krogen commented on HDFS-14442: Hi [~Sushma_28], I think your patch is a diff be

[jira] [Resolved] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-2318. -- Fix Version/s: 0.5.0 Resolution: Fixed > Avoid proto::tostring in preconditions t

[jira] [Work logged] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?focusedWorklogId=330765&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330765 ] ASF GitHub Bot logged work on HDDS-2318: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954902#comment-16954902 ] Anu Engineer commented on HDDS-2323: I verified the TestAuditPaser works well. Since t

[jira] [Updated] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDDS-2323: --- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) Than

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954858#comment-16954858 ] Ayush Saxena commented on HDFS-14913: - Thanx [~elgoiri] for the review. Have extracte

[jira] [Updated] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14913: Attachment: HDFS-14913-02.patch > Correct the value of available count in > DFSNetworkTopology#cho

[jira] [Commented] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-18 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954853#comment-16954853 ] Siddharth Wagle commented on HDDS-2323: --- Hey [~aengineer]/[~dineshchitlangia], since

[jira] [Commented] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-18 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954847#comment-16954847 ] Dinesh Chitlangia commented on HDDS-2323: - [~aengineer] No, it should be fine. Aud

[jira] [Commented] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954833#comment-16954833 ] Anu Engineer commented on HDDS-2323: The change is so trivial, that I will test this o

[jira] [Comment Edited] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954833#comment-16954833 ] Anu Engineer edited comment on HDDS-2323 at 10/18/19 5:13 PM: --

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954817#comment-16954817 ] Íñigo Goiri commented on HDFS-14908: Thanks [~LiJinglun] for checking, I think we can

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954812#comment-16954812 ] Íñigo Goiri commented on HDFS-14913: The double ternary is tricky. Let's create a fun

[jira] [Commented] (HDDS-2324) Enhance locking mechanism in OzoneMangaer

2019-10-18 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954808#comment-16954808 ] Arpit Agarwal commented on HDDS-2324: - Have we tried switching the fairness setting to

[jira] [Commented] (HDDS-2327) Provide new Freon test to test Ratis pipeline with pure XceiverClientRatis

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954806#comment-16954806 ] Anu Engineer commented on HDDS-2327: Ok, I get it, even though this is a Ratis test ca

[jira] [Commented] (HDDS-2327) Provide new Freon test to test Ratis pipeline with pure XceiverClientRatis

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954804#comment-16954804 ] Anu Engineer commented on HDDS-2327: why is this part of freon ? Should this be a Rati

[jira] [Commented] (HDDS-2328) Support large-scale listing

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954802#comment-16954802 ] Anu Engineer commented on HDDS-2328: The Listing API interface already does that. I wi

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954800#comment-16954800 ] Attila Doroszlai commented on HDDS-2331: Thanks [~aengineer]. I can workaround it

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954792#comment-16954792 ] Anu Engineer commented on HDDS-2331: [~adoroszlai] Would you like me to revert this co

[jira] [Commented] (HDFS-14887) RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954734#comment-16954734 ] Hadoop QA commented on HDFS-14887: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-14887) RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable

2019-10-18 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14887: - Attachment: HDFS-14887.009.patch > RBF: In Router Web UI, Observer Namenode Information displayin

[jira] [Commented] (HDDS-2280) HddsUtils#CheckForException should not return null in case the ratis exception cause is not set

2019-10-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954702#comment-16954702 ] Shashikant Banerjee commented on HDDS-2280: --- st > HddsUtils#CheckForException s

[jira] [Commented] (HDDS-2332) BlockOutputStream#waitOnFlushFutures blocks on putBlock combined future

2019-10-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954697#comment-16954697 ] Shashikant Banerjee commented on HDDS-2332: --- [~ljain], i think we should timeout

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954693#comment-16954693 ] Hadoop QA commented on HDFS-14847: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDDS-2332) BlockOutputStream#waitOnFlushFutures blocks on putBlock combined future

2019-10-18 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954689#comment-16954689 ] Lokesh Jain commented on HDDS-2332: --- Should we support timeout in client as well which w

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954680#comment-16954680 ] Fei Hui commented on HDFS-14847: Upload v005 patch. Fix checkstyle > Erasure Coding: Blo

[jira] [Updated] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14847: --- Attachment: HDFS-14847.005.patch > Erasure Coding: Blocks are over-replicated while EC decommissioning >

[jira] [Created] (HDDS-2332) BlockOutputStream#waitOnFlushFutures blocks on putBlock combined future

2019-10-18 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-2332: - Summary: BlockOutputStream#waitOnFlushFutures blocks on putBlock combined future Key: HDDS-2332 URL: https://issues.apache.org/jira/browse/HDDS-2332 Project: Hadoop Distrib

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954642#comment-16954642 ] Hadoop QA commented on HDFS-14913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-18 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954612#comment-16954612 ] Dinesh Chitlangia commented on HDDS-2323: - [~rajesh.balamohan] Thanks for filing t

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954611#comment-16954611 ] Ayush Saxena commented on HDFS-14913: - Some problem with build, Have retriggered. >

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954603#comment-16954603 ] Ayush Saxena commented on HDFS-14847: - Thanx [~ferhui] Can you handle checkstyle war

[jira] [Commented] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954601#comment-16954601 ] Hadoop QA commented on HDFS-14913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954598#comment-16954598 ] Hadoop QA commented on HDFS-11639: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11639) [PROVIDED Phase 2] Encode the BlockAlias in the client protocol

2019-10-18 Thread Ewan Higgs (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954591#comment-16954591 ] Ewan Higgs commented on HDFS-11639: --- Note for myself as I page this back in: Part of

[jira] [Updated] (HDDS-2325) BenchMarkDatanodeDispatcher genesis test is failing with NPE

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2325: - Labels: pull-request-available (was: ) > BenchMarkDatanodeDispatcher genesis test is failing with

[jira] [Work logged] (HDDS-2325) BenchMarkDatanodeDispatcher genesis test is failing with NPE

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2325?focusedWorklogId=330490&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330490 ] ASF GitHub Bot logged work on HDDS-2325: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2197) Extend SCMCLI Topology command to print node Operational States

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2197?focusedWorklogId=330484&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330484 ] ASF GitHub Bot logged work on HDDS-2197: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2327) Provide new Freon test to test Ratis pipeline with pure XceiverClientRatis

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2327: - Labels: pull-request-available (was: ) > Provide new Freon test to test Ratis pipeline with pure

[jira] [Work logged] (HDDS-2327) Provide new Freon test to test Ratis pipeline with pure XceiverClientRatis

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2327?focusedWorklogId=330480&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330480 ] ASF GitHub Bot logged work on HDDS-2327: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14913: Status: Patch Available (was: Open) > Correct the value of available count in > DFSNetworkTopolog

[jira] [Updated] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14913: Attachment: HDFS-14913-01.patch > Correct the value of available count in > DFSNetworkTopology#cho

[jira] [Work logged] (HDDS-2293) Create a new CONTRIBUTION.md for the new repository

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2293?focusedWorklogId=330476&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330476 ] ASF GitHub Bot logged work on HDDS-2293: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2293) Create a new CONTRIBUTION.md for the new repository

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2293: - Labels: pull-request-available (was: ) > Create a new CONTRIBUTION.md for the new repository > --

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954556#comment-16954556 ] Hadoop QA commented on HDFS-14847: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDDS-2292) Create Ozone specific README.md to the new hadoop-ozone repository

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2292: - Labels: pull-request-available (was: ) > Create Ozone specific README.md to the new hadoop-ozone

[jira] [Updated] (HDDS-2292) Create Ozone specific README.md to the new hadoop-ozone repository

2019-10-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2292: -- Status: Patch Available (was: Open) > Create Ozone specific README.md to the new hadoop-ozone repositor

[jira] [Work logged] (HDDS-2292) Create Ozone specific README.md to the new hadoop-ozone repository

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2292?focusedWorklogId=330471&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330471 ] ASF GitHub Bot logged work on HDDS-2292: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2197) Extend SCMCLI Topology command to print node Operational States

2019-10-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2197: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Extend SCMCLI Topology command to p

[jira] [Comment Edited] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954527#comment-16954527 ] Attila Doroszlai edited comment on HDDS-2331 at 10/18/19 11:58 AM: -

[jira] [Updated] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2331: --- Description: Freon random key generator exhausts default heap after just few hundred 1MB keys

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954527#comment-16954527 ] Attila Doroszlai commented on HDDS-2331: Hi [~szetszwo], can you please check this

[jira] [Updated] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2331: --- Attachment: profiler.png > Client OOME due to buffer retention > -

[jira] [Created] (HDDS-2331) Client OOME due to buffer retention

2019-10-18 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2331: -- Summary: Client OOME due to buffer retention Key: HDDS-2331 URL: https://issues.apache.org/jira/browse/HDDS-2331 Project: Hadoop Distributed Data Store I

[jira] [Updated] (HDDS-2330) Random key generator can get stuck

2019-10-18 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2330: --- Status: Patch Available (was: Open) > Random key generator can get stuck > --

[jira] [Updated] (HDDS-2330) Random key generator can get stuck

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2330: - Labels: pull-request-available (was: ) > Random key generator can get stuck > ---

[jira] [Work logged] (HDDS-2330) Random key generator can get stuck

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2330?focusedWorklogId=330438&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330438 ] ASF GitHub Bot logged work on HDDS-2330: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-18 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954500#comment-16954500 ] Fei Hui commented on HDFS-14852: TestReconstructStripedFileWithRandomECPolicy & TestRecon

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954499#comment-16954499 ] Hadoop QA commented on HDFS-14908: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-18 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14908: --- Attachment: Test.java > LeaseManager should check parent-child relationship when filter open files. > ---

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-18 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954497#comment-16954497 ] Jinglun commented on HDFS-14908: I did a benchmark and here is the result. Test file is T

[jira] [Created] (HDDS-2330) Random key generator can get stuck

2019-10-18 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2330: -- Summary: Random key generator can get stuck Key: HDDS-2330 URL: https://issues.apache.org/jira/browse/HDDS-2330 Project: Hadoop Distributed Data Store Is

[jira] [Work logged] (HDDS-2281) ContainerStateMachine#handleWriteChunk should ignore close container exception

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2281?focusedWorklogId=330422&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330422 ] ASF GitHub Bot logged work on HDDS-2281: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2281) ContainerStateMachine#handleWriteChunk should ignore close container exception

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2281?focusedWorklogId=330421&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330421 ] ASF GitHub Bot logged work on HDDS-2281: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-2324) Enhance locking mechanism in OzoneMangaer

2019-10-18 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar reassigned HDDS-2324: - Assignee: Nanda kumar > Enhance locking mechanism in OzoneMangaer > -

[jira] [Created] (HDDS-2329) Destroy pipelines on any decommission or maintenance nodes

2019-10-18 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-2329: --- Summary: Destroy pipelines on any decommission or maintenance nodes Key: HDDS-2329 URL: https://issues.apache.org/jira/browse/HDDS-2329 Project: Hadoop Distribut

[jira] [Work logged] (HDDS-2281) ContainerStateMachine#handleWriteChunk should ignore close container exception

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2281?focusedWorklogId=330414&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330414 ] ASF GitHub Bot logged work on HDDS-2281: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2281) ContainerStateMachine#handleWriteChunk should ignore close container exception

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2281?focusedWorklogId=330413&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330413 ] ASF GitHub Bot logged work on HDDS-2281: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954481#comment-16954481 ] Fei Hui commented on HDFS-14847: [~ayushtkn] Thanks for your review! For an EC block(RS-6

[jira] [Work logged] (HDDS-2326) Http server of Freon is not started for new Freon tests

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2326?focusedWorklogId=330408&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330408 ] ASF GitHub Bot logged work on HDDS-2326: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2326) Http server of Freon is not started for new Freon tests

2019-10-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2326: - Labels: pull-request-available (was: ) > Http server of Freon is not started for new Freon tests

[jira] [Updated] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-18 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14847: --- Attachment: HDFS-14847.004.patch > Erasure Coding: Blocks are over-replicated while EC decommissioning >

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954466#comment-16954466 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDDS-2328) Support large-scale listing

2019-10-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2328: --- Description: Large-scale listing of directory contents takes a lot longer time and also has t

[jira] [Commented] (HDDS-2324) Enhance locking mechanism in OzoneMangaer

2019-10-18 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954449#comment-16954449 ] Mukul Kumar Singh commented on HDDS-2324: - cc [~bharat] [~arp] [~hanishakoneru] [~

[jira] [Assigned] (HDDS-2328) Support large-scale listing

2019-10-18 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2328: --- Assignee: Hanisha Koneru > Support large-scale listing > ---

[jira] [Created] (HDDS-2328) Support large-scale listing

2019-10-18 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HDDS-2328: -- Summary: Support large-scale listing Key: HDDS-2328 URL: https://issues.apache.org/jira/browse/HDDS-2328 Project: Hadoop Distributed Data Store Issue Ty

[jira] [Commented] (HDDS-2181) Ozone Manager should send correct ACL type in ACL requests to Authorizer

2019-10-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954413#comment-16954413 ] Marton Elek commented on HDDS-2181: --- Yes, I did. Sorry I didn't explain it here. I rever

[jira] [Created] (HDDS-2327) Provide new Freon test to test Ratis pipeline with pure XceiverClientRatis

2019-10-18 Thread Marton Elek (Jira)
Marton Elek created HDDS-2327: - Summary: Provide new Freon test to test Ratis pipeline with pure XceiverClientRatis Key: HDDS-2327 URL: https://issues.apache.org/jira/browse/HDDS-2327 Project: Hadoop Dist

[jira] [Created] (HDDS-2326) Http server of Freon is not started for new Freon tests

2019-10-18 Thread Marton Elek (Jira)
Marton Elek created HDDS-2326: - Summary: Http server of Freon is not started for new Freon tests Key: HDDS-2326 URL: https://issues.apache.org/jira/browse/HDDS-2326 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2325) BenchMarkDatanodeDispatcher genesis test is failing with NPE

2019-10-18 Thread Marton Elek (Jira)
Marton Elek created HDDS-2325: - Summary: BenchMarkDatanodeDispatcher genesis test is failing with NPE Key: HDDS-2325 URL: https://issues.apache.org/jira/browse/HDDS-2325 Project: Hadoop Distributed Data S

[jira] [Created] (HDFS-14913) Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-18 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-14913: --- Summary: Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType() Key: HDFS-14913 URL: https://issues.apache.org/jira/browse/HDFS-14913

[jira] [Updated] (HDDS-2324) Enhance locking mechanism in OzoneMangaer

2019-10-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2324: --- Labels: performance (was: ) > Enhance locking mechanism in OzoneMangaer > ---

[jira] [Commented] (HDDS-2324) Enhance locking mechanism in OzoneMangaer

2019-10-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954367#comment-16954367 ] Rajesh Balamohan commented on HDDS-2324: Attached lock profiler output for reader

[jira] [Updated] (HDDS-2324) Enhance locking mechanism in OzoneMangaer

2019-10-18 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2324: --- Attachment: om_lock_reader_and_writer_workload.svg om_lock_100_percent_read_ben

  1   2   >