[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963991#comment-16963991 ] Mukul Kumar Singh commented on HDDS-2356: - Hi [~timmylicheng], the following error is a new issue.

[jira] [Updated] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-14948: -- Description: We see increasing use of HttpFS as a compatibility bridge and also as a bridge between

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964212#comment-16964212 ] Íñigo Goiri commented on HDFS-14938: Maybe we should add the new test code to a separate function to

[jira] [Created] (HDDS-2391) Consolidate XCeiverClientManager instantiation

2019-10-31 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2391: -- Summary: Consolidate XCeiverClientManager instantiation Key: HDDS-2391 URL: https://issues.apache.org/jira/browse/HDDS-2391 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14940) HDFS Balancer : getBalancerBandwidth displaying wrong values for the maximum network bandwidth used by the datanode while network bandwidth set with values as 104857600

2019-10-31 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964032#comment-16964032 ] Kihwal Lee commented on HDFS-14940: --- This is per-datanode bandwidth setting. There should be a

[jira] [Assigned] (HDDS-2391) Consolidate XCeiverClientManager instantiation

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth reassigned HDDS-2391: -- Assignee: Istvan Fajth > Consolidate XCeiverClientManager instantiation >

[jira] [Assigned] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reassigned HDFS-14948: Assignee: Ahmed Hussein > Improve HttpFS Server > - > >

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964156#comment-16964156 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/31/19 3:53 PM:

[jira] [Assigned] (HDDS-2389) add toStateMachineLogEntryString provider in Ozone's ContainerStateMachine

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2389: --- Assignee: Mukul Kumar Singh > add toStateMachineLogEntryString provider in Ozone's

[jira] [Created] (HDDS-2389) add toStateMachineLogEntryString provider in Ozone's ContainerStateMachine

2019-10-31 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-2389: --- Summary: add toStateMachineLogEntryString provider in Ozone's ContainerStateMachine Key: HDDS-2389 URL: https://issues.apache.org/jira/browse/HDDS-2389

[jira] [Resolved] (HDFS-5441) Wrong use of catalina opts in httpfs.sh

2019-10-31 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-5441. -- Resolution: Won't Fix It moved on to Jetty. No longer relevant. > Wrong use of catalina opts in

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964079#comment-16964079 ] Hadoop QA commented on HDFS-6874: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-10-31 Thread Kihwal Lee (Jira)
Kihwal Lee created HDFS-14949: - Summary: HttpFS does not support getServerDefaults() Key: HDFS-14949 URL: https://issues.apache.org/jira/browse/HDFS-14949 Project: Hadoop HDFS Issue Type:

[jira] [Reopened] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani reopened HDFS-14884: - Assignee: Yuval Degani (was: Mukul Kumar Singh) Submitting a revised patch for branch-2 >

[jira] [Created] (HDDS-2390) SCMSecurityClient and mixing of abstraction layers

2019-10-31 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2390: -- Summary: SCMSecurityClient and mixing of abstraction layers Key: HDDS-2390 URL: https://issues.apache.org/jira/browse/HDDS-2390 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-2390) SCMSecurityClient and mixing of abstraction layers

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964025#comment-16964025 ] Istvan Fajth commented on HDDS-2390: I am working on a PR for this one and I will publish it hopefully

[jira] [Assigned] (HDDS-2390) SCMSecurityClient and mixing of abstraction layers

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth reassigned HDDS-2390: -- Assignee: Istvan Fajth > SCMSecurityClient and mixing of abstraction layers >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964156#comment-16964156 ] Bharat Viswanadham commented on HDDS-2356: -- {quote} What are you looking for in audit logs?

[jira] [Commented] (HDFS-14891) RBF: namenode links in NameFederation Health page (federationhealth.html) cannot use https scheme

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964200#comment-16964200 ] Íñigo Goiri commented on HDFS-14891: [~risyomei], I am referring to: {code} 52 /** 53 *

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964138#comment-16964138 ] Li Cheng commented on HDDS-2356: [~msingh] I check OM audit log and it looks like this one:

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964156#comment-16964156 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/31/19 3:55 PM:

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani updated HDFS-14884: Attachment: HDFS-14884-branch-2.001.patch > Add sanity check that zone key equals feinfo key while

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964209#comment-16964209 ] Íñigo Goiri commented on HDFS-14908: Let's go with v03 then. We should add a javadoc to startsWith

[jira] [Commented] (HDDS-2364) Add a OM metrics to find the false positive rate for the keyMayExist

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964000#comment-16964000 ] Mukul Kumar Singh commented on HDDS-2364: - I had a cursory look at the patch and it looks good to

[jira] [Resolved] (HDDS-2219) Move all the ozone dist scripts/configs to one location

2019-10-31 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2219. --- Fix Version/s: 0.5.0 Resolution: Fixed > Move all the ozone dist scripts/configs to one

[jira] [Work logged] (HDDS-2219) Move all the ozone dist scripts/configs to one location

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2219?focusedWorklogId=336786=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336786 ] ASF GitHub Bot logged work on HDDS-2219: Author: ASF GitHub Bot

[jira] [Created] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Kihwal Lee (Jira)
Kihwal Lee created HDFS-14948: - Summary: Improve HttpFS Server Key: HDFS-14948 URL: https://issues.apache.org/jira/browse/HDFS-14948 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-14943) RBF: Add Namespace to the Overview page in the Web UI

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964205#comment-16964205 ] Íñigo Goiri commented on HDFS-14943: After checking, the current Router does not have the concept of

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964283#comment-16964283 ] Ayush Saxena commented on HDFS-14936: - Committed to trunk. Thanx [~leosun08] for the contribution

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964286#comment-16964286 ] Ayush Saxena commented on HDFS-14920: - Thanx [~ferhui] for the patch. v005 LGTM +1 > Erasure Coding:

[jira] [Updated] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2375: - Description: In HDDS-2331, we found that Ozone client allocates a ByteBuffer with chunk size (e.g. 16MB

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964301#comment-16964301 ] Hudson commented on HDFS-14936: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17589 (See

[jira] [Commented] (HDDS-2384) Large chunks during write can have memory pressure on DN with multiple clients

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964348#comment-16964348 ] Anu Engineer commented on HDDS-2384: Thank you for flagging this issue. I think this is a hard to

[jira] [Commented] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964354#comment-16964354 ] Wei-Chiu Chuang commented on HDFS-14948: [~smeng] and other contributors added a number of REST

[jira] [Updated] (HDDS-2392) Fix TestScmSafeMode#testSCMSafeModeRestrictedOp

2019-10-31 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-2392: - Description: After ratis upgrade (HDDS-2340), TestScmSafeMode#testSCMSafeModeRestrictedOp fails

[jira] [Updated] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14920: Fix Version/s: 3.2.2 3.1.4 3.3.0 Hadoop Flags: Reviewed

[jira] [Assigned] (HDDS-2384) Large chunks during write can have memory pressure on DN with multiple clients

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDDS-2384: -- Assignee: Anu Engineer > Large chunks during write can have memory pressure on DN with

[jira] [Work logged] (HDDS-2293) Create a new CONTRIBUTION.md for the new repository

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2293?focusedWorklogId=336953=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336953 ] ASF GitHub Bot logged work on HDDS-2293: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-2293) Create a new CONTRIBUTION.md for the new repository

2019-10-31 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-2293. - Fix Version/s: 0.5.0 Resolution: Fixed Thank you all for reviews and [~elek] for

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964315#comment-16964315 ] Hudson commented on HDFS-14920: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17590 (See

[jira] [Work logged] (HDDS-2380) Use the Table.isExist API instead of get() call while checking for presence of key.

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2380?focusedWorklogId=336965=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336965 ] ASF GitHub Bot logged work on HDDS-2380: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2386) Implement incremental ChunkBuffer

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2386: - Attachment: o2386_20191031b.patch > Implement incremental ChunkBuffer > -

[jira] [Commented] (HDDS-2370) Remove classpath in RunningWithHDFS.md ozone-hdfs/docker-compose as dir 'ozoneplugin' is not exist anymore

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964296#comment-16964296 ] Anu Engineer commented on HDDS-2370: Yeap, I am fine with removing it. I don't think we are testing or

[jira] [Commented] (HDDS-2386) Implement incremental ChunkBuffer

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964298#comment-16964298 ] Tsz-wo Sze commented on HDDS-2386: -- o2386_20191031b.patch: fixes test failures. > Implement incremental

[jira] [Commented] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964297#comment-16964297 ] Bharat Viswanadham commented on HDDS-2388: -- If WAL has been cleared, then we get this error. Not

[jira] [Commented] (HDFS-14284) RBF: Log Router identifier when reporting exceptions

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964271#comment-16964271 ] Ayush Saxena commented on HDFS-14284: - Thanx [~hemanthboyina] for the patch. As I said before, please

[jira] [Updated] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14936: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964345#comment-16964345 ] Hadoop QA commented on HDFS-14884: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-1847. Fix Version/s: 0.5.0 Resolution: Fixed I have committed this patch to the master branch. >

[jira] [Work logged] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?focusedWorklogId=336991=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336991 ] ASF GitHub Bot logged work on HDDS-1847: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?focusedWorklogId=336990=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336990 ] ASF GitHub Bot logged work on HDDS-1847: Author: ASF GitHub Bot

[jira] [Created] (HDDS-2392) Fix TestScmSafeMode#testSCMSafeModeRestrictedOp

2019-10-31 Thread Hanisha Koneru (Jira)
Hanisha Koneru created HDDS-2392: Summary: Fix TestScmSafeMode#testSCMSafeModeRestrictedOp Key: HDDS-2392 URL: https://issues.apache.org/jira/browse/HDDS-2392 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964374#comment-16964374 ] Siyao Meng commented on HDDS-1847: -- Looks like this commit breaks {{TestKeyManagerImpl}} in {{setUp()}}

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani updated HDFS-14884: Attachment: (was: HDFS-14884-branch-2.001.patch) > Add sanity check that zone key equals

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani updated HDFS-14884: Attachment: HDFS-14884-branch-2.001.patch Fix Version/s: 2.11.0 Target

[jira] [Commented] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964573#comment-16964573 ] Li Cheng commented on HDDS-2395: Also please note the exclude list issue.   2019-11-01 11:25:24,047

[jira] [Created] (HDFS-14950) missing libhdfspp libs in dist-package

2019-10-31 Thread Yuan Zhou (Jira)
Yuan Zhou created HDFS-14950: Summary: missing libhdfspp libs in dist-package Key: HDFS-14950 URL: https://issues.apache.org/jira/browse/HDFS-14950 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964579#comment-16964579 ] Hudson commented on HDFS-12943: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17592 (See

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964586#comment-16964586 ] Bharat Viswanadham commented on HDDS-2356: -- Has the above error caused crash in OM? If so, can

[jira] [Resolved] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-2363. -- Resolution: Fixed > Failed to create Ratis container > > >

[jira] [Updated] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2397: - Labels: pull-request-available (was: ) > Fix calling cleanup for few missing tables in OM >

[jira] [Created] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2397: Summary: Fix calling cleanup for few missing tables in OM Key: HDDS-2397 URL: https://issues.apache.org/jira/browse/HDDS-2397 Project: Hadoop Distributed Data

[jira] [Work logged] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?focusedWorklogId=337179=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337179 ] ASF GitHub Bot logged work on HDDS-2311: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964598#comment-16964598 ] Leon Gao commented on HDFS-14927: - Thanks [~inigoiri] and [~ayushtkn] for the review ^ > RBF: Add

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964617#comment-16964617 ] Hadoop QA commented on HDFS-14938: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-12943: - Release Note: Observer is a new type of a NameNode in addition to Active and Standby Nodes in

[jira] [Updated] (HDFS-14950) missing libhdfspp libs in dist-package

2019-10-31 Thread Yuan Zhou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Zhou updated HDFS-14950: - Attachment: fix_libhdfspp_lib.patch Status: Patch Available (was: Open) > missing libhdfspp

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964627#comment-16964627 ] Surendra Singh Lilhore commented on HDFS-14768: --- [~gjhkael], we appreciate your hard work

[jira] [Comment Edited] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964625#comment-16964625 ] Surendra Singh Lilhore edited comment on HDFS-14768 at 11/1/19 5:51 AM:

[jira] [Commented] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964585#comment-16964585 ] Bharat Viswanadham commented on HDDS-2395: -- Hi [~timmylicheng] Exclude List is fixed as part of

[jira] [Assigned] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-2397: Assignee: Bharat Viswanadham > Fix calling cleanup for few missing tables in OM >

[jira] [Work logged] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?focusedWorklogId=337178=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337178 ] ASF GitHub Bot logged work on HDDS-2397: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14950) missing libhdfspp libs in dist-package

2019-10-31 Thread Yuan Zhou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Zhou updated HDFS-14950: - Attachment: (was: fix_libhdfspp_lib.patch) > missing libhdfspp libs in dist-package >

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964554#comment-16964554 ] Li Cheng edited comment on HDDS-2356 at 11/1/19 3:45 AM: - Also see a core dump in

[jira] [Commented] (HDDS-2396) OM rocksdb core dump during writing

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964578#comment-16964578 ] Li Cheng commented on HDDS-2396: Attached the entire log for the core dump. Will try to turn on ulimit and

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964591#comment-16964591 ] Hadoop QA commented on HDFS-14937: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-31 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-2311. - Fix Version/s: 0.5.0 Resolution: Fixed [~bharat] Thank you for flagging this issue

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964625#comment-16964625 ] Surendra Singh Lilhore commented on HDFS-14768: --- [~gjhkael] why you think it is not a

[jira] [Reopened] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reopened HDFS-14768: --- > EC : Busy DN replica should be consider in live replica check. >

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-31 Thread xuzq (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964560#comment-16964560 ] xuzq commented on HDFS-14937: - Thanks [~xkrogen] [~vagarychen] for the comment. RetryInvocationHandler use 

[jira] [Updated] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-31 Thread xuzq (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuzq updated HDFS-14937: Attachment: HDFS-14937-trunk-002.patch > [SBN read] ObserverReadProxyProvider should throw InterruptException >

[jira] [Created] (HDDS-2396) OM rocksdb core dump during writing

2019-10-31 Thread Li Cheng (Jira)
Li Cheng created HDDS-2396: -- Summary: OM rocksdb core dump during writing Key: HDDS-2396 URL: https://issues.apache.org/jira/browse/HDDS-2396 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Updated] (HDDS-2396) OM rocksdb core dump during writing

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2396: --- Attachment: hs_err_pid9340.log > OM rocksdb core dump during writing > --- >

[jira] [Updated] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Fix Version/s: 0.5.0 > Failed to create Ratis container > > >

[jira] [Issue Comment Deleted] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2356: - Comment: was deleted (was: Has the above error caused crash in OM? If so, can you share

[jira] [Resolved] (HDFS-14020) Emulate Observer node falling far behind the Active

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-14020. Resolution: Duplicate Resolving as duplicate since HDFS-13873 introduced

[jira] [Commented] (HDDS-2364) Add a OM metrics to find the false positive rate for the keyMayExist

2019-10-31 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964433#comment-16964433 ] Aravindan Vijayan commented on HDDS-2364: - [~msingh] Thanks for the review. I will raise follow up

[jira] [Updated] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Status: Open (was: Patch Available) > EC : Busy DN replica should be consider in live replica check. >

[jira] [Resolved] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-12943. Fix Version/s: 2.10.0 3.2.2 3.1.4

[jira] [Resolved] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh resolved HDFS-14768. -- Resolution: Not A Problem > EC : Busy DN replica should be consider in live replica check. >

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964530#comment-16964530 ] Lisheng Sun commented on HDFS-14938: Thanks [~elgoiri] for your comments. I add a javadoc and ut for

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964554#comment-16964554 ] Li Cheng commented on HDDS-2356: Also see a core dump in rocksdb during last night's testing. Please check

[jira] [Assigned] (HDDS-2393) HDDS-1847 broke some unit tests

2019-10-31 Thread Chris Teoh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Teoh reassigned HDDS-2393: Assignee: Chris Teoh Description: Siyao Meng commented on HDDS-1847:

[jira] [Updated] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2395: - Summary: Handle Ozone S3 completeMPU to match with aws s3 behavior. (was: Handle

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964443#comment-16964443 ] Wei-Chiu Chuang commented on HDFS-14720: I don't think this fix is relevant to HDFS-14794. This

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964476#comment-16964476 ] Konstantin Shvachko commented on HDFS-14720: Does it need a unit test? > DataNode shouldn't

[jira] [Updated] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2395: - Issue Type: Bug (was: Task) > Handle Ozone S3 completeMPU to match with aws s3 behavior.

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964502#comment-16964502 ] Íñigo Goiri commented on HDFS-14927: +1 on [^HDFS-14927.009.patch]. > RBF: Add metrics for async

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: hs_err_pid9340.log > Multipart upload report errors while writing to ozone Ratis pipeline >

[jira] [Updated] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Summary: Failed to create Ratis container (was: Fail to create Ratis container) > Failed to create

  1   2   >