[jira] [Commented] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965229#comment-16965229 ] Fei Hui commented on HDFS-14946: [~ayushtkn] Thanks for you review! {code} +assert srcNodes.length ==

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Attachment: HDFS-14946.002.patch > Erasure Coding: Block recovery failed during decommissioning >

[jira] [Commented] (HDFS-14922) On StartUp , Snapshot modification time got changed

2019-11-01 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965208#comment-16965208 ] Virajith Jalaparti commented on HDFS-14922: --- Thanks for fixing this [~hemanthboyina]. The edit

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-11-01 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965167#comment-16965167 ] Yuval Degani commented on HDFS-14884: - Ran the two failed tests locally and they passed without any

[jira] [Commented] (HDFS-14925) rename operation should check nest snapshot

2019-11-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965158#comment-16965158 ] Hudson commented on HDFS-14925: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17598 (See

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-11-01 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965157#comment-16965157 ] Anu Engineer commented on HDDS-1847: It was my mistake. I saw this patch did not have the CI run. The

[jira] [Resolved] (HDFS-14925) rename operation should check nest snapshot

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14925. Fix Version/s: 3.2.2 3.1.4 Resolution: Fixed Thanks! merged the

[jira] [Updated] (HDFS-14944) ec admin such as : -enablePolicy should support multi federation namespace not only the default namespace in core-site.xml

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14944: --- Component/s: federation > ec admin such as : -enablePolicy should support multi federation

[jira] [Updated] (HDFS-14944) ec admin such as : -enablePolicy should support multi federation namespace not only the default namespace in core-site.xml

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14944: --- Component/s: ec > ec admin such as : -enablePolicy should support multi federation namespace

[jira] [Assigned] (HDFS-14925) rename operation should check nest snapshot

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14925: -- Assignee: Junwang Zhao > rename operation should check nest snapshot >

[jira] [Updated] (HDFS-14925) rename operation should check nest snapshot

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14925: --- Fix Version/s: 3.3.0 > rename operation should check nest snapshot >

[jira] [Comment Edited] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965151#comment-16965151 ] Wei-Chiu Chuang edited comment on HDFS-14802 at 11/1/19 11:20 PM: --

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965151#comment-16965151 ] Wei-Chiu Chuang commented on HDFS-14802: Unrelated. It's unfortunate the configuration is listed

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965148#comment-16965148 ] Hadoop QA commented on HDFS-14884: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14945) Revise PacketResponder's log.

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965146#comment-16965146 ] Wei-Chiu Chuang commented on HDFS-14945: +1 > Revise PacketResponder's log. >

[jira] [Commented] (HDFS-14947) infrequent data loss due to rename functionality breaking

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965143#comment-16965143 ] Wei-Chiu Chuang commented on HDFS-14947: I would be really really surprised if a file simply

[jira] [Comment Edited] (HDFS-14951) KMS Jetty server does not startup if trust store password is null

2019-11-01 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965130#comment-16965130 ] Hanisha Koneru edited comment on HDFS-14951 at 11/1/19 10:36 PM: - Pinging

[jira] [Commented] (HDFS-14951) KMS Jetty server does not startup if trust store password is null

2019-11-01 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965130#comment-16965130 ] Hanisha Koneru commented on HDFS-14951: --- Pinging [~weichiu] for review please. > KMS Jetty server

[jira] [Updated] (HDFS-14951) KMS Jetty server does not startup if trust store password is null

2019-11-01 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-14951: -- Attachment: HDFS-14951.001.patch > KMS Jetty server does not startup if trust store password

[jira] [Created] (HDFS-14951) KMS Jetty server does not startup if trust store password is null

2019-11-01 Thread Hanisha Koneru (Jira)
Hanisha Koneru created HDFS-14951: - Summary: KMS Jetty server does not startup if trust store password is null Key: HDFS-14951 URL: https://issues.apache.org/jira/browse/HDFS-14951 Project: Hadoop

[jira] [Work logged] (HDDS-2398) Remove usage of LogUtils class from ratis-common

2019-11-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2398?focusedWorklogId=337549=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337549 ] ASF GitHub Bot logged work on HDDS-2398: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2398) Remove usage of LogUtils class from ratis-common

2019-11-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2398: - Labels: pull-request-available (was: ) > Remove usage of LogUtils class from ratis-common >

[jira] [Updated] (HDDS-2291) Acceptance tests for OM HA

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2291: Status: Patch Available (was: Open) > Acceptance tests for OM HA > -- > >

[jira] [Assigned] (HDDS-2388) Teragen test failure due to OM exception

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDDS-2388: --- Assignee: Hanisha Koneru > Teragen test failure due to OM exception >

[jira] [Created] (HDDS-2398) Remove usage of LogUtils class from ratis-common

2019-11-01 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2398: Summary: Remove usage of LogUtils class from ratis-common Key: HDDS-2398 URL: https://issues.apache.org/jira/browse/HDDS-2398 Project: Hadoop Distributed Data

[jira] [Assigned] (HDDS-2398) Remove usage of LogUtils class from ratis-common

2019-11-01 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-2398: Assignee: Bharat Viswanadham > Remove usage of LogUtils class from ratis-common >

[jira] [Resolved] (HDDS-2393) HDDS-1847 broke some unit tests

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-2393. - Resolution: Not A Problem Reverted HDDS-1847 for now, so this should not be necessary. Let's

[jira] [Updated] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1847: Fix Version/s: (was: 0.5.0) > Datanode Kerberos principal and keytab config key looks

[jira] [Updated] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-1847: Target Version/s: 0.5.0 Affects Version/s: (was: 0.5.0) > Datanode Kerberos principal and

[jira] [Reopened] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDDS-1847: - I've reverted this to unblock other CI runs which may get stuck on the failing tests. We can

[jira] [Commented] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965069#comment-16965069 ] Wei-Chiu Chuang commented on HDFS-14942: I'm assuming this issue happens during rolling upgrade

[jira] [Comment Edited] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965068#comment-16965068 ] Arpit Agarwal edited comment on HDDS-1847 at 11/1/19 8:17 PM: -- Looks like

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-11-01 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965068#comment-16965068 ] Arpit Agarwal commented on HDDS-1847: - Looks like this commit did not get a full Anzix CI run in

[jira] [Assigned] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14942: -- Assignee: Lisheng Sun > Change Log Level to warn in

[jira] [Commented] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965065#comment-16965065 ] Íñigo Goiri commented on HDFS-14949: We can fix the checkstyles in BaseTestHttpFSWith. The other one

[jira] [Commented] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965056#comment-16965056 ] Hadoop QA commented on HDFS-14949: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-14477) No enum constant Operation.GET_BLOCK_LOCATIONS

2019-11-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965030#comment-16965030 ] hemanthboyina edited comment on HDFS-14477 at 11/1/19 6:49 PM: --- the

[jira] [Commented] (HDFS-14477) No enum constant Operation.GET_BLOCK_LOCATIONS

2019-11-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965030#comment-16965030 ] hemanthboyina commented on HDFS-14477: -- the operation getfileblocklocations was there in httpfs ,

[jira] [Comment Edited] (HDFS-14922) On StartUp , Snapshot modification time got changed

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965027#comment-16965027 ] Íñigo Goiri edited comment on HDFS-14922 at 11/1/19 6:39 PM: - It would be

[jira] [Commented] (HDFS-14922) On StartUp , Snapshot modification time got changed

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965027#comment-16965027 ] Íñigo Goiri commented on HDFS-14922: It would be good to add the javadoc through all the code path

[jira] [Updated] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-11-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14949: - Attachment: HDFS-14949.002.patch > HttpFS does not support getServerDefaults() >

[jira] [Resolved] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-11-01 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-2397. - Fix Version/s: 0.5.0 Resolution: Fixed [~bharat] Thank you for spotting and fixing

[jira] [Work logged] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-11-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?focusedWorklogId=337463=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337463 ] ASF GitHub Bot logged work on HDDS-2397: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-11-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965017#comment-16965017 ] Hudson commented on HDFS-13736: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17597 (See

[jira] [Commented] (HDFS-14922) On StartUp , Snapshot modification time got changed

2019-11-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965012#comment-16965012 ] hemanthboyina commented on HDFS-14922: -- can you please review the patch [~elgoiri]  > On StartUp ,

[jira] [Updated] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-11-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-13736: Fix Version/s: 3.2.2 3.1.4 3.3.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-11-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965009#comment-16965009 ] Ayush Saxena commented on HDFS-13736: - Committed to trunk,3.2 and 3.1 Thanx [~xiaodong.hu] for the

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-11-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965003#comment-16965003 ] Hudson commented on HDFS-14927: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17596 (See

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-11-01 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965002#comment-16965002 ] Wei-Chiu Chuang commented on HDFS-14720: i'm okay without a test since it's mostly a cosmetic

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964994#comment-16964994 ] Íñigo Goiri commented on HDFS-14908: I think that the unit test failures are unrelated. Do you mind

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964992#comment-16964992 ] Íñigo Goiri commented on HDFS-14927: Thanks [~LeonG] for the patch and [~ayushtkn] for the review.

[jira] [Updated] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14927: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964990#comment-16964990 ] Íñigo Goiri commented on HDFS-14942: As we are changing that, do you mind changing the log to use

[jira] [Updated] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14942: --- Description: when hadoop 2.x upgrades to hadoop 3.x,  InterQJournalProtocol is newly added,so 

[jira] [Updated] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14942: --- Environment: (was: when hadoop 2.x upgrades to hadoop 3.x,   InterQJournalProtocol is newly

[jira] [Updated] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-11-01 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14942: --- Description: when hadoop 2.x upgrades to hadoop 3.x,  InterQJournalProtocol is newly added,so 

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-11-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964988#comment-16964988 ] Ayush Saxena commented on HDFS-14938: - [~leosun08] where is the javadoc and the function in v005 as

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-11-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964987#comment-16964987 ] Hudson commented on HDFS-14768: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17594 (See

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964985#comment-16964985 ] Hadoop QA commented on HDFS-14908: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-11-01 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964980#comment-16964980 ] Surendra Singh Lilhore commented on HDFS-14768: --- For branch-3.2 and branch-3.1 need new

[jira] [Updated] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-11-01 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-14768: -- Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964974#comment-16964974 ] Ayush Saxena commented on HDFS-14946: - Where is {{j}} incrementing? {code:java} for(int i =

[jira] [Commented] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-11-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964972#comment-16964972 ] Hudson commented on HDFS-14824: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17593 (See

[jira] [Commented] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964965#comment-16964965 ] Ayush Saxena commented on HDFS-14946: - Thanx [~ferhui] for the report. Initial Doubt : {code:java} +

[jira] [Commented] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964966#comment-16964966 ] Hadoop QA commented on HDFS-14949: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964961#comment-16964961 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-11-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14824: --- Fix Version/s: 3.3.0 > [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the >

[jira] [Updated] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-11-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14824: --- Resolution: Fixed Status: Resolved (was: Patch Available) > [Dynamometer] Dynamometer in

[jira] [Commented] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-11-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964955#comment-16964955 ] Erik Krogen commented on HDFS-14824: Thanks [~tasanuma]! Just committed this to trunk. >

[jira] [Comment Edited] (HDDS-2396) OM rocksdb core dump during writing

2019-11-01 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964947#comment-16964947 ] Bharat Viswanadham edited comment on HDDS-2396 at 11/1/19 4:30 PM: --- Hi

[jira] [Comment Edited] (HDDS-2396) OM rocksdb core dump during writing

2019-11-01 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964947#comment-16964947 ] Bharat Viswanadham edited comment on HDDS-2396 at 11/1/19 4:30 PM: --- Hi

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964951#comment-16964951 ] Hadoop QA commented on HDFS-14854: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDDS-2396) OM rocksdb core dump during writing

2019-11-01 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964947#comment-16964947 ] Bharat Viswanadham commented on HDDS-2396: -- Hi [~aengineer] The issue resolved with

[jira] [Updated] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-11-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14949: - Attachment: HDFS-14949.001.patch Assignee: hemanthboyina Status: Patch Available

[jira] [Commented] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-11-01 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964889#comment-16964889 ] hemanthboyina commented on HDFS-14949: -- was working on this , will upload patch shortly > HttpFS

[jira] [Commented] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964879#comment-16964879 ] Hadoop QA commented on HDFS-14946: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-11-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964858#comment-16964858 ] Jinglun commented on HDFS-14908: Hi [~elgoiri], thanks your nice suggestion ! Upload v05 with javadoc for

[jira] [Updated] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-11-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14908: --- Attachment: HDFS-14908.005.patch > LeaseManager should check parent-child relationship when filter open

[jira] [Updated] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-11-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14908: --- Attachment: (was: HDFS-14908.005.patch) > LeaseManager should check parent-child relationship when

[jira] [Updated] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-11-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14908: --- Attachment: HDFS-14908.005.patch > LeaseManager should check parent-child relationship when filter open

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-11-01 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964833#comment-16964833 ] Surendra Singh Lilhore commented on HDFS-14768: --- +1, will wait for build report. > EC :

[jira] [Updated] (HDFS-14854) Create improved decommission monitor implementation

2019-11-01 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14854: - Attachment: HDFS-14854.012.patch > Create improved decommission monitor implementation >

[jira] [Updated] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-11-01 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-14768: -- Status: Patch Available (was: Reopened) > EC : Busy DN replica should be

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964830#comment-16964830 ] Fei Hui commented on HDFS-14802: ping [~ste...@apache.org] [~ayushtkn] > The feature of protect

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-11-01 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964829#comment-16964829 ] Stephen O'Donnell commented on HDFS-14854: -- Uploading another revision which addresses the typo

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964828#comment-16964828 ] Fei Hui commented on HDFS-14852: [~surendrasingh] [~ayushtkn] Could you please take a look? > Remove of

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964811#comment-16964811 ] Fei Hui commented on HDFS-14768: busyLiveNode is used for checking whether create replicate work, avoid

[jira] [Commented] (HDDS-2396) OM rocksdb core dump during writing

2019-11-01 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964800#comment-16964800 ] Anu Engineer commented on HDDS-2396: [~bharat] Does this stack look similar to the issuse that was

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-11-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964798#comment-16964798 ] Hadoop QA commented on HDFS-14938: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDDS-2394) Ozone allows bucket name with underscore to be created but throws an error during put key operation

2019-11-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964795#comment-16964795 ] Steve Loughran commented on HDDS-2394: -- AWS used to allow buckets with _ , but new buckets cannot be

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-11-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough

  1   2   >