[jira] [Commented] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101391#comment-17101391 ] Hadoop QA commented on HDFS-15340: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Assigned] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15340: -- Assignee: Jinglun > RBF: Balance data across federation namespaces with DistCp and snapshot diff > /

[jira] [Updated] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15340: --- Attachment: HDFS-15340.001.patch Status: Patch Available (was: Open) > RBF: Balance data across

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Description: This jira introduces a new balance command 'fedbalance' that is ran by the administrator. The

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Description: This jira introduces a new balance command 'fedbalance' that is ran by the administrator. The

[jira] [Created] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

Jinglun created HDFS-15340: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler) Key: HDFS-15340 URL:

[jira] [Commented] (HDFS-15250) Setting `dfs.client.use.datanode.hostname` to true can crash the system because of unhandled UnresolvedAddressException

[ https://issues.apache.org/jira/browse/HDFS-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101354#comment-17101354 ] Hadoop QA commented on HDFS-15250: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101318#comment-17101318 ] Jinglun edited comment on HDFS-15294 at 5/7/20, 3:54 AM: - Hi [~elgoiri], thanks

[jira] [Commented] (HDFS-15339) TestHDFSCLI fails for user names with the dot/dash character

[ https://issues.apache.org/jira/browse/HDFS-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101332#comment-17101332 ] Yan Xiaole commented on HDFS-15339: --- Posted a patch > TestHDFSCLI fails for user names with the

[jira] [Updated] (HDFS-15339) TestHDFSCLI fails for user names with the dot/dash character

[ https://issues.apache.org/jira/browse/HDFS-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Xiaole updated HDFS-15339: -- Attachment: HDFS-15339.001.patch > TestHDFSCLI fails for user names with the dot/dash character >

[jira] [Created] (HDFS-15339) TestHDFSCLI fails for user names with the dot/dash character

Yan Xiaole created HDFS-15339: - Summary: TestHDFSCLI fails for user names with the dot/dash character Key: HDFS-15339 URL: https://issues.apache.org/jira/browse/HDFS-15339 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15250) Setting `dfs.client.use.datanode.hostname` to true can crash the system because of unhandled UnresolvedAddressException

[ https://issues.apache.org/jira/browse/HDFS-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15250: - Attachment: HDFS-15250-001.patch Status: Patch Available (was: Open) > Setting

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101318#comment-17101318 ] Jinglun commented on HDFS-15294: Hi [~elgoiri], thanks your comments ! I can split this into 2 patches:

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101316#comment-17101316 ] bright.zhou commented on HDFS-14999: [~weichiu] Encountered this problem on our cluster and used this

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101307#comment-17101307 ] Akira Ajisaka commented on HDFS-15293: -- Thank you [~shv] and [~vagarychen]. The change looks

[jira] [Updated] (HDFS-15296) TestBPOfferService::testMissBlocksWhenReregister is flaky

[ https://issues.apache.org/jira/browse/HDFS-15296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15296: - Issue Type: Bug (was: Improvement) > TestBPOfferService::testMissBlocksWhenReregister is flaky

[jira] [Updated] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright.zhou updated HDFS-14999: --- Attachment: (was: infinitLoop3.patch) > Avoid Potential Infinite Loop in DFSNetworkTopology >

[jira] [Updated] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright.zhou updated HDFS-14999: --- Attachment: infinitLoop3.patch > Avoid Potential Infinite Loop in DFSNetworkTopology >

[jira] [Updated] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright.zhou updated HDFS-14999: --- Attachment: (was: InfiniteLoop.patch) > Avoid Potential Infinite Loop in DFSNetworkTopology >

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101292#comment-17101292 ] Hadoop QA commented on HDFS-15255: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101256#comment-17101256 ] Hadoop QA commented on HDFS-15293: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15305) Extend ViewFS and provide ViewFSOverloadScheme implementation with scheme configurable.

[ https://issues.apache.org/jira/browse/HDFS-15305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-15305: -- Fix Version/s: 3.4.0 3.3.1 > Extend ViewFS and provide

[jira] [Updated] (HDFS-15323) StandbyNode fails transition to active due to insufficient transaction tailing

[ https://issues.apache.org/jira/browse/HDFS-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15323: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was:

[jira] [Updated] (HDFS-15323) StandbyNode fails transition to active due to insufficient transaction tailing

[ https://issues.apache.org/jira/browse/HDFS-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15323: --- Fix Version/s: 3.1.5 > StandbyNode fails transition to active due to insufficient

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101185#comment-17101185 ] Íñigo Goiri commented on HDFS-15082: I would personally add a separate config key. It's is a little

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101181#comment-17101181 ] Íñigo Goiri commented on HDFS-15294: Thanks [~LiJinglun] for adding the documentation. In general,

[jira] [Commented] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101165#comment-17101165 ] Hudson commented on HDFS-15332: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18223 (See

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101157#comment-17101157 ] Íñigo Goiri commented on HDFS-12288: The patch itself looks good to me. I'm not sure if we are still

[jira] [Commented] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101147#comment-17101147 ] Íñigo Goiri commented on HDFS-15332: Thanks [~hemanthboyina] for the patch. Committed to trunk. >

[jira] [Updated] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15332: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15332) Quota Space consumed was wrong in truncate with Snapshots

[ https://issues.apache.org/jira/browse/HDFS-15332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101146#comment-17101146 ] Íñigo Goiri commented on HDFS-15332: +1 on [^HDFS-15332.001.patch]. > Quota Space consumed was

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15293: -- Status: Patch Available (was: Open) > Relax the condition for accepting a fsimage when receiving a

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101136#comment-17101136 ] Chen Liang commented on HDFS-15293: --- Had some offline discussion with [~shv], the txnid check does not

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15293: -- Attachment: HDFS-15293.001.patch > Relax the condition for accepting a fsimage when receiving a

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101109#comment-17101109 ] Wei-Chiu Chuang commented on HDFS-14999: [~zgw] i saw you posted a patch. Is that the fix for

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101105#comment-17101105 ] Hadoop QA commented on HDFS-15255: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100999#comment-17100999 ] Hadoop QA commented on HDFS-15338: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100966#comment-17100966 ] Stephen O'Donnell commented on HDFS-15255: -- Upload a 009 patch with a findbugs exception added.

[jira] [Updated] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15255: - Attachment: HDFS-15255.009.patch > Consider StorageType when

[jira] [Comment Edited] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100927#comment-17100927 ] Arpit Agarwal edited comment on HDFS-8432 at 5/6/20, 4:02 PM: -- [~heliangjun]

[jira] [Commented] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100927#comment-17100927 ] Arpit Agarwal commented on HDFS-8432: - [~heliangjun] looks like some other folks worked on downgrade

[jira] [Commented] (HDFS-13904) ContentSummary does not always respect processing limit, resulting in long lock acquisitions

[ https://issues.apache.org/jira/browse/HDFS-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100870#comment-17100870 ] Erik Krogen commented on HDFS-13904: Looks like I must have confused {{getReadHoldCount()}} and

[jira] [Updated] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright.zhou updated HDFS-14999: --- Attachment: InfiniteLoop.patch > Avoid Potential Infinite Loop in DFSNetworkTopology >

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.001.patch Status: Patch Available (was: Open) > listOpenFiles() should throw

[jira] [Assigned] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15338: -- Assignee: Jinglun > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Created] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

Jinglun created HDFS-15338: -- Summary: listOpenFiles() should throw InvalidPathException to remind the admin. Key: HDFS-15338 URL: https://issues.apache.org/jira/browse/HDFS-15338 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100730#comment-17100730 ] Hudson commented on HDFS-14283: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18221 (See

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14283: Fix Version/s: 3.3.1 > DFSInputStream to prefer cached replica >

[jira] [Updated] (HDFS-14283) DFSInputStream to prefer cached replica

[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14283: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100699#comment-17100699 ] Ayush Saxena commented on HDFS-14283: - Committed to trunk. Thanx everyone for the work here!!! >

[jira] [Commented] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100626#comment-17100626 ] heliangjun commented on HDFS-8432: -- ping [~cnauroth] ,  [~arp] . We are ready to rollingupgrade our

[jira] [Created] (HDFS-15337) Support available space choosing policy in HDFS Persistent Memory Cache

Feilong He created HDFS-15337: - Summary: Support available space choosing policy in HDFS Persistent Memory Cache Key: HDFS-15337 URL: https://issues.apache.org/jira/browse/HDFS-15337 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100539#comment-17100539 ] Ayush Saxena commented on HDFS-14283: - Thanx [~leosun08] for the update. v009 LGTM +1 Will commit by