[jira] [Issue Comment Deleted] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15294: - Comment: was deleted (was: Hi [~ayushtkn], could you have time to review the latest patch to see if it

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109305#comment-17109305 ] Yiqun Lin commented on HDFS-15340: -- Hi [~ayushtkn], could you have time to review the latest patch to

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109304#comment-17109304 ] Yiqun Lin commented on HDFS-15294: -- Hi [~ayushtkn], could you have time to review the latest patch to

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109303#comment-17109303 ] Hadoop QA commented on HDFS-15207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15264) Backport Datanode detection to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109298#comment-17109298 ] Yiqun Lin edited comment on HDFS-15264 at 5/17/20, 4:06 AM: I prefer to only

[jira] [Updated] (HDFS-15264) Backport Datanode detection to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15264: - Fix Version/s: 2.10.1 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15264) Backport Datanode detection to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15264: - Summary: Backport Datanode detection to branch-2.10 (was: Backport HDFS-13571, HDFS-15149 to

[jira] [Updated] (HDFS-15264) Backport HDFS-13571, HDFS-15149 to branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15264: - Summary: Backport HDFS-13571, HDFS-15149 to branch-2.10 (was: Backport HDFS-13571,HDFS-15149 to

[jira] [Commented] (HDFS-15264) Backport HDFS-13571,HDFS-15149 to branch-3.1, branch-2.10

[ https://issues.apache.org/jira/browse/HDFS-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109298#comment-17109298 ] Yiqun Lin commented on HDFS-15264: -- I prefer to only backport this to branch-2.10 since we already have

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109264#comment-17109264 ] Hadoop QA commented on HDFS-15359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15207: Attachment: HDFS-15207.008.patch Status: Patch Available (was: Open) > VolumeScanner skip to scan

[jira] [Updated] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15207: Status: Open (was: Patch Available) > VolumeScanner skip to scan blocks accessed during recent scan

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109235#comment-17109235 ] Hudson commented on HDFS-15358: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #18262 (See

[jira] [Updated] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15358: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109231#comment-17109231 ] Ayush Saxena commented on HDFS-15358: - Committed to trunk. Thanx [~elgoiri] for the review!!! > RBF:

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109230#comment-17109230 ] Ayush Saxena commented on HDFS-14999: - Thanx [~vinayakumarb] for the review. If no further comments

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15359: Attachment: HDFS-15359-03.patch > EC: Allow closing a file with committed blocks >

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109213#comment-17109213 ] Hadoop QA commented on HDFS-15359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109192#comment-17109192 ] Íñigo Goiri commented on HDFS-15358: Thanks [~ayushtkn] for the update. Let's go with the

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15359: Attachment: HDFS-15359-02.patch > EC: Allow closing a file with committed blocks >

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109151#comment-17109151 ] Hadoop QA commented on HDFS-15082: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109141#comment-17109141 ] Hadoop QA commented on HDFS-15355: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109135#comment-17109135 ] Hadoop QA commented on HDFS-15359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109120#comment-17109120 ] Xiaoqiao He commented on HDFS-15082: v005 try to fix checkstyle and trigger yetus again. > RBF:

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.005.patch > RBF: Check each component length of destination path when

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109115#comment-17109115 ] Hadoop QA commented on HDFS-15082: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109087#comment-17109087 ] Yang Yun commented on HDFS-15355: - Thanks [~elgoiri] and [~ayushtkn] for the suggestion. Updated to

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.006.patch Status: Patch Available (was: Open) > Make the default block

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Status: Open (was: Patch Available) > Make the default block storage policy ID configurable >

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.004.patch > RBF: Check each component length of destination path when

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109076#comment-17109076 ] Xiaoqiao He commented on HDFS-15082: Thanks [~ayushtkn] and [~elgoiri]. v004 try to set separate

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109067#comment-17109067 ] Ayush Saxena commented on HDFS-15315: - Well, I am not sure why this failed like this. Some issue with

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15359: Status: Patch Available (was: Open) > EC: Allow closing a file with committed blocks >

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15359: Attachment: HDFS-15359-01.patch > EC: Allow closing a file with committed blocks >

[jira] [Created] (HDFS-15359) EC: Allow closing a file with committed blocks

Ayush Saxena created HDFS-15359: --- Summary: EC: Allow closing a file with committed blocks Key: HDFS-15359 URL: https://issues.apache.org/jira/browse/HDFS-15359 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109066#comment-17109066 ] Ayush Saxena commented on HDFS-15288: - Jenkins warnings are unrelated. Broken since couple of days.

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109055#comment-17109055 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17109006#comment-17109006 ] Hudson commented on HDFS-15356: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #18261 (See

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15356: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108999#comment-17108999 ] Ayush Saxena commented on HDFS-15356: - Committed to trunk. Thanx [~hexiaoqiao] for the

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108997#comment-17108997 ] Ayush Saxena commented on HDFS-15355: - I guess doing that would require changes to multiple places.

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108994#comment-17108994 ] Ayush Saxena commented on HDFS-15356: - v003 LGTM +1 > Unify configuration `dfs.ha.allow.stale.reads`

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108986#comment-17108986 ] Vinayakumar B commented on HDFS-14999: -- +1 > Avoid Potential Infinite Loop in DFSNetworkTopology >

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108968#comment-17108968 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108957#comment-17108957 ] Ayush Saxena edited comment on HDFS-15358 at 5/16/20, 9:52 AM: --- Thanx

[jira] [Commented] (HDFS-11748) Deleting an open file should invalidate the block from expected locations.

[ https://issues.apache.org/jira/browse/HDFS-11748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108966#comment-17108966 ] Ayush Saxena commented on HDFS-11748: - Thanx [~shahrs87] for the report, I tried to reproduce the

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108958#comment-17108958 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108957#comment-17108957 ] Ayush Saxena commented on HDFS-15358: - Thanx [~elgoiri] for the review. Have uploaded a couple of

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108953#comment-17108953 ] Hadoop QA commented on HDFS-15358: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108945#comment-17108945 ] Hadoop QA commented on HDFS-15356: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108921#comment-17108921 ] Ayush Saxena commented on HDFS-15356: - Thanx [~hexiaoqiao] for the patch. LGTM. Will commit by EOD,

[jira] [Updated] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15358: Attachment: RBF-After-01.png RBF-After-03.png RBF-Before.png >

[jira] [Updated] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15358: Attachment: RBF-After-02.png > RBF: Unify router datanode UI with namenode datanode UI >

[jira] [Updated] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15358: Attachment: HDFS-15358-02.patch > RBF: Unify router datanode UI with namenode datanode UI >

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108899#comment-17108899 ] Hadoop QA commented on HDFS-15358: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15288: Attachment: HDFS-15288-02.patch > Add Available Space Rack Fault Tolerant BPP >

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108891#comment-17108891 ] Hadoop QA commented on HDFS-14960: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108890#comment-17108890 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108881#comment-17108881 ] Xiaoqiao He commented on HDFS-13183: Try to run failed unit test at local, both of them passed except