[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015661#comment-17015661 ] Ayush Saxena commented on HDFS-15112: - bq. So this change breaks the assumption that we can create

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015652#comment-17015652 ] Ayush Saxena commented on HDFS-15117: - Fixed one test failure, Others were not related, cc and javac

[jira] [Updated] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15117: Attachment: HDFS-15117-06.patch > EC: Add getECTopologyResultForPolicies to DistributedFileSystem

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015638#comment-17015638 ] Hadoop QA commented on HDFS-15124: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2020-01-14 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015613#comment-17015613 ] Tao Yang commented on HDFS-14672: - Thanks [~hexiaoqiao] for the reply, this patch seems not applicable to

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest edited comment on HDFS-15124 at 1/15/20 3:30 AM: --- [~elgoiri] Thank you for

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest edited comment on HDFS-15124 at 1/15/20 3:28 AM: --- [~elgoiri] This is a good

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015598#comment-17015598 ] Hadoop QA commented on HDFS-15112: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest edited comment on HDFS-15124 at 1/15/20 3:26 AM: --- [~elgoiri] This is a good

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest edited comment on HDFS-15124 at 1/15/20 3:07 AM: --- [~elgoiri] How about

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest edited comment on HDFS-15124 at 1/15/20 3:06 AM: --- [~elgoiri] How about

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest edited comment on HDFS-15124 at 1/15/20 3:02 AM: --- [~elgoiri] How about

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest edited comment on HDFS-15124 at 1/15/20 3:03 AM: --- [~elgoiri] How about

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015581#comment-17015581 ] Ctest commented on HDFS-15124: -- [~elgoiri] How about catch InstantiationException in 

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: (was: HDFS-15124.000.patch) > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: HDFS-15124.000.patch Status: Patch Available (was: Open) > Crashing bugs in NameNode when

[jira] [Updated] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15112: --- Attachment: HDFS-15112.008.patch > RBF: Do not return FileNotFoundException when a subcluster is

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015568#comment-17015568 ] Íñigo Goiri commented on HDFS-15112: I found the issue. The problem is that now when we try to create

[jira] [Updated] (HDFS-15046) Backport HDFS-7060 to branch-2.10

2020-01-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15046: --- Status: Patch Available (was: Open) > Backport HDFS-7060 to branch-2.10 >

[jira] [Updated] (HDFS-15046) Backport HDFS-7060 to branch-2.10

2020-01-14 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15046: --- Status: Open (was: Patch Available) > Backport HDFS-7060 to branch-2.10 >

[jira] [Updated] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13339: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~Jim_Brennan]!

[jira] [Updated] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13339: --- Fix Version/s: 2.10.1 2.9.3 > Volume reference can't be released and may

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015490#comment-17015490 ] Íñigo Goiri commented on HDFS-15112: It looks like this also broke testWriteWithFailedSubcluster().

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015488#comment-17015488 ] Íñigo Goiri commented on HDFS-15124: In addition to the constructor, the exception for this case is a

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15124: --- Description: I am using Hadoop-2.10.0. The configuration parameter `dfs.namenode.audit.loggers`

[jira] [Resolved] (HDFS-14126) DataNode DirectoryScanner holding global lock for too long

2020-01-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-14126. Resolution: Duplicate I believe HDFS-14476 solves the same issue and so I'll mark this as

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015478#comment-17015478 ] Ctest edited comment on HDFS-15124 at 1/14/20 11:26 PM: [~weichiu] Thank you for

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015478#comment-17015478 ] Ctest commented on HDFS-15124: -- [~weichiu] Thank you for your reply! Yes. The default value can also add 

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Description: I am using Hadoop-2.10.0. The configuration parameter `dfs.namenode.audit.loggers` allows

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: HDFS-15124.000.patch > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: patch.txt > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: (was: patch.txt) > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Updated] (HDFS-15070) Duplicated: Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Xudong Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Sun updated HDFS-15070: -- Summary: Duplicated: Crashing bugs in NameNode when using a valid configuration for

[jira] [Commented] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015471#comment-17015471 ] Hadoop QA commented on HDFS-14968: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-15070) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Xudong Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Sun resolved HDFS-15070. --- Resolution: Duplicate > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Description: I am using Hadoop-2.10.0. The configuration parameter `dfs.namenode.audit.loggers` allows

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Description: I am using Hadoop-2.10.0. The configuration parameter `dfs.namenode.audit.loggers` allows

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Description: {code:java} // code placeholder {code} I am using Hadoop-2.10.0. The configuration parameter

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015456#comment-17015456 ] Wei-Chiu Chuang commented on HDFS-15124: You shouldn't need to add TopAuditLogger to auditlogger

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015457#comment-17015457 ] Hadoop QA commented on HDFS-14476: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-14 Thread Ctest (Jira)
Ctest created HDFS-15124: Summary: Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers` Key: HDFS-15124 URL: https://issues.apache.org/jira/browse/HDFS-15124 Project:

[jira] [Commented] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015419#comment-17015419 ] Jim Brennan commented on HDFS-13339: I don't think the unit test failures are related to this change. 

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015410#comment-17015410 ] Hadoop QA commented on HDFS-14476: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-01-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-14476: > lock too long when fix inconsistent blocks between disk and in-memory >

[jira] [Updated] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-01-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14476: --- Status: Patch Available (was: Reopened) Reopen to precommit the branch-2 patch > lock too

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015389#comment-17015389 ] Hadoop QA commented on HDFS-15117: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015385#comment-17015385 ] Wei-Chiu Chuang commented on HDFS-13339: +1 > Volume reference can't be released and may lead to

[jira] [Commented] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015373#comment-17015373 ] Hadoop QA commented on HDFS-13339: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-14968: - Attachment: HDFS-14968.003.patch > Add ability to know datanode staleness >

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015356#comment-17015356 ] Hadoop QA commented on HDFS-15112: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015351#comment-17015351 ] Hadoop QA commented on HDFS-15120: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015305#comment-17015305 ] Hadoop QA commented on HDFS-14968: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015295#comment-17015295 ] Hadoop QA commented on HDFS-15112: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015294#comment-17015294 ] Hadoop QA commented on HDFS-15112: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015273#comment-17015273 ] Ahmed Hussein commented on HDFS-15119: -- Checking the failed unit test cases. It looks like

[jira] [Updated] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15119: - Attachment: HDFS-15119.002.patch > Allow expiration of cached locations in DFSInputStream >

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015265#comment-17015265 ] Hadoop QA commented on HDFS-15117: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015257#comment-17015257 ] Íñigo Goiri commented on HDFS-15112: [^HDFS-15112.007.patch] improves some of the comments. {quote}

[jira] [Commented] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015254#comment-17015254 ] Jim Brennan commented on HDFS-13339: I submitted another patch to fix the checkstyle issue.  I don't

[jira] [Updated] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-13339: --- Attachment: HDFS-13339-branch-2.10.002.patch > Volume reference can't be released and may lead to

[jira] [Updated] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15112: --- Attachment: HDFS-15112.007.patch > RBF: Do not return FileNotFoundException when a subcluster is

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015247#comment-17015247 ] Ayush Saxena commented on HDFS-15112: - Thanx [~elgoiri]  for the update, Just to confirm, do we need

[jira] [Updated] (HDFS-15123) Remove unnecessary null check in FoldedTreeSet

2020-01-14 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravuri Sushma sree updated HDFS-15123: -- Attachment: HDFS-15123.001.patch > Remove unnecessary null check in FoldedTreeSet >

[jira] [Updated] (HDFS-15123) Remove unnecessary null check in FoldedTreeSet

2020-01-14 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravuri Sushma sree updated HDFS-15123: -- Description: *if (toMoveUp.left != null)* and *if (toMoveUp.right != null)* null

[jira] [Created] (HDFS-15123) Remove unnecessary null check in FoldedTreeSet

2020-01-14 Thread Ravuri Sushma sree (Jira)
Ravuri Sushma sree created HDFS-15123: - Summary: Remove unnecessary null check in FoldedTreeSet Key: HDFS-15123 URL: https://issues.apache.org/jira/browse/HDFS-15123 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015238#comment-17015238 ] Hadoop QA commented on HDFS-13339: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2020-01-14 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015234#comment-17015234 ] Chen Liang commented on HDFS-12943: --- [~lindy_hopper] access time update is a write call so it can not

[jira] [Updated] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15112: --- Attachment: HDFS-15112.006.patch > RBF: Do not return FileNotFoundException when a subcluster is

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015229#comment-17015229 ] Íñigo Goiri commented on HDFS-15112: Thanks [~ayushtkn] for the comments. {quote} The test expects

[jira] [Updated] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15112: --- Attachment: HDFS-15112.005.patch > RBF: Do not return FileNotFoundException when a subcluster is

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015202#comment-17015202 ] Ayush Saxena commented on HDFS-15120: - We have {color:#808080}ReconfigurationProtocol. {color}Can we

[jira] [Updated] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15117: Attachment: HDFS-15117-05.patch > EC: Add getECTopologyResultForPolicies to DistributedFileSystem

[jira] [Updated] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-14968: - Attachment: HDFS-14968.002.patch Status: Patch Available (was: Open) > Add ability to

[jira] [Updated] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-14968: - Attachment: (was: HDFS-14968.002.patch) > Add ability to know datanode staleness >

[jira] [Updated] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-14968: - Attachment: HDFS-14968.002.patch > Add ability to know datanode staleness >

[jira] [Updated] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-14 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15120: --- Attachment: HDFS-15120.001.patch Status: Patch Available (was: Open) > Refresh BlockPlacementPolicy

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015176#comment-17015176 ] Hadoop QA commented on HDFS-15113: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015170#comment-17015170 ] Hadoop QA commented on HDFS-15119: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015166#comment-17015166 ] Hadoop QA commented on HDFS-15117: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-13339: --- Attachment: HDFS-13339-branch-2.10.001.patch Status: Patch Available (was: Reopened) We

[jira] [Reopened] (HDFS-13339) Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume

2020-01-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened HDFS-13339: Re-opening issue so I can put up a patch for branch-2.10. > Volume reference can't be released and

[jira] [Work stopped] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14968 stopped by Ahmed Hussein. > Add ability to know datanode staleness >

[jira] [Work stopped] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15119 stopped by Ahmed Hussein. > Allow expiration of cached locations in DFSInputStream >

[jira] [Updated] (HDFS-15122) Log all balancer related parameters at Balancer startup

2020-01-14 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth updated HDFS-15122: Description: Currently Balancer just logs the parameters it deals with. It would be good to emit

[jira] [Updated] (HDFS-15122) Log all balancer related parameters at Balancer startup

2020-01-14 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth updated HDFS-15122: Component/s: balancer & mover > Log all balancer related parameters at Balancer startup >

[jira] [Updated] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15117: Attachment: HDFS-15117-04.patch > EC: Add getECTopologyResultForPolicies to DistributedFileSystem

[jira] [Updated] (HDFS-15122) Log all balancer related parameters at Balancer startup

2020-01-14 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth updated HDFS-15122: Labels: balancer (was: ) > Log all balancer related parameters at Balancer startup >

[jira] [Assigned] (HDFS-15122) Log all balancer related parameters at Balancer startup

2020-01-14 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth reassigned HDFS-15122: --- Assignee: Istvan Fajth > Log all balancer related parameters at Balancer startup >

[jira] [Created] (HDFS-15122) Log all balancer related parameters at Balancer startup

2020-01-14 Thread Istvan Fajth (Jira)
Istvan Fajth created HDFS-15122: --- Summary: Log all balancer related parameters at Balancer startup Key: HDFS-15122 URL: https://issues.apache.org/jira/browse/HDFS-15122 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015083#comment-17015083 ] Hadoop QA commented on HDFS-15112: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15119) Allow expiration of cached locations in DFSInputStream

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15119: - Status: In Progress (was: Patch Available) > Allow expiration of cached locations in

[jira] [Updated] (HDFS-14968) Add ability to know datanode staleness

2020-01-14 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-14968: - Status: In Progress (was: Patch Available) > Add ability to know datanode staleness >

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015065#comment-17015065 ] Xiaoqiao He commented on HDFS-15113: Thanks all for your comments.

[jira] [Commented] (HDFS-10243) When using the TableMapping network topology, adding new datanoe need to restart the namenode

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015042#comment-17015042 ] Hadoop QA commented on HDFS-10243: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.003.patch > Missing IBR when NameNode restart if open processCommand async

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2020-01-14 Thread zhangkai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014996#comment-17014996 ] zhangkai commented on HDFS-12943: - When client use getBlockLocation to access the observer node, the

[jira] [Commented] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014949#comment-17014949 ] Ayush Saxena commented on HDFS-15117: - Thanx [~vinayakumarb]  for the review. Have made suggested

[jira] [Updated] (HDFS-15117) EC: Add getECTopologyResultForPolicies to DistributedFileSystem

2020-01-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15117: Attachment: HDFS-15117-03.patch > EC: Add getECTopologyResultForPolicies to DistributedFileSystem

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-01-14 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014921#comment-17014921 ] Sean Chow commented on HDFS-14476: -- Attach the patch for branch-2: HDFS-14476-branch-2.02.patch This

[jira] [Updated] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-01-14 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14476: - Attachment: HDFS-14476-branch-2.02.patch > lock too long when fix inconsistent blocks between disk and

  1   2   >