[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-01-16 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017759#comment-17017759 ] Sean Chow commented on HDFS-14476: -- Build failed:( > lock too long when fix inconsistent blocks between

[jira] [Commented] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017686#comment-17017686 ] Hadoop QA commented on HDFS-15126: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017672#comment-17017672 ] Hadoop QA commented on HDFS-15127: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017653#comment-17017653 ] Hadoop QA commented on HDFS-15124: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017650#comment-17017650 ] Íñigo Goiri commented on HDFS-15126: I went over this class and this is a little hard to debug.

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017645#comment-17017645 ] Hadoop QA commented on HDFS-15118: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15128) Unit test failing to clean testing data and crashed future Maven test run

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15128: - Summary: Unit test failing to clean testing data and crashed future Maven test run (was: Unit test failing to

[jira] [Updated] (HDFS-15128) Unit test failing to clean testing data and crashed subsequent Maven test run

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15128: - Summary: Unit test failing to clean testing data and crashed subsequent Maven test run (was: Unit test failing

[jira] [Updated] (HDFS-15128) Unit test failing to clean testing data and caused Maven to crash

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15128: - Description: Actively-used test helper function `testVolumeConfig` in

[jira] [Updated] (HDFS-15128) Unit test failing to clean testing data and caused Maven to crash

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15128: - Description: Actively-used test helper function `testVolumeConfig` in

[jira] [Updated] (HDFS-15128) Unit test failing to clean testing data and caused Maven to crash

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15128: - Description: *Description:* Actively-used test helper function `testVolumeConfig` in

[jira] [Updated] (HDFS-15128) Unit test failing to clean testing data and caused Maven to crash

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15128: - Attachment: HDFS-15128-000.patch Tags: (was: test) > Unit test failing to clean testing data and

[jira] [Updated] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15127: --- Status: Patch Available (was: Open) > RBF: Do not allow writes when a subcluster is unavailable for

[jira] [Created] (HDFS-15128) Unit test failing to clean testing data and caused Maven to crash

2020-01-16 Thread Ctest (Jira)
Ctest created HDFS-15128: Summary: Unit test failing to clean testing data and caused Maven to crash Key: HDFS-15128 URL: https://issues.apache.org/jira/browse/HDFS-15128 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2020-01-16 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017634#comment-17017634 ] Konstantin Shvachko commented on HDFS-12943: Hey [~lindy_hopper] yes we currently recommend

[jira] [Updated] (HDFS-15111) start / stopStandbyServices() should log which service it is transitioning to/from.

2020-01-16 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15111: --- Labels: newbie++ (was: ) > start / stopStandbyServices() should log which service

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017619#comment-17017619 ] Ctest commented on HDFS-15124: -- Uploaded one new patch for trunk. > Crashing bugs in NameNode when using a

[jira] [Updated] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15126: - Attachment: HDFS-15126.001.patch > testForcedRegistration fails Intermittently >

[jira] [Updated] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15126: - Status: Patch Available (was: Open) > testForcedRegistration fails Intermittently >

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: HDFS-15124.002.patch > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Commented] (HDFS-15125) Pull back fixes for DataNodeVolume* unit tests

2020-01-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017550#comment-17017550 ] Hadoop QA commented on HDFS-15125: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-16 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15118: -- Status: Patch Available (was: Open) > [SBN Read] Slow clients when Observer reads are enabled but

[jira] [Updated] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-16 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15118: -- Attachment: HDFS-15118.001.patch > [SBN Read] Slow clients when Observer reads are enabled but there

[jira] [Assigned] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

2020-01-16 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-15118: - Assignee: Chen Liang > [SBN Read] Slow clients when Observer reads are enabled but there are no

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017471#comment-17017471 ] Hadoop QA commented on HDFS-15124: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15125) Pull back fixes for DataNodeVolume* unit tests

2020-01-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017464#comment-17017464 ] Jim Brennan commented on HDFS-15125: There was a problem with my back-port of HDFS-13945, so

[jira] [Updated] (HDFS-15125) Pull back fixes for DataNodeVolume* unit tests

2020-01-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15125: --- Attachment: HDFS-15125-branch-2.10.002.patch > Pull back fixes for DataNodeVolume* unit tests >

[jira] [Comment Edited] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017418#comment-17017418 ] Ctest edited comment on HDFS-15124 at 1/16/20 7:55 PM: --- [~elgoiri] Sorry that I was

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017418#comment-17017418 ] Ctest commented on HDFS-15124: -- I was using hadoop-2.10.0 and the FSNameSystem was using  {code:java} public

[jira] [Updated] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15127: --- Attachment: HDFS-15127.000.patch > RBF: Do not allow writes when a subcluster is unavailable for

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-16 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017409#comment-17017409 ] Hudson commented on HDFS-15112: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17873 (See

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017405#comment-17017405 ] Íñigo Goiri commented on HDFS-15112: Thanks [~ayushtkn] for the review. Committed to trunk. Opened

[jira] [Created] (HDFS-15127) RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points.

2020-01-16 Thread Jira
Íñigo Goiri created HDFS-15127: -- Summary: RBF: Do not allow writes when a subcluster is unavailable for HASH_ALL mount points. Key: HDFS-15127 URL: https://issues.apache.org/jira/browse/HDFS-15127

[jira] [Updated] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15112: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15112) RBF: Do not return FileNotFoundException when a subcluster is unavailable

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017401#comment-17017401 ] Íñigo Goiri commented on HDFS-15112: Correct, the change in RouterRPCServer is only there to make the

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017346#comment-17017346 ] Íñigo Goiri commented on HDFS-15124: FSNameSystem seems to be using logger, right?

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-16 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017339#comment-17017339 ] Íñigo Goiri commented on HDFS-15113: I think we need to extend [^HDFS-15113.003.patch] to cover the

[jira] [Commented] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017329#comment-17017329 ] Ctest commented on HDFS-15124: -- I uploaded a new patch to do all these changes. [~elgoiri] I am sorry I

[jira] [Updated] (HDFS-15124) Crashing bugs in NameNode when using a valid configuration for `dfs.namenode.audit.loggers`

2020-01-16 Thread Ctest (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ctest updated HDFS-15124: - Attachment: HDFS-15124.001.patch > Crashing bugs in NameNode when using a valid configuration for >

[jira] [Created] (HDFS-15126) testForcedRegistration fails Intermittently

2020-01-16 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HDFS-15126: Summary: testForcedRegistration fails Intermittently Key: HDFS-15126 URL: https://issues.apache.org/jira/browse/HDFS-15126 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15125) Pull back fixes for DataNodeVolume* unit tests

2020-01-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016994#comment-17016994 ] Jim Brennan commented on HDFS-15125: The unit tests are unrelated, but I am still seeing one of the

[jira] [Commented] (HDFS-14757) TestBalancerRPCDelay.testBalancerRPCDelay failed

2020-01-16 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016985#comment-17016985 ] Ahmed Hussein commented on HDFS-14757: -- The Failed junit tests were failing Intermittently on the

[jira] [Commented] (HDFS-15087) RBF: Balance/Rename across federation namespaces

2020-01-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016871#comment-17016871 ] Jinglun commented on HDFS-15087: Hi everyone, any further comments? Please let me know your thoughts,

[jira] [Comment Edited] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016695#comment-17016695 ] Jinglun edited comment on HDFS-15120 at 1/16/20 12:31 PM: -- Hi [~ayushtkn],

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016854#comment-17016854 ] Hadoop QA commented on HDFS-15120: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016851#comment-17016851 ] Xiaoqiao He commented on HDFS-15113: [~elgoiri],[~weichiu],[~brahmareddy], any bandwidth to push this

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016844#comment-17016844 ] Xiaoqiao He commented on HDFS-15115: [~wzx513], would you like to check all same cases in

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016843#comment-17016843 ] Xiaoqiao He commented on HDFS-14672: [~Tao Yang], [^HDFS-14672.branch-2.8.001.patch] try to offer

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14672: --- Attachment: HDFS-14672.branch-2.8.001.patch > Backport HDFS-12703 to branch-2 >

[jira] [Comment Edited] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016695#comment-17016695 ] Jinglun edited comment on HDFS-15120 at 1/16/20 8:38 AM: - Hi [~ayushtkn], thanks

[jira] [Updated] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15120: --- Attachment: HDFS-15120.002.patch > Refresh BlockPlacementPolicy at runtime. >

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016695#comment-17016695 ] Jinglun commented on HDFS-15120: Hi [~ayushtkn], thanks your comment ! I found the