[jira] [Updated] (HDFS-15044) [Dynamometer] Show the line of audit log when parsing it unsuccessfully

2019-12-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15044: Status: Patch Available (was: Open) > [Dynamometer] Show the line of audit log when

[jira] [Created] (HDFS-15044) [Dynamometer] Show the line of audit log when parsing it unsuccessfully

2019-12-09 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-15044: --- Summary: [Dynamometer] Show the line of audit log when parsing it unsuccessfully Key: HDFS-15044 URL: https://issues.apache.org/jira/browse/HDFS-15044 Project:

[jira] [Commented] (HDFS-14953) [Dynamometer] Missing blocks gradually increase after NN starts

2019-12-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992267#comment-16992267 ] Takanobu Asanuma commented on HDFS-14953: - Sorry for late response. Actually, I ported your PR

[jira] [Commented] (HDFS-15040) RBF: Secured Router should not run when SecretManager is not running

2019-12-09 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992263#comment-16992263 ] Hudson commented on HDFS-15040: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17746 (See

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992261#comment-16992261 ] zhuqi commented on HDFS-15041: -- Thanks for [~hexiaoqiao]  to help to cc [~weichiu]. Now i am the Hadoop

[jira] [Commented] (HDFS-15043) RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl

2019-12-09 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992257#comment-16992257 ] Hudson commented on HDFS-15043: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17745 (See

[jira] [Updated] (HDFS-15040) RBF: Secured Router should not run when SecretManager is not running

2019-12-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15040: Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-14983) RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option

2019-12-09 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992259#comment-16992259 ] Xieming Li commented on HDFS-14983: --- [~inigoiri], Thank you for your review. I have fixed that

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992256#comment-16992256 ] Xiaoqiao He commented on HDFS-15041: Thanks [~zhuqi] for your quick response, It makes sense to me

[jira] [Updated] (HDFS-14983) RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option

2019-12-09 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14983: -- Attachment: HDFS-14983.004.patch Status: Patch Available (was: Open) > RBF: Add

[jira] [Updated] (HDFS-14983) RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option

2019-12-09 Thread Xieming Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-14983: -- Status: Open (was: Patch Available) > RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration

[jira] [Updated] (HDFS-15043) RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl

2019-12-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15043: - Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992240#comment-16992240 ] zhuqi commented on HDFS-15041: -- Hi [~hexiaoqiao]  Our one cluster with too many deleted operations and

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

2019-12-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992225#comment-16992225 ] Xiaoqiao He commented on HDFS-14997: Thanks [~elgoiri] for your comments. Actually I have deployed

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992223#comment-16992223 ] Xiaoqiao He commented on HDFS-15041: Thanks [~weichiu] for your invite. In my experience, 4 ms by

[jira] [Comment Edited] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992124#comment-16992124 ] zhuqi edited comment on HDFS-15041 at 12/10/19 5:48 AM: Hi [~weichiu] Yeah, i

[jira] [Updated] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated HDFS-15041: - Attachment: HDFS-15041.001.patch Status: Patch Available (was: Open) > Make MAX_LOCK_HOLD_MS and full

[jira] [Updated] (HDFS-15043) RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl

2019-12-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15043: - Assignee: Akira Ajisaka Status: Patch Available (was: Open) > RBF: The detail of the

[jira] [Updated] (HDFS-15043) RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl

2019-12-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15043: - Target Version/s: 3.3.0 > RBF: The detail of the Exception is not shown in >

[jira] [Updated] (HDFS-15043) RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl

2019-12-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15043: - Description: In the constructor of ZKDTSMImpl, when IOException occurs in super.startThreads(),

[jira] [Updated] (HDFS-15043) RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl

2019-12-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15043: - Summary: RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl

[jira] [Created] (HDFS-15043) RBF: The detail of the Exception is not logged in ZKDelegationTokenSecretManagerImpl

2019-12-09 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HDFS-15043: Summary: RBF: The detail of the Exception is not logged in ZKDelegationTokenSecretManagerImpl Key: HDFS-15043 URL: https://issues.apache.org/jira/browse/HDFS-15043

[jira] [Commented] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992155#comment-16992155 ] Hadoop QA commented on HDFS-15036: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992138#comment-16992138 ] Konstantin Shvachko commented on HDFS-15036: Good investigation and findings [~vagarychen]. #

[jira] [Comment Edited] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992124#comment-16992124 ] zhuqi edited comment on HDFS-15041 at 12/10/19 2:45 AM: Hi [~weichiu] Yeah, i

[jira] [Comment Edited] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992124#comment-16992124 ] zhuqi edited comment on HDFS-15041 at 12/10/19 2:26 AM: Hi [~weichiu] Yeah, i

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992124#comment-16992124 ] zhuqi commented on HDFS-15041: -- Hi [~weichiu] Yeah, i mean to make MAX_LOCK_HOLD_MS configurable after your

[jira] [Updated] (HDFS-14522) Allow compact property description in xml in httpfs

2019-12-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-14522: - Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-14522) Allow compact property description in xml in httpfs

2019-12-09 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992105#comment-16992105 ] Hudson commented on HDFS-14522: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17744 (See

[jira] [Updated] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15036: -- Target Version/s: 3.3.0, 2.10.1 (was: 2.10.1) Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15036: -- Attachment: HDFS-15036.001.patch > Active NameNode should not silently fail the image transfer >

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992069#comment-16992069 ] Konstantin Shvachko commented on HDFS-15032: Hey Erik, I see what you mean now. But it looks

[jira] [Assigned] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-15036: - Assignee: Chen Liang (was: Chao Sun) > Active NameNode should not silently fail the image

[jira] [Commented] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992029#comment-16992029 ] Chen Liang commented on HDFS-15036: --- [~csun] np, sure, thanks for asking :) . Assigning to myself then.

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-12-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992025#comment-16992025 ] Stephen O'Donnell commented on HDFS-14852: -- Looking at the original code, in

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2019-12-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992023#comment-16992023 ] Íñigo Goiri commented on HDFS-6874: --- {quote} I think we need to implement getblocklocations in httpfs

[jira] [Commented] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992018#comment-16992018 ] Chao Sun commented on HDFS-15036: - [~vagarychen] sorry for grabbing this JIRA too soon :) Since you have

[jira] [Comment Edited] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991998#comment-16991998 ] Chen Liang edited comment on HDFS-15036 at 12/9/19 10:36 PM: - Spent some time

[jira] [Commented] (HDFS-15036) Active NameNode should not silently fail the image transfer

2019-12-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991998#comment-16991998 ] Chen Liang commented on HDFS-15036: --- Spent some time debugging this issue, I think I found the cause of

[jira] [Commented] (HDFS-14983) RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option

2019-12-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991984#comment-16991984 ] Íñigo Goiri commented on HDFS-14983: For the checkstyle warning you can break the line in

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991983#comment-16991983 ] Wei-Chiu Chuang commented on HDFS-15041: [~hexiaoqiao] does it make sense to make

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991971#comment-16991971 ] Hadoop QA commented on HDFS-15032: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14667: - Fix Version/s: (was: 2.11.0) > Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

[jira] [Updated] (HDFS-15005) Backport HDFS-12300 to branch-2

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-15005: - Fix Version/s: (was: 2.11.0) > Backport HDFS-12300 to branch-2 >

[jira] [Commented] (HDFS-15005) Backport HDFS-12300 to branch-2

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991917#comment-16991917 ] Jonathan Hung commented on HDFS-15005: -- Removing 2.11.0 fix version after branch-2 -> branch-2.10

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991911#comment-16991911 ] Jonathan Hung commented on HDFS-14986: -- Removing 2.11.0 fix version after branch-2 -> branch-2.10

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14986: - Fix Version/s: (was: 2.11.0) > ReplicaCachingGetSpaceUsed throws

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991910#comment-16991910 ] Jonathan Hung commented on HDFS-14973: -- Removing 2.11.0 fix version after branch-2 -> branch-2.10

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14973: - Fix Version/s: (was: 2.11.0) > Balancer getBlocks RPC dispersal does not function properly >

[jira] [Commented] (HDFS-14952) Skip safemode if blockTotal is 0 in new NN

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991904#comment-16991904 ] Jonathan Hung commented on HDFS-14952: -- Renaming 2.11.0 fix version to 2.10.1 after branch-2 ->

[jira] [Updated] (HDFS-14952) Skip safemode if blockTotal is 0 in new NN

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14952: - Fix Version/s: (was: 2.11.0) 2.10.1 > Skip safemode if blockTotal is 0 in

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991896#comment-16991896 ] Jonathan Hung commented on HDFS-14884: -- Removing 2.11.0 fix version after branch-2 -> branch-2.10

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14884: - Fix Version/s: (was: 2.11.0) > Add sanity check that zone key equals feinfo key while

[jira] [Commented] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991899#comment-16991899 ] Jonathan Hung commented on HDFS-14979: -- Removing 2.11.0 fix version after branch-2 -> branch-2.10

[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14979: - Fix Version/s: (was: 2.11.0) > [Observer Node] Balancer should submit getBlocks to Observer

[jira] [Commented] (HDFS-14590) [SBN Read] Add the document link to the top page

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991890#comment-16991890 ] Jonathan Hung commented on HDFS-14590: -- Removing 2.11.0 fix version after branch-2 -> branch-2.10

[jira] [Commented] (HDFS-14958) TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991891#comment-16991891 ] Jonathan Hung commented on HDFS-14958: -- Removing 2.11.0 fix version after branch-2 -> branch-2.10

[jira] [Updated] (HDFS-14958) TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14958: - Fix Version/s: (was: 2.11.0) > TestBalancerWithNodeGroup is not using

[jira] [Updated] (HDFS-14590) [SBN Read] Add the document link to the top page

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14590: - Fix Version/s: (was: 2.11.0) > [SBN Read] Add the document link to the top page >

[jira] [Updated] (HDFS-15042) Add more tests for ByteBufferPositionedReadable

2019-12-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-15042: -- Summary: Add more tests for ByteBufferPositionedReadable (was: add more tests for

[jira] [Issue Comment Deleted] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991822#comment-16991822 ] Erik Krogen commented on HDFS-15032: It looks like Yetus was trying to pick up the image as a patch:

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.004.patch > Balancer crashes when it fails to contact an unavailable NN via

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991812#comment-16991812 ] Hadoop QA commented on HDFS-15032: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991806#comment-16991806 ] Erik Krogen commented on HDFS-15032: Hey [~shv], that's a great question. In many cases, only a

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991801#comment-16991801 ] Hadoop QA commented on HDFS-15032: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: debugger_with_tostring.png > Balancer crashes when it fails to contact an unavailable NN

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: debugger_without_tostring.png > Balancer crashes when it fails to contact an unavailable

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.003.patch > Balancer crashes when it fails to contact an unavailable NN via

[jira] [Created] (HDFS-15042) add more tests for ByteBufferPositionedReadable

2019-12-09 Thread Steve Loughran (Jira)
Steve Loughran created HDFS-15042: - Summary: add more tests for ByteBufferPositionedReadable Key: HDFS-15042 URL: https://issues.apache.org/jira/browse/HDFS-15042 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991755#comment-16991755 ] Wei-Chiu Chuang commented on HDFS-15041: I believe the HDFS-14553 does the latter for you. >

[jira] [Commented] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991729#comment-16991729 ] zhuqi commented on HDFS-15041: -- cc [~daryn]  ,  [~weichiu] Our cluster wants to change it in order to get

[jira] [Created] (HDFS-15041) Make MAX_LOCK_HOLD_MS and full queue size configurable

2019-12-09 Thread zhuqi (Jira)
zhuqi created HDFS-15041: Summary: Make MAX_LOCK_HOLD_MS and full queue size configurable Key: HDFS-15041 URL: https://issues.apache.org/jira/browse/HDFS-15041 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-09 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991695#comment-16991695 ] Tsz-wo Sze commented on HDFS-15012: --- +1 the 000 patch looks good. > NN fails to parse Edit logs after