[jira] [Updated] (HDFS-14272) [SBN read] ObserverReadProxyProvider should sync with active txnID on startup

[ https://issues.apache.org/jira/browse/HDFS-14272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14272: -- Fix Version/s: 2.10.0 3.2.1 3.1.3 > [SBN read]

[jira] [Commented] (HDFS-15665) Balancer logging improvement

[ https://issues.apache.org/jira/browse/HDFS-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225636#comment-17225636 ] Chen Liang commented on HDFS-15665: --- Thanks for the clarification [~shv] , +1 to v002 patch  >

[jira] [Commented] (HDFS-15665) Balancer logging improvement

[ https://issues.apache.org/jira/browse/HDFS-15665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225011#comment-17225011 ] Chen Liang commented on HDFS-15665: --- Thanks for working on this [~shv]! v001 patch looks good to me.

[jira] [Commented] (HDFS-15567) [SBN Read] HDFS should expose msync() API to allow downstream applications call it explicetly.

[ https://issues.apache.org/jira/browse/HDFS-15567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212685#comment-17212685 ] Chen Liang commented on HDFS-15567: --- Thanks [~shv]. Makes sense, +1 on v002 patch. > [SBN Read] HDFS

[jira] [Commented] (HDFS-15567) [SBN Read] HDFS should expose msync() API to allow downstream applications call it explicetly.

[ https://issues.apache.org/jira/browse/HDFS-15567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210499#comment-17210499 ] Chen Liang commented on HDFS-15567: --- Thanks for working on this [~shv]! Some comments: 1. Currently

[jira] [Commented] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189568#comment-17189568 ] Chen Liang commented on HDFS-15545: --- Thanks [~ibuenros], I agree that HDFS-6222 looks to be about a

[jira] [Commented] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188775#comment-17188775 ] Chen Liang commented on HDFS-15545: --- Thanks for working on this [~ibuenros]! The change makes sense to

[jira] [Commented] (HDFS-15290) NPE in HttpServer during NameNode startup

[ https://issues.apache.org/jira/browse/HDFS-15290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181494#comment-17181494 ] Chen Liang commented on HDFS-15290: --- I have committed v03 patch to trunk, branch-3.x. Thanks for the

[jira] [Commented] (HDFS-15290) NPE in HttpServer during NameNode startup

[ https://issues.apache.org/jira/browse/HDFS-15290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178072#comment-17178072 ] Chen Liang commented on HDFS-15290: --- Thanks for working on this [~simbadzina]! The v002 patch seems

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Fix Version/s: 3.1.5 3.4.0 3.3.1 2.10.1

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161585#comment-17161585 ] Chen Liang commented on HDFS-15404: --- I have committed v006 patch to trunk, branch-3.3/3.2/3.1 and

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160291#comment-17160291 ] Chen Liang commented on HDFS-15404: --- Upload v006 patch to address the remaining checkstyle issues.

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.006.patch > ShellCommandFencer should expose info about source >

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159408#comment-17159408 ] Chen Liang commented on HDFS-15404: --- Thanks for taking a look [~shv]! In general, I agree that should

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.005.patch > ShellCommandFencer should expose info about source >

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148160#comment-17148160 ] Chen Liang commented on HDFS-15404: --- Upload v004 patch to fix {{TestDFSHAAdminMiniCluster}} which was

[jira] [Comment Edited] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148160#comment-17148160 ] Chen Liang edited comment on HDFS-15404 at 6/29/20, 9:53 PM: - Upload v004

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.004.patch > ShellCommandFencer should expose info about source >

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144249#comment-17144249 ] Chen Liang commented on HDFS-15404: --- Thanks for checking [~shv]! These three test might slipped through

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.003.patch > ShellCommandFencer should expose info about source >

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143504#comment-17143504 ] Chen Liang commented on HDFS-15421: --- Thanks for reporting [~kihwal] and thanks [~aajisaka] working on

[jira] [Commented] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140052#comment-17140052 ] Chen Liang commented on HDFS-15404: --- Upload v002 patch to fix the bug that caused failed tests. The bug

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.002.patch > ShellCommandFencer should expose info about source >

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Status: Patch Available (was: Open) > ShellCommandFencer should expose info about source >

[jira] [Updated] (HDFS-15404) ShellCommandFencer should expose info about source

[ https://issues.apache.org/jira/browse/HDFS-15404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15404: -- Attachment: HDFS-15404.001.patch > ShellCommandFencer should expose info about source >

[jira] [Created] (HDFS-15404) ShellCommandFencer should expose info about source

Chen Liang created HDFS-15404: - Summary: ShellCommandFencer should expose info about source Key: HDFS-15404 URL: https://issues.apache.org/jira/browse/HDFS-15404 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114247#comment-17114247 ] Chen Liang commented on HDFS-15368: --- Thanks [~hexiaoqiao]! Will look into it, but one quick question,

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113424#comment-17113424 ] Chen Liang commented on HDFS-15368: --- [~hexiaoqiao] thanks for reporting and looking into! It is

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15293: -- Fix Version/s: 3.1.5 3.3.1 2.10.1 3.2.2

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110561#comment-17110561 ] Chen Liang commented on HDFS-15293: --- I have committed to trunk, branch-3.2, branch-3.1 and branch-2.10.

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108491#comment-17108491 ] Chen Liang commented on HDFS-15293: --- Updated v002 patch to address Akira's comments. > Relax the

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15293: -- Attachment: HDFS-15293.002.patch > Relax the condition for accepting a fsimage when receiving a

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108470#comment-17108470 ] Chen Liang commented on HDFS-15293: --- Hi [~aajisaka] sorry I have been busy dealing with some internal

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15293: -- Status: Patch Available (was: Open) > Relax the condition for accepting a fsimage when receiving a

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101136#comment-17101136 ] Chen Liang commented on HDFS-15293: --- Had some offline discussion with [~shv], the txnid check does not

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15293: -- Attachment: HDFS-15293.001.patch > Relax the condition for accepting a fsimage when receiving a

[jira] [Commented] (HDFS-15323) StandbyNode fails transition to active due to insufficient transaction tailing

[ https://issues.apache.org/jira/browse/HDFS-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097821#comment-17097821 ] Chen Liang commented on HDFS-15323: --- Thanks for the finding [~shv]! This is a tricky issue. In 

[jira] [Commented] (HDFS-14647) NPE during secure namenode startup

[ https://issues.apache.org/jira/browse/HDFS-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097589#comment-17097589 ] Chen Liang commented on HDFS-14647: --- Thanks Konstantin, I have committed the branch-2 patch to

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094792#comment-17094792 ] Chen Liang commented on HDFS-15293: --- [~shv] I don't think the the issue you mentioned will actually

[jira] [Comment Edited] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094722#comment-17094722 ] Chen Liang edited comment on HDFS-15287 at 4/28/20, 5:42 PM: - Thanks for the

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094722#comment-17094722 ] Chen Liang commented on HDFS-15287: --- Thanks for the update [~kihwal]. Will follow up on HDFS-15293, the

[jira] [Commented] (HDFS-14647) NPE during secure namenode startup

[ https://issues.apache.org/jira/browse/HDFS-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093983#comment-17093983 ] Chen Liang commented on HDFS-14647: --- [~ayushtkn] [~fengnanli], thanks for working on this issue. I see

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091752#comment-17091752 ] Chen Liang commented on HDFS-15287: --- Thanks for the elaboration [~kihwal]. I did some testing in our

[jira] [Comment Edited] (HDFS-15293) Relax FSImage upload time delta check restriction

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088924#comment-17088924 ] Chen Liang edited comment on HDFS-15293 at 4/21/20, 6:09 PM: - The reason this

[jira] [Comment Edited] (HDFS-15293) Relax FSImage upload time delta check restriction

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088924#comment-17088924 ] Chen Liang edited comment on HDFS-15293 at 4/21/20, 6:08 PM: - The reason this

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088926#comment-17088926 ] Chen Liang commented on HDFS-15287: --- I filed HDFS-15293 to relax the time interval condition. But

[jira] [Commented] (HDFS-15293) Relax FSImage upload time delta check restriction

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088924#comment-17088924 ] Chen Liang commented on HDFS-15293: --- The reason this check might be too stringent is that, for example,

[jira] [Created] (HDFS-15293) Relax FSImage upload time delta check restriction

Chen Liang created HDFS-15293: - Summary: Relax FSImage upload time delta check restriction Key: HDFS-15293 URL: https://issues.apache.org/jira/browse/HDFS-15293 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088127#comment-17088127 ] Chen Liang commented on HDFS-12979: --- [~kihwal], it is disabled in minidsfscluter because there are

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088079#comment-17088079 ] Chen Liang commented on HDFS-15287: --- In case of roll back image, this check {code}

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071188#comment-17071188 ] Chen Liang commented on HDFS-15191: --- [~Steven Rand] I think this patch is already in branch-3.3. The

[jira] [Updated] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15191: -- Fix Version/s: 3.3.1 3.2.2 Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069016#comment-17069016 ] Chen Liang commented on HDFS-15191: --- [~Steven Rand] the change makes sense to me, nice catch on the

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067897#comment-17067897 ] Chen Liang commented on HDFS-15191: --- Hey [~Steven Rand], Sorry I did plan to take another look, but

[jira] [Updated] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15197: -- Status: Patch Available (was: Open) > Change ObserverRetryOnActiveException log to debug >

[jira] [Updated] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

[ https://issues.apache.org/jira/browse/HDFS-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15197: -- Attachment: HDFS-15197.001.patch > Change ObserverRetryOnActiveException log to debug >

[jira] [Created] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

Chen Liang created HDFS-15197: - Summary: Change ObserverRetryOnActiveException log to debug Key: HDFS-15197 URL: https://issues.apache.org/jira/browse/HDFS-15197 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043864#comment-17043864 ] Chen Liang edited comment on HDFS-15191 at 2/24/20 9:01 PM: There could be

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043864#comment-17043864 ] Chen Liang commented on HDFS-15191: --- There could be token compatibility issue though, if you only have

[jira] [Commented] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041290#comment-17041290 ] Chen Liang commented on HDFS-15185: --- I have tested this fix on a real cluster, the patch did get rid of

[jira] [Assigned] (HDFS-15168) ABFS driver enhancement - Translate AAD Service Principal and Security Group To Linux user and group

[ https://issues.apache.org/jira/browse/HDFS-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-15168: - Assignee: Karthik Amarnath > ABFS driver enhancement - Translate AAD Service Principal and

[jira] [Commented] (HDFS-15153) TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035573#comment-17035573 ] Chen Liang commented on HDFS-15153: --- Closing this ticket as it duplicates of HDFS-15164 >

[jira] [Resolved] (HDFS-15153) TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-15153. --- Resolution: Duplicate > TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails >

[jira] [Commented] (HDFS-15164) Fix TestDelegationTokensWithHA

[ https://issues.apache.org/jira/browse/HDFS-15164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035560#comment-17035560 ] Chen Liang commented on HDFS-15164: --- Initially based on my quick check, I thought this was due to the

[jira] [Commented] (HDFS-15086) Block scheduled counter never get decremet if the block got deleted before replication.

[ https://issues.apache.org/jira/browse/HDFS-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035548#comment-17035548 ] Chen Liang commented on HDFS-15086: --- TestDelegationTokensWithHA failing is tracked under HDFS-15153, I

[jira] [Comment Edited] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035537#comment-17035537 ] Chen Liang edited comment on HDFS-15118 at 2/12/20 5:37 PM: [~ayushtkn] I

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035537#comment-17035537 ] Chen Liang commented on HDFS-15118: --- [~ayushtkn] I already filed HDFS-15153 for fixing this test, just

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Fix Version/s: 3.3.1 2.10.1 3.2.2 3.1.4

[jira] [Commented] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030085#comment-17030085 ] Chen Liang commented on HDFS-15148: --- Thanks [~shv]! I have filed HDFS-15146 to fix the test. Will

[jira] [Created] (HDFS-15153) TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails intermittently

Chen Liang created HDFS-15153: - Summary: TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails intermittently Key: HDFS-15153 URL: https://issues.apache.org/jira/browse/HDFS-15153

[jira] [Commented] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029185#comment-17029185 ] Chen Liang commented on HDFS-15148: --- {{testObserverReadProxyProviderWithDT}} fail is unrelated and

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Attachment: HDFS-15148.004.patch > dfs.namenode.send.qop.enabled should not apply to primary NN port >

[jira] [Commented] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028536#comment-17028536 ] Chen Liang commented on HDFS-15148: --- Thanks for taking a look [~shv]! post v004 patch >

[jira] [Commented] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026282#comment-17026282 ] Chen Liang commented on HDFS-15148: --- The failed test TestMultipleNNPortQOP seems unrelated to the

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Attachment: HDFS-15148.003.patch > dfs.namenode.send.qop.enabled should not apply to primary NN port >

[jira] [Updated] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15118: -- Fix Version/s: 2.10.1 3.2.2 3.1.4 3.3.0

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026199#comment-17026199 ] Chen Liang commented on HDFS-15118: --- The failed tests are unrelated. I've committed to trunk,

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Attachment: HDFS-15148.002.patch > dfs.namenode.send.qop.enabled should not apply to primary NN port >

[jira] [Commented] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025434#comment-17025434 ] Chen Liang commented on HDFS-15148: --- {{TestBlockTokenWrappingQOP}} test fail is actually related,

[jira] [Commented] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024808#comment-17024808 ] Chen Liang commented on HDFS-15118: --- Thanks for the catch [~shv]! Updated in v02 patch > [SBN Read]

[jira] [Updated] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15118: -- Attachment: HDFS-15118.002.patch > [SBN Read] Slow clients when Observer reads are enabled but there

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Status: Patch Available (was: Open) > dfs.namenode.send.qop.enabled should not apply to primary NN

[jira] [Updated] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

[ https://issues.apache.org/jira/browse/HDFS-15148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15148: -- Attachment: HDFS-15148.001.patch > dfs.namenode.send.qop.enabled should not apply to primary NN port >

[jira] [Created] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

Chen Liang created HDFS-15148: - Summary: dfs.namenode.send.qop.enabled should not apply to primary NN port Key: HDFS-15148 URL: https://issues.apache.org/jira/browse/HDFS-15148 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15118: -- Status: Patch Available (was: Open) > [SBN Read] Slow clients when Observer reads are enabled but

[jira] [Updated] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15118: -- Attachment: HDFS-15118.001.patch > [SBN Read] Slow clients when Observer reads are enabled but there

[jira] [Assigned] (HDFS-15118) [SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster.

[ https://issues.apache.org/jira/browse/HDFS-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-15118: - Assignee: Chen Liang > [SBN Read] Slow clients when Observer reads are enabled but there are no

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015234#comment-17015234 ] Chen Liang commented on HDFS-12943: --- [~lindy_hopper] access time update is a write call so it can not

[jira] [Updated] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15099: -- Attachment: HDFS-15099-branch-2.10.003.patch > [SBN Read] getBlockLocations() should throw

[jira] [Commented] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013159#comment-17013159 ] Chen Liang commented on HDFS-15099: --- Checked with Konstantin offline, a better approach for the test

[jira] [Commented] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013146#comment-17013146 ] Chen Liang commented on HDFS-15099: --- Thanks for the great suggestions [~shv]! Post v002 patch. Only

[jira] [Updated] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15099: -- Attachment: HDFS-15099-branch-2.10.002.patch > [SBN Read] getBlockLocations() should throw

[jira] [Updated] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15099: -- Status: Patch Available (was: Open) > [SBN Read] getBlockLocations() should throw

[jira] [Updated] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15099: -- Attachment: HDFS-15099-branch-2.10.001.patch > [SBN Read] getBlockLocations() should throw

[jira] [Comment Edited] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007828#comment-17007828 ] Chen Liang edited comment on HDFS-14655 at 1/3/20 11:25 PM: Although it's a

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007828#comment-17007828 ] Chen Liang commented on HDFS-14655: --- HDFS-14934  does look like the fix. Thanks  for the pointer

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007662#comment-17007662 ] Chen Liang commented on HDFS-14655: --- [~ayushtkn] shared below, it may not help too much though, as it

[jira] [Commented] (HDFS-15036) Active NameNode should not silently fail the image transfer

[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998561#comment-16998561 ] Chen Liang commented on HDFS-15036: --- [~Jim_Brennan] I filed 

[jira] [Commented] (HDFS-15036) Active NameNode should not silently fail the image transfer

[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996000#comment-16996000 ] Chen Liang commented on HDFS-15036: --- Oops! Did not realize it's already deleted, guess I missed the

[jira] [Updated] (HDFS-15036) Active NameNode should not silently fail the image transfer

[ https://issues.apache.org/jira/browse/HDFS-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15036: -- Fix Version/s: 3.2.2 3.1.4 > Active NameNode should not silently fail the image

  1   2   3   4   5   6   7   8   9   10   >