[jira] [Updated] (HDFS-14524) NNTop total counts does not add up as expected

[ https://issues.apache.org/jira/browse/HDFS-14524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-14524: - Release Note: Duplicate of HDFS-15707 Resolution: Duplicate Status: Resolved

[jira] [Work logged] (HDFS-15679) DFSOutputStream close should be a no-op when called multiple times

[ https://issues.apache.org/jira/browse/HDFS-15679?focusedWorklogId=522982=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-522982 ] ASF GitHub Bot logged work on HDFS-15679: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247600#comment-17247600 ] Hadoop QA commented on HDFS-15725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15655) Add option to make balancer prefer to get cold blocks

[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247205#comment-17247205 ] Yang Yun edited comment on HDFS-15655 at 12/11/20, 1:40 AM: Thanks 

[jira] [Resolved] (HDFS-15711) Add Metrics to HttpFS Server

[ https://issues.apache.org/jira/browse/HDFS-15711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15711. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247539#comment-17247539 ] Hadoop QA commented on HDFS-15725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-15720) namenode audit async logger should add some log4j config

[ https://issues.apache.org/jira/browse/HDFS-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15720. Fix Version/s: 3.2.3 3.1.5 3.3.1 Resolution:

[jira] [Work logged] (HDFS-15720) namenode audit async logger should add some log4j config

[ https://issues.apache.org/jira/browse/HDFS-15720?focusedWorklogId=522912=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-522912 ] ASF GitHub Bot logged work on HDFS-15720: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15727) RpcQueueTimeAvgTime of the NameNode increases after it becomes StandBy

Aihua Xu created HDFS-15727: --- Summary: RpcQueueTimeAvgTime of the NameNode increases after it becomes StandBy Key: HDFS-15727 URL: https://issues.apache.org/jira/browse/HDFS-15727 Project: Hadoop HDFS

[jira] [Work logged] (HDFS-15720) namenode audit async logger should add some log4j config

[ https://issues.apache.org/jira/browse/HDFS-15720?focusedWorklogId=522901=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-522901 ] ASF GitHub Bot logged work on HDFS-15720: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247518#comment-17247518 ] Stephen O'Donnell commented on HDFS-15725: -- Uploaded v002 based on the patch [~kihwal] uploaded.

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Attachment: HDFS-15725.002.patch > Lease Recovery never completes for a committed block

[jira] [Comment Edited] (HDFS-13965) hadoop.security.kerberos.ticket.cache.path setting is not honored when KMS encryption is enabled.

[ https://issues.apache.org/jira/browse/HDFS-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247381#comment-17247381 ] István Fajth edited comment on HDFS-13965 at 12/10/20, 9:16 PM: Ok, so to

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247501#comment-17247501 ] Stephen O'Donnell commented on HDFS-15725: -- Yes, it is probably the shutdown hook that is

[jira] [Resolved] (HDFS-5912) TestDistributedFileSystem#testGetFileBlockStorageLocationsBatching fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-5912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein resolved HDFS-5912. - Release Note: test does not exist anymore. Resolution: Cannot Reproduce >

[jira] [Assigned] (HDFS-15726) Client should only complete a file if the last block is finalized

[ https://issues.apache.org/jira/browse/HDFS-15726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-15726: - Assignee: Ahmed Hussein > Client should only complete a file if the last block is finalized >

[jira] [Created] (HDFS-15726) Client should only complete a file if the last block is finalized

Kihwal Lee created HDFS-15726: - Summary: Client should only complete a file if the last block is finalized Key: HDFS-15726 URL: https://issues.apache.org/jira/browse/HDFS-15726 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

[ https://issues.apache.org/jira/browse/HDFS-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247485#comment-17247485 ] Íñigo Goiri commented on HDFS-15723: Can we add a test to avoid future regressions? > RBF:

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247478#comment-17247478 ] Kihwal Lee commented on HDFS-15725: --- We have seen certain version of clients closing without completely

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247464#comment-17247464 ] Stephen O'Donnell commented on HDFS-15725: -- [~kihwal] Thanks for this. I will have a look at the

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247461#comment-17247461 ] Hadoop QA commented on HDFS-15725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247455#comment-17247455 ] Kihwal Lee edited comment on HDFS-15725 at 12/10/20, 7:43 PM: -- We have seen

[jira] [Comment Edited] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247455#comment-17247455 ] Kihwal Lee edited comment on HDFS-15725 at 12/10/20, 7:42 PM: -- We have seen

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247455#comment-17247455 ] Kihwal Lee commented on HDFS-15725: --- We have seen this more with later versions of clients. The

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15725: -- Attachment: lease_recovery_2_10.patch > Lease Recovery never completes for a committed block which the

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247448#comment-17247448 ] Stephen O'Donnell commented on HDFS-15725: -- [~szetszwo] Could you have a look at this if you

[jira] [Commented] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247447#comment-17247447 ] Arpit Agarwal commented on HDFS-15725: -- [~szetszwo], can you take a look at this patch? > Lease

[jira] [Work logged] (HDFS-15711) Add Metrics to HttpFS Server

[ https://issues.apache.org/jira/browse/HDFS-15711?focusedWorklogId=522857=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-522857 ] ASF GitHub Bot logged work on HDFS-15711: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15711) Add Metrics to HttpFS Server

[ https://issues.apache.org/jira/browse/HDFS-15711?focusedWorklogId=522853=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-522853 ] ASF GitHub Bot logged work on HDFS-15711: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Status: Patch Available (was: Open) > Lease Recovery never completes for a committed

[jira] [Updated] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

[ https://issues.apache.org/jira/browse/HDFS-15725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15725: - Attachment: HDFS-15725.001.patch > Lease Recovery never completes for a committed block

[jira] [Created] (HDFS-15725) Lease Recovery never completes for a committed block which the DNs never finalize

Stephen O'Donnell created HDFS-15725: Summary: Lease Recovery never completes for a committed block which the DNs never finalize Key: HDFS-15725 URL: https://issues.apache.org/jira/browse/HDFS-15725

[jira] [Work logged] (HDFS-15711) Add Metrics to HttpFS Server

[ https://issues.apache.org/jira/browse/HDFS-15711?focusedWorklogId=522818=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-522818 ] ASF GitHub Bot logged work on HDFS-15711: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15717) Improve fsck logging

[ https://issues.apache.org/jira/browse/HDFS-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247384#comment-17247384 ] Jim Brennan commented on HDFS-15717: It should be noted that this also adds a superuser check for the

[jira] [Created] (HDFS-15724) Hive should use DFSClient#isHDFSEncryptionEnabled

Xiaoyu Yao created HDFS-15724: - Summary: Hive should use DFSClient#isHDFSEncryptionEnabled Key: HDFS-15724 URL: https://issues.apache.org/jira/browse/HDFS-15724 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13965) hadoop.security.kerberos.ticket.cache.path setting is not honored when KMS encryption is enabled.

[ https://issues.apache.org/jira/browse/HDFS-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247381#comment-17247381 ] István Fajth commented on HDFS-13965: - Ok, so to refine my understanding: There is an application

[jira] [Commented] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

[ https://issues.apache.org/jira/browse/HDFS-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247316#comment-17247316 ] Hadoop QA commented on HDFS-15723: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

[ https://issues.apache.org/jira/browse/HDFS-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15723: --- Description: My colleague report that the following code segment has wrong parameter passed when

[jira] [Updated] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

[ https://issues.apache.org/jira/browse/HDFS-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15723: --- Attachment: HDFS-15723.001.patch Assignee: Xiaoqiao He Status: Patch Available (was:

[jira] [Created] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

Xiaoqiao He created HDFS-15723: -- Summary: RBF: invokeConcurrent may run unexpected when enable standby read Key: HDFS-15723 URL: https://issues.apache.org/jira/browse/HDFS-15723 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15722) Gather storage report for each volume in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-15722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247237#comment-17247237 ] Hadoop QA commented on HDFS-15722: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15567) [SBN Read] HDFS should expose msync() API to allow downstream applications call it explicitly.

[ https://issues.apache.org/jira/browse/HDFS-15567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247217#comment-17247217 ] Steve Loughran commented on HDFS-15567: --- Hey, just noticed this Can we not have broad changes to

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247205#comment-17247205 ] Yang Yun commented on HDFS-15655: - Thanks [~ayushtkn] fot your review. Sorry for the late reply. I

[jira] [Comment Edited] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247202#comment-17247202 ] Hemanth Boyina edited comment on HDFS-13314 at 12/10/20, 12:13 PM: ---

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247202#comment-17247202 ] Hemanth Boyina commented on HDFS-13314: --- thanks for the discussions here {quote}*bq. WithCount

[jira] [Issue Comment Deleted] (HDFS-15655) Add option to make balancer prefer to get cold blocks

[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15655: Comment: was deleted (was: Thanks [~ayushtkn] for the reivew. ) > Add option to make balancer prefer to

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247201#comment-17247201 ] Yang Yun commented on HDFS-15655: - Thanks [~ayushtkn] for the reivew.  > Add option to make balancer

[jira] [Updated] (HDFS-15722) Gather storage report for each volume in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-15722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15722: Attachment: HDFS-15722.001.patch Status: Patch Available (was: Open) > Gather storage report for

[jira] [Updated] (HDFS-15722) Gather storage report for each volume in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-15722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15722: Status: Open (was: Patch Available) > Gather storage report for each volume in a separate thread >

[jira] [Updated] (HDFS-15722) Gather storage report for each volume in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-15722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15722: Attachment: (was: HDFS-15722.001.patch) > Gather storage report for each volume in a separate thread

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247113#comment-17247113 ] Yuxuan Wang commented on HDFS-15383: [~fengnanli] Thx for your reply. Very clear explanation. > RBF:

[jira] [Commented] (HDFS-15722) Gather storage report for each volume in a separate thread

[ https://issues.apache.org/jira/browse/HDFS-15722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247095#comment-17247095 ] Hadoop QA commented on HDFS-15722: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14558) RBF: Isolation/Fairness documentation

[ https://issues.apache.org/jira/browse/HDFS-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247081#comment-17247081 ] Hadoop QA commented on HDFS-14558: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||