[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935051#comment-16935051 ] He Xiaoqiao commented on HDFS-14461: {quote}In most cases I like static imports but for

[jira] [Updated] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14461: --- Attachment: HDFS-14461.005.patch > RBF: Fix intermittently failing kerberos related unit test >

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934472#comment-16934472 ] He Xiaoqiao commented on HDFS-9668: --- Hi [~zhangchen],[~jojochuang], any plan to push this feature

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934447#comment-16934447 ] He Xiaoqiao commented on HDFS-14461: [^HDFS-14461.004.patch] try to fix checkstyle. > RBF: Fix

[jira] [Updated] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14461: --- Attachment: HDFS-14461.004.patch > RBF: Fix intermittently failing kerberos related unit test >

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934432#comment-16934432 ] He Xiaoqiao commented on HDFS-14771: Thanks [~sodonnell] for your reminder. Just correct the release

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14771: --- Release Note: This change allows the inode and inode directory sections of the fsimage to be loaded

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14771: --- Release Note: This change allows the inode and inode directory sections of the fsimage to be loaded

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934239#comment-16934239 ] He Xiaoqiao commented on HDFS-14461: Thanks [~elgoiri],[~crh] for mentioning HDFS-14609, it is more

[jira] [Updated] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14461: --- Attachment: HDFS-14461.003.patch > RBF: Fix intermittently failing kerberos related unit test >

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932350#comment-16932350 ] He Xiaoqiao commented on HDFS-14771: Thanks [~jojochuang] and sorry for late response. {quote}Once

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932246#comment-16932246 ] He Xiaoqiao commented on HDFS-14437: [~daryn],[~jojochuang],[~linyiqun],[~xkrogen],[~elgoiri], are

[jira] [Commented] (HDFS-14461) RBF: Fix intermittently failing kerberos related unit test

[ https://issues.apache.org/jira/browse/HDFS-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932220#comment-16932220 ] He Xiaoqiao commented on HDFS-14461: very sorry that I missed this ticket for a while.

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932217#comment-16932217 ] He Xiaoqiao commented on HDFS-14836: +1(non-binding) for [^HDFS-14836-trunk-001.patch] from my side.

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926629#comment-16926629 ] He Xiaoqiao commented on HDFS-10943: Thanks [~swingcong] for your pings, It is important observation.

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925661#comment-16925661 ] He Xiaoqiao commented on HDFS-14836: Thanks [~Aiphag0] for your report, and I agree that we should

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925579#comment-16925579 ] He Xiaoqiao commented on HDFS-14303: [^HDFS-14303-branch-3.2.addendum.03.patch] upload addendum patch

[jira] [Updated] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14303: --- Attachment: HDFS-14303-branch-3.2.addendum.03.patch > check block directory logic not correct when

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925531#comment-16925531 ] He Xiaoqiao commented on HDFS-14303: Hi [~ayushtkn], [^HDFS-14303-addendum-02.patch] only apply to

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925517#comment-16925517 ] He Xiaoqiao commented on HDFS-14303: upload new patch file with no changes compare to

[jira] [Updated] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14303: --- Attachment: HDFS-14303-branch-2.addendum.02.patch > check block directory logic not correct when

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925377#comment-16925377 ] He Xiaoqiao commented on HDFS-14303: [~iamgd67], just try to trigger Jenkins, please wait for a

[jira] [Updated] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14303: --- Target Version/s: 2.9.2, 3.2.0 (was: 3.2.0, 2.9.2) Status: Patch Available (was:

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925322#comment-16925322 ] He Xiaoqiao commented on HDFS-14771: Hi [~jojochuang],[~sodonnell] is this ready to backport to

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925320#comment-16925320 ] He Xiaoqiao commented on HDFS-14810: Hi [~jojochuang],[~ayushtkn] any update for this improvement? >

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924753#comment-16924753 ] He Xiaoqiao commented on HDFS-10453: [~hustnn] I think this is explained case, when some datanodes

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923913#comment-16923913 ] He Xiaoqiao commented on HDFS-10453: Thanks [~hustnn] for your pings. I am confused about the log

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923883#comment-16923883 ] He Xiaoqiao commented on HDFS-14771: I try to follow up both failed unit tests in branch-2 Jenkins

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923881#comment-16923881 ] He Xiaoqiao commented on HDFS-14303: upload [^HDFS-14303-addendnum-branch-2.01.patch] addendum for

[jira] [Updated] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14303: --- Attachment: HDFS-14303-addendnum-branch-2.01.patch > check block directory logic not correct when

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923872#comment-16923872 ] He Xiaoqiao commented on HDFS-14633: Thanks [~xyao] for your quick response and helps. verify failed

[jira] [Commented] (HDFS-14303) check block directory logic not correct when there is only meta file, print no meaning warn log

[ https://issues.apache.org/jira/browse/HDFS-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923461#comment-16923461 ] He Xiaoqiao commented on HDFS-14303: +1, TestDirectoryScanner in branch-2 failed for a while, and the

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled for rename

[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923449#comment-16923449 ] He Xiaoqiao commented on HDFS-14633: hi [~xyao],[~LiJinglun]. Sorry for late response, just check

[jira] [Comment Edited] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923196#comment-16923196 ] He Xiaoqiao edited comment on HDFS-14771 at 9/5/19 8:33 AM: Check failed unit

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923196#comment-16923196 ] He Xiaoqiao commented on HDFS-14771: Check failed unit test, I don't think they are related with this

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923173#comment-16923173 ] He Xiaoqiao commented on HDFS-14810: Check failed unit tests [TestNamenodeCapacityReport,

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923036#comment-16923036 ] He Xiaoqiao commented on HDFS-14771: [^HDFS-14771.branch-2.003.patch] disable this feature by

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14771: --- Attachment: HDFS-14771.branch-2.003.patch > Backport HDFS-14617 to branch-2 (Improve fsimage load

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923035#comment-16923035 ] He Xiaoqiao commented on HDFS-14810: Thanks [~ayushtkn], [^HDFS-14810.004.patch] remove success

[jira] [Updated] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14810: --- Attachment: HDFS-14810.004.patch > review FSNameSystem editlog sync >

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922726#comment-16922726 ] He Xiaoqiao commented on HDFS-14810: [~ayushtkn],[~jojochuang],[~kihwal] do you mind to take another

[jira] [Commented] (HDFS-14821) Make HDFS-14617 (fsimage sub-sections) off by default

[ https://issues.apache.org/jira/browse/HDFS-14821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922722#comment-16922722 ] He Xiaoqiao commented on HDFS-14821: +1 (non-binding) for [^HDFS-14821.001.patch]. Thanks

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922721#comment-16922721 ] He Xiaoqiao commented on HDFS-14771: {quote}Perhaps on branch 2 that is the way forward too?{quote}

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922715#comment-16922715 ] He Xiaoqiao commented on HDFS-14771: +1 for disable this feature by default, it may be safest and

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922692#comment-16922692 ] He Xiaoqiao commented on HDFS-14810: Thanks [~ayushtkn] for your nice reviews. 1. I try to remove

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921585#comment-16921585 ] He Xiaoqiao commented on HDFS-14771: [^HDFS-14771.branch-2.002.patch] try to fix checkstyle Jenkins

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14771: --- Attachment: HDFS-14771.branch-2.002.patch > Backport HDFS-14617 to branch-2 (Improve fsimage load

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920981#comment-16920981 ] He Xiaoqiao commented on HDFS-14810: check four failed unit tests are all related with OOM, and

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920719#comment-16920719 ] He Xiaoqiao commented on HDFS-14810: [^HDFS-14810.003.patch] changes point based on v002 and pending

[jira] [Updated] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14810: --- Attachment: HDFS-14810.003.patch > review FSNameSystem editlog sync >

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920612#comment-16920612 ] He Xiaoqiao commented on HDFS-14810: [^HDFS-14810.002.patch] try to fix some exception and follows

[jira] [Updated] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14810: --- Attachment: HDFS-14810.002.patch > review FSNameSystem editlog sync >

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920441#comment-16920441 ] He Xiaoqiao commented on HDFS-13157: Thanks [~belugabehr] for the great work and detailed analysis. I

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920413#comment-16920413 ] He Xiaoqiao commented on HDFS-14810: Thanks [~ayushtkn] for your feedback, I will update it next

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920397#comment-16920397 ] He Xiaoqiao commented on HDFS-14305: Thanks [~csun] for your comments. To be honest, I have no

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920394#comment-16920394 ] He Xiaoqiao commented on HDFS-14802: Thanks [~ferhui] for your contribution, I think maybe we need

[jira] [Commented] (HDFS-14807) SetTimes updates all negative values apart from -1

[ https://issues.apache.org/jira/browse/HDFS-14807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920393#comment-16920393 ] He Xiaoqiao commented on HDFS-14807: [^HDFS-14807-02.patch] LGTM. +1(no binding). > SetTimes updates

[jira] [Assigned] (HDFS-12733) Option to disable to namenode local edits

[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao reassigned HDFS-12733: -- Assignee: He Xiaoqiao (was: Brahma Reddy Battula) > Option to disable to namenode local

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920390#comment-16920390 ] He Xiaoqiao commented on HDFS-12733: To [~brahmareddy], I just assign this JIRA to myself, please

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920388#comment-16920388 ] He Xiaoqiao commented on HDFS-12733: Thanks [~ayushtkn] pick up this ticket, and I would like to

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920386#comment-16920386 ] He Xiaoqiao commented on HDFS-14810: some unnecessary edit logs such as HDFS-11291 reported do not

[jira] [Updated] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14810: --- Attachment: HDFS-14810.001.patch Status: Patch Available (was: Open) submit init patch and

[jira] [Created] (HDFS-14810) review FSNameSystem editlog sync

He Xiaoqiao created HDFS-14810: -- Summary: review FSNameSystem editlog sync Key: HDFS-14810 URL: https://issues.apache.org/jira/browse/HDFS-14810 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918256#comment-16918256 ] He Xiaoqiao commented on HDFS-14305: [~shv], Thanks very much for picking up this JIRA and revisiting

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917418#comment-16917418 ] He Xiaoqiao commented on HDFS-14771: thanks [~kihwal],[~sodonnell] for your discussions. it seems I

[jira] [Commented] (HDFS-14497) Write lock held by metasave impact following RPC processing

[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916380#comment-16916380 ] He Xiaoqiao commented on HDFS-14497: verify failed unit test and both passed at local, please take a

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916314#comment-16916314 ] He Xiaoqiao commented on HDFS-14771: Thanks [~kihwal] for your response, HDFS-14617 has discussed the

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915452#comment-16915452 ] He Xiaoqiao commented on HDFS-11246: check failed unit tests and it seems that most of them is

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915273#comment-16915273 ] He Xiaoqiao commented on HDFS-14771: Thanks [~linyiqun] for your feedback.

[jira] [Commented] (HDFS-14648) DeadNodeDetector basic model

[ https://issues.apache.org/jira/browse/HDFS-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915262#comment-16915262 ] He Xiaoqiao commented on HDFS-14648: Thanks [~leosun08] for your contributions. I try to learn

[jira] [Reopened] (HDFS-14497) Write lock held by metasave impact following RPC processing

[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao reopened HDFS-14497: > Write lock held by metasave impact following RPC processing >

[jira] [Comment Edited] (HDFS-14497) Write lock held by metasave impact following RPC processing

[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915230#comment-16915230 ] He Xiaoqiao edited comment on HDFS-14497 at 8/25/19 1:45 PM: - Thanks

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14771: --- Attachment: HDFS-14771.branch-2.001.patch Status: Patch Available (was: Open) submit demo

[jira] [Commented] (HDFS-14497) Write lock held by metasave impact following RPC processing

[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915230#comment-16915230 ] He Xiaoqiao commented on HDFS-14497: Thanks [~jojochuang], {quote}suggests metaSaveLock should be a

[jira] [Updated] (HDFS-14497) Write lock held by metasave impact following RPC processing

[ https://issues.apache.org/jira/browse/HDFS-14497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14497: --- Attachment: HDFS-14497-addendum.001.patch > Write lock held by metasave impact following RPC

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915221#comment-16915221 ] He Xiaoqiao commented on HDFS-14617: [~csun],[~sodonnell],[~jojochuang] HDFS-14771 is tracking for

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915218#comment-16915218 ] He Xiaoqiao commented on HDFS-11246: Thanks [~jojochuang], [^HDFS-11246.011.patch] try to correct

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-11246: --- Attachment: HDFS-11246.011.patch > FSNameSystem#logAuditEvent should be called outside the read or

[jira] [Assigned] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao reassigned HDFS-14771: -- Assignee: He Xiaoqiao > Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914211#comment-16914211 ] He Xiaoqiao commented on HDFS-14771: [~hemanthboyina] thanks for your quick response. As mentioned at

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14771: --- Description: This JIRA aims to backport HDFS-14617 to branch-2: fsimage load time by writing

[jira] [Updated] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14771: --- Summary: Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the

[jira] [Created] (HDFS-14771) Backport HDFS-12914 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

He Xiaoqiao created HDFS-14771: -- Summary: Backport HDFS-12914 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index) Key: HDFS-14771 URL:

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914179#comment-16914179 ] He Xiaoqiao commented on HDFS-14617: [~csun] Thanks for your follows, I apply this patch to

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914173#comment-16914173 ] He Xiaoqiao commented on HDFS-11246: Thanks [~jojochuang] for the detailed reviews. submit

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-11246: --- Attachment: HDFS-11246.010.patch > FSNameSystem#logAuditEvent should be called outside the read or

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913002#comment-16913002 ] He Xiaoqiao commented on HDFS-12749: attach [^HDFS-12749-trunk.006.patch] based on trunk without unit

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-trunk.006.patch > DN may not send block report to NN after NN restart >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912960#comment-16912960 ] He Xiaoqiao commented on HDFS-12749: [~jojochuang] Thanks for your feedback, and sorry for late

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912955#comment-16912955 ] He Xiaoqiao commented on HDFS-11246: Ping [~ayushtkn],[~linyiqun],[~daryn], do you have any bandwidth

[jira] [Commented] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912952#comment-16912952 ] He Xiaoqiao commented on HDFS-10782: [~jojochuang] Thanks for picking this issue up,

[jira] [Commented] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910157#comment-16910157 ] He Xiaoqiao commented on HDFS-10606: TrashPolicyDefault clean up trash at static time 00:00 UTC, and

[jira] [Updated] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

[ https://issues.apache.org/jira/browse/HDFS-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-14109: --- Resolution: Not A Problem Status: Resolved (was: Patch Available) > Improve hdfs auditlog

[jira] [Commented] (HDFS-14109) Improve hdfs auditlog format and support federation friendly

[ https://issues.apache.org/jira/browse/HDFS-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910155#comment-16910155 ] He Xiaoqiao commented on HDFS-14109: my first thought is that add `nsid` for namenode audit log to

[jira] [Commented] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909767#comment-16909767 ] He Xiaoqiao commented on HDFS-10606: [^HDFS-10606.002.patch] fix checkstyle and javadoc. >

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Attachment: HDFS-10606.002.patch > TrashPolicyDefault supports time of auto clean up can configured

[jira] [Commented] (HDFS-14583) FileStatus#toString() will throw IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909716#comment-16909716 ] He Xiaoqiao commented on HDFS-14583: {quote} HdfsFileStatus don't has empty symlink check, so I think

[jira] [Commented] (HDFS-14583) FileStatus#toString() will throw IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909704#comment-16909704 ] He Xiaoqiao commented on HDFS-14583: Thanks [~xuzq_zander] for your report and contribution. I prefer

[jira] [Commented] (HDFS-14646) Standby NameNode should not upload fsimage to an inappropriate NameNode.

[ https://issues.apache.org/jira/browse/HDFS-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909702#comment-16909702 ] He Xiaoqiao commented on HDFS-14646: Thanks [~xudongcao] for your pings, to be honest, I do not have

[jira] [Commented] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909694#comment-16909694 ] He Xiaoqiao commented on HDFS-10606: Thanks [~jojochuang] pick it up again. [^HDFS-10606.001.patch]

  1   2   3   4   5   6   7   8   9   >