[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941654#comment-16941654 ] Xiaoqiao He commented on HDFS-14305: Thanks [~shv],[~vagarychen] for your explains. it makes sense to

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941748#comment-16941748 ] Xiaoqiao He commented on HDFS-14882: [~lukmajercak], Thanks for your comments. This ticket is plan to

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941859#comment-16941859 ] Xiaoqiao He commented on HDFS-14498: Thank [~leigh.jo...@ripjar.com] for your report. Would you like

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940643#comment-16940643 ] Xiaoqiao He commented on HDFS-14090: Thanks [~crh] for your works and sorry for late response. 1.

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940652#comment-16940652 ] Xiaoqiao He commented on HDFS-14305: Thanks [~shv],[~arp] very much for your feedback and works. it

[jira] [Commented] (HDFS-14554) Avoid to process duplicate blockreport of datanode when namenode in startup safemode

[ https://issues.apache.org/jira/browse/HDFS-14554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940646#comment-16940646 ] Xiaoqiao He commented on HDFS-14554: Thanks [~lindongdong] for your comments. This ticket is not

[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940674#comment-16940674 ] Xiaoqiao He commented on HDFS-14775: Thanks [~zhangchen] for your works. This improvement is useful

[jira] [Commented] (HDFS-14810) review FSNameSystem editlog sync

[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940660#comment-16940660 ] Xiaoqiao He commented on HDFS-14810: [~jojochuang] gentle reminder again. any update here? > review

[jira] [Comment Edited] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940674#comment-16940674 ] Xiaoqiao He edited comment on HDFS-14775 at 9/30/19 6:34 AM: - Thanks

[jira] [Created] (HDFS-14882) Consider DataNode load when #getBlockLocation

Xiaoqiao He created HDFS-14882: -- Summary: Consider DataNode load when #getBlockLocation Key: HDFS-14882 URL: https://issues.apache.org/jira/browse/HDFS-14882 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.001.patch Status: Patch Available (was: Open) submit demo patch and

[jira] [Updated] (HDFS-14952) Skip safemode if blockSafe is 0 in new NN

[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14952: --- Attachment: HDFS-14952.001.patch > Skip safemode if blockSafe is 0 in new NN >

[jira] [Commented] (HDFS-14952) Skip safemode if blockSafe is 0 in new NN

[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966781#comment-16966781 ] Xiaoqiao He commented on HDFS-14952: Thanks [~rajesh.balamohan] for your report. It speeds extension

[jira] [Commented] (HDFS-14952) Skip safemode if blockSafe is 0 in new NN

[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966788#comment-16966788 ] Xiaoqiao He commented on HDFS-14952: [^HDFS-14952.001.patch] try to correct the extension period for

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962758#comment-16962758 ] Xiaoqiao He commented on HDFS-14882: Thanks [~pifta] for your suggestions, {quote}I would suggest two

[jira] [Comment Edited] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962758#comment-16962758 ] Xiaoqiao He edited comment on HDFS-14882 at 10/30/19 7:08 AM: -- Thanks

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.010.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965313#comment-16965313 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.010.patch] try to fix bug about

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.010.patch > Consider DataNode load when #getBlockLocation >

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: (was: HDFS-14882.010.patch) > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965347#comment-16965347 ] Xiaoqiao He commented on HDFS-14720: [~surendrasingh] Thanks for your report. Would you like to share

[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967196#comment-16967196 ] Xiaoqiao He commented on HDFS-14775: [^HDFS-14775.005.patch] LGTM, +1. Thanks [~zhangchen]. > Add

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973224#comment-16973224 ] Xiaoqiao He commented on HDFS-14617: Thanks [~Feng Yuan] for your pings. IIRC, it is exactly invoke

[jira] [Updated] (HDFS-14952) Skip safemode if blockTotal is 0 in new NN

[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14952: --- Attachment: HDFS-14952.002.patch Assignee: Xiaoqiao He Status: Patch Available (was:

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973305#comment-16973305 ] Xiaoqiao He commented on HDFS-14986: we meet very similar case (ConcurrentModificationException or

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973339#comment-16973339 ] Xiaoqiao He commented on HDFS-14986: [~linyiqun], we did some modify when backport HDFS-14313 since

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973364#comment-16973364 ] Xiaoqiao He commented on HDFS-14882: Ping [~elgoiri],[~ayushtkn] any furthermore comments? >

[jira] [Commented] (HDFS-14952) Skip safemode if blockTotal is 0 in new NN

[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974868#comment-16974868 ] Xiaoqiao He commented on HDFS-14952: [^HDFS-14952.003.patch] try to fix failed unit test

[jira] [Updated] (HDFS-14952) Skip safemode if blockTotal is 0 in new NN

[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14952: --- Attachment: HDFS-14952.003.patch > Skip safemode if blockTotal is 0 in new NN >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969041#comment-16969041 ] Xiaoqiao He commented on HDFS-14882: Thanks [~elgoiri] for your feedback. Ping [~pifta], would like

[jira] [Commented] (HDFS-14117) RBF: We can only delete the files or dirs of one subcluster in a cluster with multiple subclusters when trash is enabled

[ https://issues.apache.org/jira/browse/HDFS-14117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969039#comment-16969039 ] Xiaoqiao He commented on HDFS-14117: Hi [~ramkumar],[~elgoiri],[~ayushtkn], any progress here? >

[jira] [Commented] (HDFS-14529) NPE while Loading the Editlogs

[ https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970116#comment-16970116 ] Xiaoqiao He commented on HDFS-14529: Thanks [~sodonnell] for your quick response. I have noticed

[jira] [Commented] (HDFS-14529) NPE while Loading the Editlogs

[ https://issues.apache.org/jira/browse/HDFS-14529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970092#comment-16970092 ] Xiaoqiao He commented on HDFS-14529: I also meet another NPE at StandbyNN (build with hadoop-2.7.1)

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970059#comment-16970059 ] Xiaoqiao He commented on HDFS-14720: Thanks [~surendrasingh] and [~hemanthboyina], {quote}It just not

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970332#comment-16970332 ] Xiaoqiao He commented on HDFS-14720: [^HDFS-14720.003.patch] LGTM, +1. Thanks [~hemanthboyina]. >

[jira] [Created] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

Xiaoqiao He created HDFS-15000: -- Summary: Improve FsDatasetImpl to avoid IO operation in datasetLock Key: HDFS-15000 URL: https://issues.apache.org/jira/browse/HDFS-15000 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: HDFS-14997.002.patch > BPServiceActor process command from NameNode asynchronously >

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979379#comment-16979379 ] Xiaoqiao He commented on HDFS-14997: [~sodonnell], Try to upload v002 patch and add unit test. Please

[jira] [Updated] (HDFS-15053) RBF: Add permission check for safemode operation

[ https://issues.apache.org/jira/browse/HDFS-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15053: --- Attachment: HDFS-15053.002.patch > RBF: Add permission check for safemode operation >

[jira] [Commented] (HDFS-15053) RBF: Add permission check for safemode operation

[ https://issues.apache.org/jira/browse/HDFS-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995438#comment-16995438 ] Xiaoqiao He commented on HDFS-15053: Hi [~ayushtkn], Thanks for your suggestion,

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993275#comment-16993275 ] Xiaoqiao He commented on HDFS-14997: Thanks [~weichiu], {quote}Question: I can imagine DNA_INVALIDATE

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995751#comment-16995751 ] Xiaoqiao He commented on HDFS-15051: Hi [~elgoiri], Thanks for your use case. [^HDFS-15051.002.patch]

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.002.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Created] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

Xiaoqiao He created HDFS-15068: -- Summary: DataNode could meet deadlock if invoke refreshVolumes when register Key: HDFS-15068 URL: https://issues.apache.org/jira/browse/HDFS-15068 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997936#comment-16997936 ] Xiaoqiao He commented on HDFS-15068: Thanks [~Aiphag0] for your contribution. I agree that it is safe

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15068: --- Status: Patch Available (was: Open) > DataNode could meet deadlock if invoke refreshVolumes when

[jira] [Created] (HDFS-15051) Propose to revoke WRITE MountTableEntry privilege to super user only

Xiaoqiao He created HDFS-15051: -- Summary: Propose to revoke WRITE MountTableEntry privilege to super user only Key: HDFS-15051 URL: https://issues.apache.org/jira/browse/HDFS-15051 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15050) Optimize log information when DFSInputStream meet CannotObtainBlockLengthException

[ https://issues.apache.org/jira/browse/HDFS-15050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15050: --- Attachment: HDFS-15050.001.patch Status: Patch Available (was: Open) submit init patch with

[jira] [Created] (HDFS-15050) Optimize log information when DFSInputStream meet CannotObtainBlockLengthException

Xiaoqiao He created HDFS-15050: -- Summary: Optimize log information when DFSInputStream meet CannotObtainBlockLengthException Key: HDFS-15050 URL: https://issues.apache.org/jira/browse/HDFS-15050

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994393#comment-16994393 ] Xiaoqiao He commented on HDFS-15051: + RouterStateManager which is without any access control. >

[jira] [Updated] (HDFS-15053) RBF: Add permission check for safemode operation

[ https://issues.apache.org/jira/browse/HDFS-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15053: --- Attachment: HDFS-15053.001.patch Status: Patch Available (was: Open) submit the init patch

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994693#comment-16994693 ] Xiaoqiao He commented on HDFS-15051: It seems that no related with other module to add permission

[jira] [Created] (HDFS-15053) RBF: Add permission check for safemode operation

Xiaoqiao He created HDFS-15053: -- Summary: RBF: Add permission check for safemode operation Key: HDFS-15053 URL: https://issues.apache.org/jira/browse/HDFS-15053 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994281#comment-16994281 ] Xiaoqiao He commented on HDFS-15051: {quote}We can change to have just superuser access, if only the

[jira] [Updated] (HDFS-15051) Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.001.patch Status: Patch Available (was: Open) submit demo patch and

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997311#comment-16997311 ] Xiaoqiao He commented on HDFS-15051: if no object, [^HDFS-15051.003.patch] try to fix permission

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.003.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.004.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997423#comment-16997423 ] Xiaoqiao He commented on HDFS-15051: [^HDFS-15051.004.patch] fix checkstyle. > RBF: Propose to

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994154#comment-16994154 ] Xiaoqiao He commented on HDFS-15051: Thanks [~elgoiri] for offering the design consideration, However

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961123#comment-16961123 ] Xiaoqiao He commented on HDFS-14882: Thanks [~pifta] for your suggestions, [^HDFS-14882.suggestion]

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961096#comment-16961096 ] Xiaoqiao He commented on HDFS-13736: [^HDFS-13736.006.patch] LGTM, check the failed unit tests, it is

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955815#comment-16955815 ] Xiaoqiao He commented on HDFS-14915: [~ayushtkn] Thanks for your works. it seems that double check

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955804#comment-16955804 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn] for your comments. {quote}Though things are

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955911#comment-16955911 ] Xiaoqiao He commented on HDFS-13736: Thanks [~xiaodong.hu] for interesting catching.

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.005.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955918#comment-16955918 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.005.patch] fix checkstyle and try to trigger

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.004.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955919#comment-16955919 ] Xiaoqiao He commented on HDFS-14915: +1 for [^HDFS-14915-02.patch] from my side. > Move Superuser

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955887#comment-16955887 ] Xiaoqiao He commented on HDFS-14915: Thanks [~ayushtkn] for your quick update. We need double

[jira] [Comment Edited] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956085#comment-16956085 ] Xiaoqiao He edited comment on HDFS-14882 at 10/21/19 1:31 PM: -- Check failed

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956027#comment-16956027 ] Xiaoqiao He commented on HDFS-13736: [^HDFS-13736.004.patch] looks much better otherwise the

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.006.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956085#comment-16956085 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn], you are right. [^HDFS-14882.006.patch]

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956922#comment-16956922 ] Xiaoqiao He commented on HDFS-14908: Thanks [~LiJinglun] for your catch and works, IIUC this issue

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959520#comment-16959520 ] Xiaoqiao He commented on HDFS-14908: Thanks [~LiJinglun] for your works and strict benchmark. IMO, we

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.009.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961746#comment-16961746 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.009.patch] originate from [~pifta]'s suggestion and

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961747#comment-16961747 ] Xiaoqiao He commented on HDFS-13736: +1 for [^HDFS-13736.007.patch]. > BlockPlacementPolicyDefault

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955423#comment-16955423 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.002.patch] fix checkstyle and try to trigger

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.002.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955426#comment-16955426 ] Xiaoqiao He commented on HDFS-14283: Thanks [~leosun08] for your works. {quote}But i have a problem

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.003.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955487#comment-16955487 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn] for your reviews. I have addressed all the

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.007.patch > Consider DataNode load when #getBlockLocation >

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956667#comment-16956667 ] Xiaoqiao He commented on HDFS-14882: [~elgoiri],[~ayushtkn] Thanks for your nice reviews and

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956673#comment-16956673 ] Xiaoqiao He commented on HDFS-13736: Thanks [~xiaodong.hu] for your works and contributions.

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957592#comment-16957592 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn],[~elgoiri] for your suggestions,

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957619#comment-16957619 ] Xiaoqiao He commented on HDFS-14908: Thanks [~LiJinglun] for your feedback. What I mean that it could

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.008.patch > Consider DataNode load when #getBlockLocation >

[jira] [Updated] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: HDFS-14997.001.patch Assignee: Xiaoqiao He (was: Aiphago) Status: Patch

[jira] [Updated] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: (was: HDFS-14997.001.patch) > BPServiceActor process command from NameNode

[jira] [Updated] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: HDFS-14997.001.patch > BPServiceActor process command from NameNode asynchronously >

[jira] [Created] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

Xiaoqiao He created HDFS-14997: -- Summary: BPServiceActor process command from NameNode asynchronously Key: HDFS-14997 URL: https://issues.apache.org/jira/browse/HDFS-14997 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978517#comment-16978517 ] Xiaoqiao He commented on HDFS-14997: Thanks [~sodonnell] for your comments. {quote}We have seen a lot

[jira] [Updated] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: HDFS-14997.004.patch > BPServiceActor process command from NameNode asynchronously >

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982686#comment-16982686 ] Xiaoqiao He commented on HDFS-14997: Thanks [~elgoiri] for your comments. v004 try to fix concerns

[jira] [Updated] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: HDFS-14997.005.patch > BPServiceActor process command from NameNode asynchronously >

[jira] [Commented] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983253#comment-16983253 ] Xiaoqiao He commented on HDFS-14997: [~elgoiri] v005 try to fix checkstyle and run all failed unit

[jira] [Updated] (HDFS-14997) BPServiceActor process command from NameNode asynchronously

[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14997: --- Attachment: (was: HDFS-14997.005.patch) > BPServiceActor process command from NameNode

  1   2   3   4   5   6   7   8   9   10   >