[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070288#comment-17070288 ] Xiaoqiao He commented on HDFS-14385: Thanks [~elgoiri], v003 try to fix checkstyle and bugs. Pending

[jira] [Updated] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14385: --- Attachment: HDFS-14385.003.patch > RBF: Optimize MiniRouterDFSCluster with optional light weight

[jira] [Commented] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069301#comment-17069301 ] Xiaoqiao He commented on HDFS-14385: Thanks [~elgoiri] pick this JIRA up, v002 rebase to trunk. PTAL.

[jira] [Updated] (HDFS-14385) RBF: Optimize MiniRouterDFSCluster with optional light weight MiniDFSCluster

2020-03-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14385: --- Attachment: HDFS-14385.002.patch > RBF: Optimize MiniRouterDFSCluster with optional light weight

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069207#comment-17069207 ] Xiaoqiao He commented on HDFS-13183: v005 try to fix the findbugs and checkstyle. > Standby NameNode

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.005.patch > Standby NameNode process getBlocks request to reduce Active load

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Affects Version/s: (was: 3.0.2) (was: 2.8.4)

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068824#comment-17068824 ] Xiaoqiao He commented on HDFS-15051: [~ayushtkn],[~elgoiri] any thought or suggestions here? > RBF:

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068823#comment-17068823 ] Xiaoqiao He commented on HDFS-15169: Thanks [~elgoiri] for your reviews. v003 try to refactor the

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.003.patch > RBF: Router FSCK should consider the mount table >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068809#comment-17068809 ] Xiaoqiao He commented on HDFS-13183: Considering this feature is deployed and used by many users, I

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-03-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.004.patch > Standby NameNode process getBlocks request to reduce Active load

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15242: --- Attachment: HDFS-15242.003.patch > Add metrics for operations hold lock times of FsDatasetImpl >

[jira] [Commented] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067915#comment-17067915 ] Xiaoqiao He commented on HDFS-15242: Thanks [~elgoiri] for your reviews. v003 fix the typo. PTAL. >

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067442#comment-17067442 ] Xiaoqiao He commented on HDFS-12733: Thanks [~elgoiri],[~ayushtkn] for your great feedback. v008 does

[jira] [Commented] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067344#comment-17067344 ] Xiaoqiao He commented on HDFS-15242: Thanks [~weichiu],[~elgoiri] for your reviews. rebase and upload

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15242: --- Attachment: HDFS-15242.002.patch > Add metrics for operations hold lock times of FsDatasetImpl >

[jira] [Commented] (HDFS-15238) RBF:NamenodeHeartbeatService caused memory to grow rapidly

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066869#comment-17066869 ] Xiaoqiao He commented on HDFS-15238: Thanks [~xuzq_zander] for your works. Good catch here. +1 for

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1703#comment-1703 ] Xiaoqiao He commented on HDFS-15075: Hi [~weichiu],[~elgoiri], add metrics for {{FsDatasetImpl}}

[jira] [Updated] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15242: --- Attachment: HDFS-15242.001.patch Status: Patch Available (was: Open) submit init patch v001

[jira] [Created] (HDFS-15242) Add metrics for operations hold lock times of FsDatasetImpl

2020-03-25 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15242: -- Summary: Add metrics for operations hold lock times of FsDatasetImpl Key: HDFS-15242 URL: https://issues.apache.org/jira/browse/HDFS-15242 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.009.patch > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066637#comment-17066637 ] Xiaoqiao He commented on HDFS-15075: update to v009, and fix findbugs. > Remove process command

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066635#comment-17066635 ] Xiaoqiao He commented on HDFS-15169: Thanks [~elgoiri] for your reviews. v002 add unit test for fsck

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.002.patch > RBF: Router FSCK should consider the mount table >

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066464#comment-17066464 ] Xiaoqiao He commented on HDFS-15082: Hi [~elgoiri], I try to test failed unit test

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066456#comment-17066456 ] Xiaoqiao He commented on HDFS-15075: Thanks [~weichiu],[~elgoiri] for your suggestions, v008 try to

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.008.patch > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066381#comment-17066381 ] Xiaoqiao He commented on HDFS-15082: Thanks [~elgoiri] for picking up this issue. submit v003 (total

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.003.patch > RBF: Check each component length of destination path when

[jira] [Commented] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064569#comment-17064569 ] Xiaoqiao He commented on HDFS-15169: Attach Jenkins result link

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064541#comment-17064541 ] Xiaoqiao He commented on HDFS-15075: Thanks [~elgoiri] for your good catches, v007 try to update the

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.007.patch > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064506#comment-17064506 ] Xiaoqiao He commented on HDFS-15113: Thanks [~weichiu]. Please refer Yetus result:

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064253#comment-17064253 ] Xiaoqiao He commented on HDFS-12733: Hi [~shv],[~brahmareddy],[~elgoiri],[~ayushtkn], Sorry for

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064245#comment-17064245 ] Xiaoqiao He commented on HDFS-15051: v008 change permission check logic just EXECUTE if immediate

[jira] [Issue Comment Deleted] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Comment: was deleted (was: Thanks [~ayushtkn] pick up this JIRA. {quote}If the immediate parent

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064243#comment-17064243 ] Xiaoqiao He commented on HDFS-15075: Thanks [~elgoiri] for your comments, v006 try to update

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.008.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.006.patch > Remove process command timing from BPServiceActor >

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064210#comment-17064210 ] Xiaoqiao He commented on HDFS-15051: Thanks [~ayushtkn] pick up this JIRA. {quote}If the immediate

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2020-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064211#comment-17064211 ] Xiaoqiao He commented on HDFS-15051: Thanks [~ayushtkn] pick up this JIRA. {quote}If the immediate

[jira] [Updated] (HDFS-15169) RBF: Router FSCK should consider the mount table

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15169: --- Attachment: HDFS-15169.001.patch Assignee: Xiaoqiao He Status: Patch Available (was:

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063838#comment-17063838 ] Xiaoqiao He commented on HDFS-15075: Considering HDFS-15113 has pushed to trunk, should we continue

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.005.patch > Remove process command timing from BPServiceActor >

[jira] [Comment Edited] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063805#comment-17063805 ] Xiaoqiao He edited comment on HDFS-15180 at 3/21/20, 7:57 AM: -- Not sure why

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063805#comment-17063805 ] Xiaoqiao He commented on HDFS-15180: Not sure why Jenkins report not attach here. Just forward the

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063403#comment-17063403 ] Xiaoqiao He commented on HDFS-15180: Try to trigger Jenkins. > DataNode FsDatasetImpl Fine-Grained

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15180: --- Status: Patch Available (was: Open) > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059699#comment-17059699 ] Xiaoqiao He commented on HDFS-15113: Thanks [~weichiu] for your comments and sorry for missing this

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.addendum.patch > Missing IBR when NameNode restart if open processCommand

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059203#comment-17059203 ] Xiaoqiao He commented on HDFS-15180: Thanks [~Aiphag0] for your works and the POC patch. Hi [~zhuqi],

[jira] [Assigned] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15180: -- Assignee: Aiphago (was: zhuqi) > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056635#comment-17056635 ] Xiaoqiao He commented on HDFS-15113: Thanks [~brahmareddy],[~elgoiri] for your reviews. [~weichiu]

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-03-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055839#comment-17055839 ] Xiaoqiao He commented on HDFS-15160: Thanks [~sodonnell] for your works, it is great improvement for

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055579#comment-17055579 ] Xiaoqiao He commented on HDFS-15113: [~weichiu],[~elgoiri],[~brahmareddy] Hi guys, any furthermore

[jira] [Commented] (HDFS-15207) VolumeScanner skip to scan blocks accessed during recent scan peroid

2020-03-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055576#comment-17055576 ] Xiaoqiao He commented on HDFS-15207: Thanks [~hadoop_yangyun] for your works. This improvement seems

[jira] [Comment Edited] (HDFS-15205) FSImage sort section logic is wrong

2020-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053968#comment-17053968 ] Xiaoqiao He edited comment on HDFS-15205 at 3/7/20, 10:21 AM: -- Hi

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053968#comment-17053968 ] Xiaoqiao He commented on HDFS-15205: Hi [~sodonnell],[~angerszhuuu], After re-check and dig code, I

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052734#comment-17052734 ] Xiaoqiao He commented on HDFS-15205: Thanks [~angerszhuuu] for your detailed comments. It looks that

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052719#comment-17052719 ] Xiaoqiao He commented on HDFS-15113: Thanks [~weichiu] for your reminder. I try to run other failed

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052320#comment-17052320 ] Xiaoqiao He commented on HDFS-15113: [~brahmareddy] Thanks for your quick response. submit v005 and

[jira] [Comment Edited] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17052320#comment-17052320 ] Xiaoqiao He edited comment on HDFS-15113 at 3/5/20, 4:40 PM: - [~brahmareddy]

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.005.patch > Missing IBR when NameNode restart if open processCommand async

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051952#comment-17051952 ] Xiaoqiao He commented on HDFS-15180: [~zhuqi] Thanks for your proposal and involve me here. It is

[jira] [Comment Edited] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051941#comment-17051941 ] Xiaoqiao He edited comment on HDFS-15205 at 3/5/20, 9:20 AM: - Thanks

[jira] [Commented] (HDFS-15205) FSImage sort section logic is wrong

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051941#comment-17051941 ] Xiaoqiao He commented on HDFS-15205: [~angerszhuuu], Thanks for your report. I try to recall test

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051909#comment-17051909 ] Xiaoqiao He commented on HDFS-15113: Sorry for late response due to long time vacation. submit v004

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-03-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.004.patch > Missing IBR when NameNode restart if open processCommand async

[jira] [Commented] (HDFS-15087) RBF: Balance/Rename across federation namespaces

2020-02-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036004#comment-17036004 ] Xiaoqiao He commented on HDFS-15087: Thanks [~LiJinglun] for your proposal, it is very interesting

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016851#comment-17016851 ] Xiaoqiao He commented on HDFS-15113: [~elgoiri],[~weichiu],[~brahmareddy], any bandwidth to push this

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016844#comment-17016844 ] Xiaoqiao He commented on HDFS-15115: [~wzx513], would you like to check all same cases in

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016843#comment-17016843 ] Xiaoqiao He commented on HDFS-14672: [~Tao Yang], [^HDFS-14672.branch-2.8.001.patch] try to offer

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2020-01-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14672: --- Attachment: HDFS-14672.branch-2.8.001.patch > Backport HDFS-12703 to branch-2 >

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015065#comment-17015065 ] Xiaoqiao He commented on HDFS-15113: Thanks all for your comments.

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.003.patch > Missing IBR when NameNode restart if open processCommand async

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014429#comment-17014429 ] Xiaoqiao He commented on HDFS-15113: cc [~elgoiri],[~weichiu],[~brahmareddy] any suggestions here?

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-01-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014426#comment-17014426 ] Xiaoqiao He commented on HDFS-15115: this case is very similar to HDFS-11827 in my opinion, not sure

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2020-01-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014401#comment-17014401 ] Xiaoqiao He commented on HDFS-14672: Thanks [~Tao Yang] for your reminder, after checking the commit,

[jira] [Commented] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013664#comment-17013664 ] Xiaoqiao He commented on HDFS-15113: submit v002 with unit test. Please help to take another review

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.002.patch > Missing IBR when NameNode restart if open processCommand async

[jira] [Updated] (HDFS-15088) RBF: Correct annotation typo of RouterPermissionChecker#checkPermission

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15088: --- Summary: RBF: Correct annotation typo of RouterPermissionChecker#checkPermission (was: Correct

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013460#comment-17013460 ] Xiaoqiao He commented on HDFS-15082: Thanks [~elgoiri] for your reviews and comments. v002 update and

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.002.patch > RBF: Check each component length of destination path when

[jira] [Commented] (HDFS-15075) Remove process command timing from BPServiceActor

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013457#comment-17013457 ] Xiaoqiao He commented on HDFS-15075: Thanks [~elgoiri] and [~dabecker] for your review comments, v004

[jira] [Updated] (HDFS-15075) Remove process command timing from BPServiceActor

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15075: --- Attachment: HDFS-15075.004.patch > Remove process command timing from BPServiceActor >

[jira] [Updated] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15113: --- Attachment: HDFS-15113.001.patch Status: Patch Available (was: Open) submit v001 to fix

[jira] [Created] (HDFS-15113) Missing IBR when NameNode restart if open processCommand async feature

2020-01-11 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15113: -- Summary: Missing IBR when NameNode restart if open processCommand async feature Key: HDFS-15113 URL: https://issues.apache.org/jira/browse/HDFS-15113 Project: Hadoop

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2020-01-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008298#comment-17008298 ] Xiaoqiao He commented on HDFS-15079: Thanks [~ferhui] for your works and ping. I believe this issue

[jira] [Commented] (HDFS-15083) Add new trash rpc which move the trash (mkdir and the rename) operation to the server side.

2020-01-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008293#comment-17008293 ] Xiaoqiao He commented on HDFS-15083: Thanks [~zhuqi] for your works, this is very meaningful work. I

[jira] [Commented] (HDFS-15091) Cache Admin and Quota Commands Should Check SuperUser Before Taking Lock

2020-01-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006735#comment-17006735 ] Xiaoqiao He commented on HDFS-15091: v02 LGTM, +1 from my side. > Cache Admin and Quota Commands

[jira] [Commented] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2020-01-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006581#comment-17006581 ] Xiaoqiao He commented on HDFS-15068: v005 LGTM, Run the failed unit test on local, it seems most of

[jira] [Updated] (HDFS-15088) Correct annotation typo of RouterPermissionChecker#checkPermission

2019-12-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15088: --- Attachment: HDFS-15088.patch Status: Patch Available (was: Open) > Correct annotation typo

[jira] [Created] (HDFS-15088) Correct annotation typo of RouterPermissionChecker#checkPermission

2019-12-30 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15088: -- Summary: Correct annotation typo of RouterPermissionChecker#checkPermission Key: HDFS-15088 URL: https://issues.apache.org/jira/browse/HDFS-15088 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2019-12-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005417#comment-17005417 ] Xiaoqiao He commented on HDFS-15051: [~ayushtkn],[~elgoiri], v007 try to check write permission about

[jira] [Updated] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2019-12-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15051: --- Attachment: HDFS-15051.007.patch > RBF: Propose to revoke WRITE MountTableEntry privilege to super

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2019-12-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005115#comment-17005115 ] Xiaoqiao He commented on HDFS-15082: Hi [~ayushtkn], Thanks for your comments. This thought comes

[jira] [Commented] (HDFS-15051) RBF: Propose to revoke WRITE MountTableEntry privilege to super user only

2019-12-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004715#comment-17004715 ] Xiaoqiao He commented on HDFS-15051: Thanks [~ayushtkn], {quote}Give a check what is the scenario

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2019-12-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004700#comment-17004700 ] Xiaoqiao He commented on HDFS-15082: It is useless entry at router side if we add/update mount entry

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2019-12-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.001.patch Status: Patch Available (was: Open) submit patch v001 and

<    4   5   6   7   8   9   10   11   >