[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-09-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940674#comment-16940674 ] Xiaoqiao He commented on HDFS-14775: Thanks [~zhangchen] for your works. This improve

[jira] [Created] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-09-30 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-14882: -- Summary: Consider DataNode load when #getBlockLocation Key: HDFS-14882 URL: https://issues.apache.org/jira/browse/HDFS-14882 Project: Hadoop HDFS Issue Type: Imp

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-09-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.001.patch Status: Patch Available (was: Open) submit demo patch and t

[jira] [Commented] (HDFS-14305) Serial number in BlockTokenSecretManager could overlap between different namenodes

2019-10-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941654#comment-16941654 ] Xiaoqiao He commented on HDFS-14305: Thanks [~shv],[~vagarychen] for your explains. i

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941748#comment-16941748 ] Xiaoqiao He commented on HDFS-14882: [~lukmajercak], Thanks for your comments. This t

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2019-10-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941859#comment-16941859 ] Xiaoqiao He commented on HDFS-14498: Thank [~leigh.jo...@ripjar.com] for your report.

[jira] [Commented] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2020-05-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099603#comment-17099603 ] Xiaoqiao He commented on HDFS-15273: Hi [~weichiu], there are a different set of test

[jira] [Commented] (HDFS-15310) RBF: Not proxy client's clientId and callId caused RetryCache invalid in NameNode.

2020-05-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099643#comment-17099643 ] Xiaoqiao He commented on HDFS-15310: Thanks [~ayushtkn] for re-launching this discuss

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.006.patch > Standby NameNode process getBlocks request to reduce Active load >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108132#comment-17108132 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your comments. {quote}does

[jira] [Created] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15356: -- Summary: Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys Key: HDFS-15356 URL: https://issues.apache.org/jira/browse/HDFS-15356 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15356: --- Attachment: HDFS-15356.001.patch Status: Patch Available (was: Open) submit init v001 and tr

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108339#comment-17108339 ] Xiaoqiao He commented on HDFS-15356: Hi [~ayushtkn], This is introduced by HDFS-2693

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15356: --- Attachment: HDFS-15356.002.patch > Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys >

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108355#comment-17108355 ] Xiaoqiao He commented on HDFS-15356: Thanks [~ayushtkn], v002 try to fix checkstyle.

[jira] [Updated] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15356: --- Attachment: HDFS-15356.003.patch > Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys >

[jira] [Commented] (HDFS-15356) Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108876#comment-17108876 ] Xiaoqiao He commented on HDFS-15356: Thanks [~ayushtkn], v003 try to fix the missing

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108881#comment-17108881 ] Xiaoqiao He commented on HDFS-13183: Try to run failed unit test at local, both of th

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109076#comment-17109076 ] Xiaoqiao He commented on HDFS-15082: Thanks [~ayushtkn] and [~elgoiri]. v004 try to s

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.004.patch > RBF: Check each component length of destination path when add/upda

[jira] [Updated] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15082: --- Attachment: HDFS-15082.005.patch > RBF: Check each component length of destination path when add/upda

[jira] [Commented] (HDFS-15082) RBF: Check each component length of destination path when add/update mount entry

2020-05-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109120#comment-17109120 ] Xiaoqiao He commented on HDFS-15082: v005 try to fix checkstyle and trigger yetus aga

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.007.patch > Standby NameNode process getBlocks request to reduce Active load >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17109826#comment-17109826 ] Xiaoqiao He commented on HDFS-13183: code rebase and trigger yetus again. > Standby

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110422#comment-17110422 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your helps and push this f

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110431#comment-17110431 ] Xiaoqiao He commented on HDFS-15202: [^HDFS-15202-Addendum-01.patch] works fine for m

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110450#comment-17110450 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] for your reminder here. branch

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110846#comment-17110846 ] Xiaoqiao He commented on HDFS-14960: [~elgoiri] IMO, it could be related to the first

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits > --

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1770#comment-1770 ] Xiaoqiao He commented on HDFS-12733: Hi [~ayushtkn] [~elgoiri], [^HDFS-12733.009.pat

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: (was: HDFS-12733.009.patch) > Option to disable to namenode local edits > ---

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits > --

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111707#comment-17111707 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] and [~Jim_Brennan] for your re

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111722#comment-17111722 ] Xiaoqiao He commented on HDFS-15280: Thanks [~weichiu] involve me here. [~hadoop_yang

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111744#comment-17111744 ] Xiaoqiao He commented on HDFS-13183: Hi [~weichiu],[~Jim_Brennan] I am sure the faile

[jira] [Reopened] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HDFS-13183: > Standby NameNode process getBlocks request to reduce Active load > --

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.addendum.patch Status: Patch Available (was: Reopened) [~weichiu],[~J

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.addendum.patch > Standby NameNode process getBlocks request to reduce Active l

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: (was: HDFS-13183.addendum.patch) > Standby NameNode process getBlocks request to redu

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-13183: --- Attachment: HDFS-13183.addendum.patch > Standby NameNode process getBlocks request to reduce Active l

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112463#comment-17112463 ] Xiaoqiao He commented on HDFS-13183: Thanks [~Jim_Brennan] for your information. I th

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112468#comment-17112468 ] Xiaoqiao He commented on HDFS-15280: Hi [~hadoop_yangyun], I will close this JIRA if

[jira] [Updated] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15280: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) > Datanode delay random time t

[jira] [Commented] (HDFS-15366) Active NameNode went down with NPE

2020-05-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112485#comment-17112485 ] Xiaoqiao He commented on HDFS-15366: HDFS-12832 could solve this issue. The root caus

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112857#comment-17112857 ] Xiaoqiao He commented on HDFS-13183: After dig deep about BalancerWithObserver, the r

[jira] [Created] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15368: -- Summary: TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally Key: HDFS-15368 URL: https://issues.apache.org/jira/browse/HDFS-15368 Project: Hadoop HD

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15368: --- Attachment: HDFS-15368.001.patch Status: Patch Available (was: Open) submit demo patch and t

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15368: --- Attachment: TestBalancerWithHANameNodes.testBalancerObserver.log > TestBalancerWithHANameNodes#testBa

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113748#comment-17113748 ] Xiaoqiao He commented on HDFS-15368: Thanks [~vagarychen] for your information, it is

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114287#comment-17114287 ] Xiaoqiao He commented on HDFS-15368: Thanks [~vagarychen], I try to revert a3f44dacc1

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15368: --- Attachment: HDFS-15368.002.patch > TestBalancerWithHANameNodes#testBalancerWithObserver failed occasi

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115332#comment-17115332 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your information. Just ch

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17115791#comment-17115791 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your confirm. Sorry not a

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-05-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116541#comment-17116541 ] Xiaoqiao He commented on HDFS-15180: [~sodonnell],[~weichiu],[~junping_du] are you in

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118784#comment-17118784 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn], TestDecommissionWithBackoff

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118797#comment-17118797 ] Xiaoqiao He commented on HDFS-15180: Thanks [~sodonnell] for your positive feedback.

[jira] [Commented] (HDFS-15366) Active NameNode went down with NPE

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118831#comment-17118831 ] Xiaoqiao He commented on HDFS-15366: [~saruntek] Please help to check if HDFS-12832 c

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17118835#comment-17118835 ] Xiaoqiao He commented on HDFS-15368: Thanks [~ayushtkn] for your help and review to f

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123392#comment-17123392 ] Xiaoqiao He commented on HDFS-15382: Thanks [~Aiphag0] for your proposal here. The pe

[jira] [Commented] (HDFS-15390) client fails forever when namenode ipaddr changed

2020-06-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17127894#comment-17127894 ] Xiaoqiao He commented on HDFS-15390: [~seanlook], It is great catch here. Some nits,

[jira] [Updated] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

2020-06-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15273: --- Attachment: HDFS-15273.001.patch Status: Patch Available (was: Open) submit demo patch and t

[jira] [Created] (HDFS-15397) Blocks recovery could overwhelm KDC when using Kerberos for authentication

2020-06-08 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15397: -- Summary: Blocks recovery could overwhelm KDC when using Kerberos for authentication Key: HDFS-15397 URL: https://issues.apache.org/jira/browse/HDFS-15397 Project: Hadoop

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-06-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17132544#comment-17132544 ] Xiaoqiao He commented on HDFS-12733: Thanks [~ayushtkn] for your reviews. {quote}This

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133315#comment-17133315 ] Xiaoqiao He commented on HDFS-15391: Hi [~haiyang Hu], Do you enable AsyncEditlog fea

[jira] [Assigned] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-06-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15175: -- Assignee: Wan Chang (was: Yicong Cai) > Multiple CloseOp shared block instance causes the sta

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-06-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135675#comment-17135675 ] Xiaoqiao He commented on HDFS-15175: Add [~wanchang] as contributor and assign this i

[jira] [Commented] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135683#comment-17135683 ] Xiaoqiao He commented on HDFS-15391: This issue is duplicated by HDFS-15175, will clo

[jira] [Resolved] (HDFS-15391) Standby NameNode due loads the corruption edit log, the service exits and cannot be restarted

2020-06-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15391. Resolution: Duplicate > Standby NameNode due loads the corruption edit log, the service exits and

[jira] [Comment Edited] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-06-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135675#comment-17135675 ] Xiaoqiao He edited comment on HDFS-15175 at 6/15/20, 9:42 AM: -

[jira] [Comment Edited] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-06-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135675#comment-17135675 ] Xiaoqiao He edited comment on HDFS-15175 at 6/15/20, 9:43 AM: -

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2020-06-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135722#comment-17135722 ] Xiaoqiao He commented on HDFS-15175: Thanks [~wanchang] for the patch. It is almost L

[jira] [Commented] (HDFS-15105) Standby NN exits and fails to restart due to edit log corruption

2020-06-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146036#comment-17146036 ] Xiaoqiao He commented on HDFS-15105: [~Tao Yang] Do you enable async editlog feature,

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17148723#comment-17148723 ] Xiaoqiao He commented on HDFS-15448: Thanks [~jianghuazhu], Good catch here. v001 alm

[jira] [Comment Edited] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17148723#comment-17148723 ] Xiaoqiao He edited comment on HDFS-15448 at 6/30/20, 2:24 PM: -

[jira] [Commented] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17148729#comment-17148729 ] Xiaoqiao He commented on HDFS-15416: LGTM, +1 on v001. Thanks [~jianghuazhu] for your

[jira] [Commented] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17148731#comment-17148731 ] Xiaoqiao He commented on HDFS-15416: BTW, it is better to trace or review for partici

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149091#comment-17149091 ] Xiaoqiao He commented on HDFS-15448: {quote}whether your suggestion is to increase sy

[jira] [Updated] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15416: --- Component/s: datanode Fix Version/s: 3.4.0 Affects Version/s: (was: 3.1.1)

[jira] [Updated] (HDFS-15416) Improve DataStorage#addStorageLocations() for empty locations

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15416: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) com

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-06-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149152#comment-17149152 ] Xiaoqiao He commented on HDFS-15448: Ping [~weichiu],[~elgoiri],[~linyiqun], would yo

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-07-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149897#comment-17149897 ] Xiaoqiao He commented on HDFS-15448: Hi [~linyiqun], As [~jianghuazhu] mentioned abo

[jira] [Resolved] (HDFS-15451) Restarting name node stuck in safe mode when using provided storage

2020-07-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15451. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Thanks [~shanyu] for your

[jira] [Commented] (HDFS-15425) Review Logging of DFSClient

2020-07-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152149#comment-17152149 ] Xiaoqiao He commented on HDFS-15425: LGTM. +1 on [^HDFS-15425.003.patch]. will commit

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152196#comment-17152196 ] Xiaoqiao He commented on HDFS-14498: [~sodonnell] thanks for your deep dig of this is

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152228#comment-17152228 ] Xiaoqiao He commented on HDFS-14498: Thanks [~sodonnell] for your quick response. {qu

[jira] [Updated] (HDFS-15451) Restarting name node stuck in safe mode when using provided storage

2020-07-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15451: --- Fix Version/s: 3.1.5 3.3.1 3.2.2 > Restarting name node stuck i

[jira] [Updated] (HDFS-15451) Restarting name node stuck in safe mode when using provided storage

2020-07-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15451: --- Affects Version/s: (was: 3.1.3) (was: 3.2.1) > Restarting name node st

[jira] [Commented] (HDFS-15451) Restarting name node stuck in safe mode when using provided storage

2020-07-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152470#comment-17152470 ] Xiaoqiao He commented on HDFS-15451: cherrypick to branch-3.3, branch-3.2 and branch-

[jira] [Updated] (HDFS-15425) Review Logging of DFSClient

2020-07-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15425: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15425) Review Logging of DFSClient

2020-07-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15425: --- Component/s: dfsclient > Review Logging of DFSClient > --- > >

[jira] [Commented] (HDFS-15448) When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-07-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153311#comment-17153311 ] Xiaoqiao He commented on HDFS-15448: LGTM, +1 for [^HDFS-15448.003.patch]. > When st

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153702#comment-17153702 ] Xiaoqiao He commented on HDFS-14498: Thanks [~sodonnell]. [^HDFS-14498.001.patch] LGT

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154161#comment-17154161 ] Xiaoqiao He commented on HDFS-14498: [^HDFS-14498.002.patch] LGTM, +1 from my side.

[jira] [Commented] (HDFS-15452) Dynamically initialize the capacity of BlocksMap

2020-07-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154314#comment-17154314 ] Xiaoqiao He commented on HDFS-15452: Thanks involve me here. Sorry I don't get what i

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155075#comment-17155075 ] Xiaoqiao He commented on HDFS-14498: Hi [~weichiu] and every watchers, Any other revi

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156474#comment-17156474 ] Xiaoqiao He commented on HDFS-14498: Thanks [~sodonnell] for your double checks. Will

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14498: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14498: --- Fix Version/s: 3.1.5 3.3.1 2.10.1 3.2.2 > Le

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156513#comment-17156513 ] Xiaoqiao He commented on HDFS-14498: cherry-pick to branches 3.3/3.2/3.1/2.10. > Lea

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14498: --- Fix Version/s: (was: 2.10.1) > LeaseManager can loop forever on the file for which create has fai

<    1   2   3   4   5   6   7   8   9   10   >