[jira] [Commented] (HDFS-16214) Lock optimization for large deleteing, no locks on the collection block

2022-01-19 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478505#comment-17478505 ] Yuxuan Wang commented on HDFS-16214: [~zhuxiangyi] I'm not read entirely but it looks similar to

[jira] [Updated] (HDFS-16284) Unboxing long value in old version's block report cause full GC

2021-10-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-16284: --- Description: When upgrade cluster from 2.6 to 3.1, namenode fall into full GC trouble. NN run 3.1

[jira] [Updated] (HDFS-16284) Unboxing long value in old version's block report cause full GC

2021-10-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-16284: --- Description: When upgrade cluster from 2.6 to 3.1, namenode fall into full GC trouble. NN run 3.1

[jira] [Created] (HDFS-16284) Unboxing long value in old version's block report cause full GC

2021-10-26 Thread Yuxuan Wang (Jira)
Yuxuan Wang created HDFS-16284: -- Summary: Unboxing long value in old version's block report cause full GC Key: HDFS-16284 URL: https://issues.apache.org/jira/browse/HDFS-16284 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15756) RBF: Cannot get updated delegation token from zookeeper

2021-04-15 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322581#comment-17322581 ] Yuxuan Wang commented on HDFS-15756: [~hexiaoqiao] As for Yarn, RM will renew token immediately when

[jira] [Commented] (HDFS-15756) [RBF] Cannot get updated delegation token from zookeeper

2020-12-30 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256860#comment-17256860 ] Yuxuan Wang commented on HDFS-15756: I modify the code let router throw StandbyException, so the

[jira] [Commented] (HDFS-15735) NameNode memory Leak on frequent execution of fsck

2020-12-17 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251445#comment-17251445 ] Yuxuan Wang commented on HDFS-15735: [~ayushtkn] I don't find any usage of tracer. Removing it is

[jira] [Created] (HDFS-15734) [READ] DirectoryScanner#scan need not check StorageType.PROVIDED

2020-12-17 Thread Yuxuan Wang (Jira)
Yuxuan Wang created HDFS-15734: -- Summary: [READ] DirectoryScanner#scan need not check StorageType.PROVIDED Key: HDFS-15734 URL: https://issues.apache.org/jira/browse/HDFS-15734 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2020-12-10 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247113#comment-17247113 ] Yuxuan Wang commented on HDFS-15383: [~fengnanli] Thx for your reply. Very clear explanation. > RBF:

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2020-12-09 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246982#comment-17246982 ] Yuxuan Wang commented on HDFS-15383: Hi ~ [~fengnanli][~elgoiri][~hexiaoqiao] After disable watcher,

[jira] [Commented] (HDFS-15486) Costly sendResponse operation slows down async editlog handling

2020-07-22 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163224#comment-17163224 ] Yuxuan Wang commented on HDFS-15486: {code:java|title=FSEditLogAsync.java} public void run() { ...

[jira] [Commented] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-19 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140277#comment-17140277 ] Yuxuan Wang commented on HDFS-15419: [~ayushtkn] Thanks for your reply. IIRC, now router will retry

[jira] [Commented] (HDFS-15419) RBF: Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-19 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140249#comment-17140249 ] Yuxuan Wang commented on HDFS-15419: [~bhji123] Well, I more agree with [~ayushtkn]. And I think we

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139351#comment-17139351 ] Yuxuan Wang commented on HDFS-15419: [~ayushtkn] But router will retry or failover once currently in

[jira] [Commented] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139275#comment-17139275 ] Yuxuan Wang commented on HDFS-15419: Hi~[~bhji123] If router retry more times and longer, but

[jira] [Assigned] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang reassigned HDFS-15419: -- Assignee: (was: Yuxuan Wang) > Router should retry communicate with NN when cluster is

[jira] [Assigned] (HDFS-15419) Router should retry communicate with NN when cluster is unavailable using configurable time interval

2020-06-18 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang reassigned HDFS-15419: -- Assignee: Yuxuan Wang > Router should retry communicate with NN when cluster is unavailable

[jira] [Commented] (HDFS-15021) RBF: Delegation Token can't remove correctly in absence of cancelToken and restart the router.

2019-11-28 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984716#comment-16984716 ] Yuxuan Wang commented on HDFS-15021: I think 

[jira] [Commented] (HDFS-14962) RBF: ConnectionPool#newConnection() error log wrong protocol class

2019-11-06 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968871#comment-16968871 ] Yuxuan Wang commented on HDFS-14962: Very *small* PR created. > RBF: ConnectionPool#newConnection()

[jira] [Created] (HDFS-14962) RBF: ConnectionPool#newConnection() error log wrong protocol class

2019-11-06 Thread Yuxuan Wang (Jira)
Yuxuan Wang created HDFS-14962: -- Summary: RBF: ConnectionPool#newConnection() error log wrong protocol class Key: HDFS-14962 URL: https://issues.apache.org/jira/browse/HDFS-14962 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-10-10 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948370#comment-16948370 ] Yuxuan Wang commented on HDFS-14509: I uploaded branch-2 patch. But I can't build it locally. Pls

[jira] [Updated] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-10-10 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14509: --- Attachment: HDFS-14509-branch-2.001.patch > DN throws InvalidToken due to inequality of password

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-10-07 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946443#comment-16946443 ] Yuxuan Wang commented on HDFS-14509: Sorry for delay it. I upload 003 patch. Feel free to take over

[jira] [Updated] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-10-07 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14509: --- Attachment: HDFS-14509-003.patch > DN throws InvalidToken due to inequality of password when upgrade

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940327#comment-16940327 ] Yuxuan Wang commented on HDFS-14509: [~ferhui] Oh, It's other approach can do, not my PR. > DN

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940326#comment-16940326 ] Yuxuan Wang commented on HDFS-14509: {quote} As for unit tests I think we need two that verifies the

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940277#comment-16940277 ] Yuxuan Wang commented on HDFS-14509: [~John Smith] If we add some fields in the future, we still need

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940266#comment-16940266 ] Yuxuan Wang commented on HDFS-14509: [~ferhui] If it's just for resolving upgrading from 2.x to 3.x,

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-29 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940253#comment-16940253 ] Yuxuan Wang commented on HDFS-14509: [~brahmareddy] Yes, existing cluster might need to update this

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-25 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938192#comment-16938192 ] Yuxuan Wang commented on HDFS-14509: OK, I'll update my PR later. Thanks for [~shv], [~vagarychen]'s

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-24 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937300#comment-16937300 ] Yuxuan Wang commented on HDFS-14509: [~shv] Thanks for your explanation! That's what I mean! If

[jira] [Commented] (HDFS-14853) NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is deleted

2019-09-19 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933463#comment-16933463 ] Yuxuan Wang commented on HDFS-14853: We should import .* in TestDFSNetworkTopology.java ? > NPE in

[jira] [Commented] (HDFS-14117) RBF: We can only delete the files or dirs of one subcluster in a cluster with multiple subclusters when trash is enabled

2019-09-16 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930414#comment-16930414 ] Yuxuan Wang commented on HDFS-14117: Hi [~elgoiri], [~xuzq_zander], [~ayushtkn]. Are you still

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-09-15 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930209#comment-16930209 ] Yuxuan Wang commented on HDFS-14509: [~ferhui] Client's version is unimportant, since client just

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-08-27 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917352#comment-16917352 ] Yuxuan Wang commented on HDFS-14509: [~shv], we don't have a conclusion here. But my solution need

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Attachment: HDFS-14772.004.patch > RBF: hdfs-rbf-site.xml can't be loaded automatically >

[jira] [Commented] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916267#comment-16916267 ] Yuxuan Wang commented on HDFS-14772: Fix checksytle, pending Jenkins. > RBF: hdfs-rbf-site.xml can't

[jira] [Commented] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915679#comment-16915679 ] Yuxuan Wang commented on HDFS-14772: [~tasanuma] OK, I submit a new patch. > RBF: hdfs-rbf-site.xml

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Attachment: HDFS-14772.003.patch > RBF: hdfs-rbf-site.xml can't be loaded automatically >

[jira] [Commented] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915499#comment-16915499 ] Yuxuan Wang commented on HDFS-14772: [~surendrasingh] [~tasanuma] [~elgoiri] Thanks for your

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-26 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Attachment: HDFS-14772.002.patch > RBF: hdfs-rbf-site.xml can't be loaded automatically >

[jira] [Updated] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14761: --- Status: Patch Available (was: In Progress) > RBF: MountTableResolver cannot invalidate cache

[jira] [Work started] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14772 started by Yuxuan Wang. -- > RBF: hdfs-rbf-site.xml can't be loaded automatically >

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Status: Patch Available (was: In Progress) > RBF: hdfs-rbf-site.xml can't be loaded automatically >

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Attachment: HDFS-14772.001.patch > RBF: hdfs-rbf-site.xml can't be loaded automatically >

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Description: ISSUE: hdfs-rbf-site.xml can't be loaded automatically WHY: Currently the code is

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Description: ISSUE: hdfs-rbf-site.xml can't be loaded automatically WHY: Currently the code is

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Description: ISSUE: hdfs-rbf-site.xml can't be loaded automatically WHY: Currently the code is

[jira] [Updated] (HDFS-14772) RBF: hdfs-rbf-site.xml can't be loaded automatically

2019-08-23 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14772: --- Description: ISSUE: hdfs-rbf-site.xml can't be loaded automatically WHY: Currently the code is

[jira] [Created] (HDFS-14772) RBF

2019-08-23 Thread Yuxuan Wang (Jira)
Yuxuan Wang created HDFS-14772: -- Summary: RBF Key: HDFS-14772 URL: https://issues.apache.org/jira/browse/HDFS-14772 Project: Hadoop HDFS Issue Type: Bug Components: rbf

[jira] [Work started] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-22 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-14761 started by Yuxuan Wang. -- > RBF: MountTableResolver cannot invalidate cache correctly >

[jira] [Commented] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-22 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913082#comment-16913082 ] Yuxuan Wang commented on HDFS-14761: Hi, [~wuweiwei], [~elgoiri]. I see you worked on *LocationCache*

[jira] [Commented] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-21 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911964#comment-16911964 ] Yuxuan Wang commented on HDFS-14761: [~zhangchen] Thanks for your comment. My bad. I'll attach a

[jira] [Updated] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-20 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14761: --- Description: STEPS TO REPRODUCE: add mount table entry 1->/

[jira] [Assigned] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-20 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang reassigned HDFS-14761: -- Assignee: Yuxuan Wang > RBF: MountTableResolver cannot invalidate cache correctly >

[jira] [Commented] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-20 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911912#comment-16911912 ] Yuxuan Wang commented on HDFS-14761: Attach a UT patch that can reproduce the issue. > RBF:

[jira] [Updated] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-20 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14761: --- Attachment: draft-reproduce-patch-HDFS-14761.patch > RBF: MountTableResolver cannot invalidate cache

[jira] [Created] (HDFS-14761) RBF: MountTableResolver cannot invalidate cache correctly

2019-08-20 Thread Yuxuan Wang (Jira)
Yuxuan Wang created HDFS-14761: -- Summary: RBF: MountTableResolver cannot invalidate cache correctly Key: HDFS-14761 URL: https://issues.apache.org/jira/browse/HDFS-14761 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-14756) RBF: getQuotaUsage may ignore some folders

2019-08-20 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911890#comment-16911890 ] Yuxuan Wang edited comment on HDFS-14756 at 8/21/19 2:24 AM: - I find it other

[jira] [Commented] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

2019-08-20 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911105#comment-16911105 ] Yuxuan Wang commented on HDFS-13596: [~aajisaka] Additionally, you can check HDFS-8432 > NN restart

[jira] [Commented] (HDFS-14396) Failed to load image from FSImageFile when downgrade from 3.x to 2.x

2019-08-19 Thread Yuxuan Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910978#comment-16910978 ] Yuxuan Wang commented on HDFS-14396: [~jojochuang] With HDFS-13596 , NN will not accept EC operation

[jira] [Resolved] (HDFS-14551) NN throws NPE if downgrade it during rolling upgrade from 3.x to 2.x

2019-08-19 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang resolved HDFS-14551. Resolution: Duplicate > NN throws NPE if downgrade it during rolling upgrade from 3.x to 2.x >

[jira] [Commented] (HDFS-14710) RBF: Improve some RPC performances

2019-08-12 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905170#comment-16905170 ] Yuxuan Wang commented on HDFS-14710: Before the patch, if I change/add a mount table entry which

[jira] [Commented] (HDFS-14654) RBF: TestRouterRpc tests are flaky

2019-08-12 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905153#comment-16905153 ] Yuxuan Wang commented on HDFS-14654: {code:title=MockResolver.java|borderStyle=solid} public

[jira] [Commented] (HDFS-14674) Got an unexpected txid when tail editlog

2019-07-31 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896844#comment-16896844 ] Yuxuan Wang commented on HDFS-14674: I find the same problem after HDFS-12978. The fix looks good. >

[jira] [Commented] (HDFS-14396) Failed to load image from FSImageFile when downgrade from 3.x to 2.x

2019-07-30 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895893#comment-16895893 ] Yuxuan Wang commented on HDFS-14396: It looks great! I create HDFS-14551 doing the same thing as you

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-07-22 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890619#comment-16890619 ] Yuxuan Wang commented on HDFS-14509: [~xkrogen], I've tested upgrading/downgrading between 2.x and

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-07-18 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888533#comment-16888533 ] Yuxuan Wang commented on HDFS-14509: I've created an PR about my thoughts. > DN throws InvalidToken

[jira] [Commented] (HDFS-14551) NN throws NPE if downgrade it during rolling upgrade from 3.x to 2.x

2019-07-18 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888494#comment-16888494 ] Yuxuan Wang commented on HDFS-14551: I have created a PR. And we need backport it to 2.x which we

[jira] [Commented] (HDFS-14562) The behaviour of getContentSummaryInt() in getQuotaUsage() should be configurable.

2019-06-13 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862769#comment-16862769 ] Yuxuan Wang commented on HDFS-14562: Hi, [~LiJinglun] I think it shouldn't be removed for

[jira] [Commented] (HDFS-14551) NN throws NPE if downgrade it during rolling upgrade from 3.x to 2.x

2019-06-06 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857603#comment-16857603 ] Yuxuan Wang commented on HDFS-14551: I can attach a patch if anyone agree with me. > NN throws NPE

[jira] [Created] (HDFS-14551) NN throws NPE if downgrade it during rolling upgrade from 3.x to 2.x

2019-06-06 Thread Yuxuan Wang (JIRA)
Yuxuan Wang created HDFS-14551: -- Summary: NN throws NPE if downgrade it during rolling upgrade from 3.x to 2.x Key: HDFS-14551 URL: https://issues.apache.org/jira/browse/HDFS-14551 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-06-06 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857500#comment-16857500 ] Yuxuan Wang commented on HDFS-14509: Hi, [~brahmareddy]. If I add codes to

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-05-23 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847190#comment-16847190 ] Yuxuan Wang commented on HDFS-14509: Hi~, [~kihwal] [~brahmareddy], thanks for comment. It's the same

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-05-23 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846697#comment-16846697 ] Yuxuan Wang commented on HDFS-14509: Anyone can take a look? It's a bug or just I miss something? >

[jira] [Created] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-05-23 Thread Yuxuan Wang (JIRA)
Yuxuan Wang created HDFS-14509: -- Summary: DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x Key: HDFS-14509 URL: https://issues.apache.org/jira/browse/HDFS-14509 Project:

[jira] [Commented] (HDFS-14134) Idempotent operations throwing RemoteException should not be retried by the client

2019-05-06 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834323#comment-16834323 ] Yuxuan Wang commented on HDFS-14134: Hi [~lukmajercak]. No. I just figure that {{StandbyException}}

[jira] [Commented] (HDFS-14134) Idempotent operations throwing RemoteException should not be retried by the client

2019-04-28 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828886#comment-16828886 ] Yuxuan Wang commented on HDFS-14134: Hello, anyone is working on this? I find a bug in

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-12 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719732#comment-16719732 ] Yuxuan Wang commented on HDFS-14088: HDFS-14088.006.patch fix whitespace >

[jira] [Updated] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-12 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14088: --- Attachment: HDFS-14088.006.patch > RequestHedgingProxyProvider can throw NullPointerException when

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-12 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719652#comment-16719652 ] Yuxuan Wang commented on HDFS-14088: Thanks [~elgoiri] for reviewing. A new patch

[jira] [Updated] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-12 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14088: --- Attachment: HDFS-14088.005.patch > RequestHedgingProxyProvider can throw NullPointerException when

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-11 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716799#comment-16716799 ] Yuxuan Wang commented on HDFS-14088: A new patch HDFS-14088.004.patch attached. Use

[jira] [Updated] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-12-11 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14088: --- Attachment: HDFS-14088.004.patch > RequestHedgingProxyProvider can throw NullPointerException when

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-11-26 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16698660#comment-16698660 ] Yuxuan Wang commented on HDFS-14088: Hi, [~elgoiri] Thanks for comment. I modify the UT, and add

[jira] [Updated] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-11-26 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14088: --- Attachment: HDFS-14088.003.patch > RequestHedgingProxyProvider can throw NullPointerException when

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-11-20 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694217#comment-16694217 ] Yuxuan Wang commented on HDFS-14088: Thanks Íñigo Goiri for reviewing. Here's a new patch

[jira] [Updated] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-11-20 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14088: --- Attachment: HDFS-14088.002.patch > RequestHedgingProxyProvider can throw NullPointerException when

[jira] [Updated] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failover due to no lock on currentUsedProxy

2018-11-20 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxuan Wang updated HDFS-14088: --- Attachment: HDFS-14088.001.patch > RequestHedgingProxyProvider can throw NullPointerException when

[jira] [Commented] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failvoer due to no lock on currentUsedProxy

2018-11-19 Thread Yuxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16691488#comment-16691488 ] Yuxuan Wang commented on HDFS-14088: I'll attach a patch later. > RequestHedgingProxyProvider can

[jira] [Created] (HDFS-14088) RequestHedgingProxyProvider can throw NullPointerException when failvoer due to no lock on currentUsedProxy

2018-11-19 Thread Yuxuan Wang (JIRA)
Yuxuan Wang created HDFS-14088: -- Summary: RequestHedgingProxyProvider can throw NullPointerException when failvoer due to no lock on currentUsedProxy Key: HDFS-14088 URL: