[jira] [Commented] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196006#comment-17196006 ] Fei Hui commented on HDFS-15576: Change the caption and upload v002 patch > Erasure Coding: Add rs and

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Description: * Add rs and rs-legacy codec test for TestErasureCodingCLI * Add comments for failed test RS *

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Attachment: HDFS-15576.002.patch > Erasure Coding: Add rs and rs-legacy codec test for addPolicies >

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Description: * Add rs and rs-legacy codec test for TestErasureCodingCLI * Add comments for failed test *

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Summary: Erasure Coding: Add rs and rs-legacy codec test for addPolicies (was: Erasure Coding: Add rs &

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs & rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Summary: Erasure Coding: Add rs & rs-legacy codec test for addPolicies (was: Erasure Coding: Add test

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195973#comment-17195973 ] Fei Hui commented on HDFS-15576: [~tasanuma] Thanks a lot, get it! Will try it with your suggestions In

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195906#comment-17195906 ] Fei Hui commented on HDFS-15576: Failed Tests are unrelated. [~hexiaoqiao][~weichiu] [~aajisaka] Could

[jira] [Updated] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-14 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Summary: Erasure Coding: Add test addPolicies to ECAdmin (was: Add test addPolicies to ECAdmin) > Erasure

[jira] [Updated] (HDFS-15576) Add test addPolicies to ECAdmin

2020-09-14 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Attachment: HDFS-15576.001.patch > Add test addPolicies to ECAdmin > --- > >

[jira] [Updated] (HDFS-15576) Add test addPolicies to ECAdmin

2020-09-14 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Status: Patch Available (was: Open) > Add test addPolicies to ECAdmin > --- > >

[jira] [Created] (HDFS-15576) Add test addPolicies to ECAdmin

2020-09-14 Thread Fei Hui (Jira)
Fei Hui created HDFS-15576: -- Summary: Add test addPolicies to ECAdmin Key: HDFS-15576 URL: https://issues.apache.org/jira/browse/HDFS-15576 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-15564) Add Test annotation for TestPersistBlocks#testRestartDfsWithSync

2020-09-11 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194233#comment-17194233 ] Fei Hui commented on HDFS-15564: [~hexiaoqiao] Could you please help to commit it? Thanks > Add Test

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2020-09-10 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193397#comment-17193397 ] Fei Hui commented on HDFS-13293: [~aajisaka][~elgoiri] I think maybe we need to do three things. * File a

[jira] [Commented] (HDFS-15556) Fix NPE in DatanodeDescriptor#updateStorageStats when handle DN Lifeline

2020-09-09 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193291#comment-17193291 ] Fei Hui commented on HDFS-15556: [~haiyang Hu] It's the same as HDFS-14042, Should we resolve this issue

[jira] [Updated] (HDFS-15564) Add Test annotation for TestPersistBlocks#testRestartDfsWithSync

2020-09-09 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15564: --- Status: Patch Available (was: Open) > Add Test annotation for TestPersistBlocks#testRestartDfsWithSync >

[jira] [Updated] (HDFS-15564) Add Test annotation for TestPersistBlocks#testRestartDfsWithSync

2020-09-09 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15564: --- Attachment: HDFS-15564.001.patch > Add Test annotation for TestPersistBlocks#testRestartDfsWithSync >

[jira] [Created] (HDFS-15564) Add Test annotation for TestPersistBlocks#testRestartDfsWithSync

2020-09-09 Thread Fei Hui (Jira)
Fei Hui created HDFS-15564: -- Summary: Add Test annotation for TestPersistBlocks#testRestartDfsWithSync Key: HDFS-15564 URL: https://issues.apache.org/jira/browse/HDFS-15564 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer

2020-09-09 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192646#comment-17192646 ] Fei Hui commented on HDFS-13293: [~aajisaka][~elgoiri] Thanks for bringing this up again. If we are in

[jira] [Commented] (HDFS-14351) RBF: Optimize configuration item resolving for monitor namenode

2020-09-03 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17189992#comment-17189992 ] Fei Hui commented on HDFS-14351: Maybe it's helpful that backport it to other 3.x branches. Thanks >

[jira] [Commented] (HDFS-15540) Directories protected from delete can still be moved to the trash

2020-08-26 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185532#comment-17185532 ] Fei Hui commented on HDFS-15540: [~sodonnell] Good catch! It looks good! > Directories protected from

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: HDFS-14852.007.patch > Remove of LowRedundancyBlocks do NOT remove the block from all queues >

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182659#comment-17182659 ] Fei Hui commented on HDFS-14852: [~hexiaoqiao] Thanks for review, Forget to remove original code. Upload

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-21 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17181844#comment-17181844 ] Fei Hui commented on HDFS-14852: Failed Tests are unrelated > Remove of LowRedundancyBlocks do NOT

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-19 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180967#comment-17180967 ] Fei Hui commented on HDFS-14852: [~sodonnell] Upload v006 patch with your suggestion, Please review >

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-19 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: HDFS-14852.006.patch > Remove of LowRedundancyBlocks do NOT remove the block from all queues >

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-19 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180485#comment-17180485 ] Fei Hui commented on HDFS-14852: [~sodonnell] [~kihwal] Can we move forward and fix this issue? > Remove

[jira] [Commented] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

2020-08-19 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17180482#comment-17180482 ] Fei Hui commented on HDFS-15422: [~kihwal] Thanks for reporting and the fix. Can we push this fix to

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-08-18 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179393#comment-17179393 ] Fei Hui commented on HDFS-15240: [~marvelrock] Fail to apply your patch on trunk branch. Could you please

[jira] [Updated] (HDFS-15514) Remove useless dfs.webhdfs.enabled

2020-08-06 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15514: --- Affects Version/s: 3.0.3 3.3.0 3.2.1

[jira] [Updated] (HDFS-15514) Remove useless dfs.webhdfs.enabled

2020-08-06 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15514: --- Priority: Minor (was: Major) > Remove useless dfs.webhdfs.enabled > -- > >

[jira] [Commented] (HDFS-15514) Remove useless dfs.webhdfs.enabled

2020-08-06 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172131#comment-17172131 ] Fei Hui commented on HDFS-15514: [~aajisaka][~ayushtkn] Could you please take a look? Thanks > Remove

[jira] [Updated] (HDFS-15514) Remove useless dfs.webhdfs.enabled

2020-08-05 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15514: --- Status: Patch Available (was: Open) > Remove useless dfs.webhdfs.enabled >

[jira] [Updated] (HDFS-15514) Remove useless dfs.webhdfs.enabled

2020-08-05 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15514: --- Attachment: HDFS-15514.001.patch > Remove useless dfs.webhdfs.enabled > -- >

[jira] [Created] (HDFS-15514) Remove useless dfs.webhdfs.enabled

2020-08-05 Thread Fei Hui (Jira)
Fei Hui created HDFS-15514: -- Summary: Remove useless dfs.webhdfs.enabled Key: HDFS-15514 URL: https://issues.apache.org/jira/browse/HDFS-15514 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

2020-07-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163518#comment-17163518 ] Fei Hui commented on HDFS-13596: [~fengwu99] You are right! Failed is related to HDFS-8791. > NN

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2020-04-08 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078329#comment-17078329 ] Fei Hui commented on HDFS-15079: Upload workaround patch. * use RetryCache of NN * Call maybe fail when

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2020-04-08 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Attachment: HDFS-15079.002.patch > RBF: Client maybe get an unexpected result with network anomaly >

[jira] [Updated] (HDFS-15084) RBF: Remove useless param nsId in RouterRpcClient#getConnection

2020-04-05 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15084: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) > RBF: Remove useless param nsId in

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-03-26 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067682#comment-17067682 ] Fei Hui commented on HDFS-15240: [~marvelrock] Good Catch ! Thanks for reporting and fixing. Could you

[jira] [Commented] (HDFS-15223) FSCK fails if one namenode is not available

2020-03-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059972#comment-17059972 ] Fei Hui commented on HDFS-15223: [~ayushtkn] Thanks for reporting and fixing. +1 > FSCK fails if one

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046298#comment-17046298 ] Fei Hui commented on HDFS-15186: +1 for HDFS-15186.005.patch. Failed tests are unrelated. > Erasure

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044123#comment-17044123 ] Fei Hui commented on HDFS-15186: [~yaoguangdong] Thanks for your patch HDFS-15186.002.patch the whole fix

[jira] [Comment Edited] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-22 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042780#comment-17042780 ] Fei Hui edited comment on HDFS-15186 at 2/23/20 2:52 AM: - [~yaoguangdong]Thanks

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

2020-02-22 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042780#comment-17042780 ] Fei Hui commented on HDFS-15186: [~yaoguangdong]Thanks for reporting this !Good Catch! Sorry for late, I

[jira] [Commented] (HDFS-15092) TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed

2020-01-20 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019445#comment-17019445 ] Fei Hui commented on HDFS-15092: [~surendrasingh][~elgoiri] Could you please take a look?Thannks >

[jira] [Commented] (HDFS-15092) TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed

2020-01-19 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019195#comment-17019195 ] Fei Hui commented on HDFS-15092: Sorry for late Upload v002 patch >

[jira] [Updated] (HDFS-15092) TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed

2020-01-19 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15092: --- Attachment: HDFS-15092.002.patch > TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes

[jira] [Commented] (HDFS-15084) RBF: Remove useless param nsId in RouterRpcClient#getConnection

2020-01-06 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008726#comment-17008726 ] Fei Hui commented on HDFS-15084: [~surendrasingh] HDFS-13522 are there any progress? Useless code is

[jira] [Updated] (HDFS-15092) TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed

2020-01-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15092: --- Status: Patch Available (was: Open) > TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock

[jira] [Commented] (HDFS-15092) TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed

2020-01-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006532#comment-17006532 ] Fei Hui commented on HDFS-15092: [~surendrasingh] Could you please take a look? I see you add this UT >

[jira] [Updated] (HDFS-15092) TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed

2020-01-01 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15092: --- Attachment: HDFS-15092.001.patch > TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes

[jira] [Created] (HDFS-15092) TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed

2020-01-01 Thread Fei Hui (Jira)
Fei Hui created HDFS-15092: -- Summary: TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes failed Key: HDFS-15092 URL: https://issues.apache.org/jira/browse/HDFS-15092 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Attachment: HDFS-15079.001.patch > RBF: Client maybe get an unexpected result with network anomaly >

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Attachment: (was: HDFS-15079.001.patch) > RBF: Client maybe get an unexpected result with network

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Attachment: HDFS-15079.001.patch > RBF: Client maybe get an unexpected result with network anomaly >

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Attachment: (was: HDFS-15079.001.patch) > RBF: Client maybe get an unexpected result with network

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-30 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Status: Patch Available (was: Open) > RBF: Client maybe get an unexpected result with network anomaly >

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-30 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005301#comment-17005301 ] Fei Hui commented on HDFS-15079: Upoad rough fix. I think maybe CallerContext is suitable here. If we

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-30 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Attachment: HDFS-15079.001.patch > RBF: Client maybe get an unexpected result with network anomaly >

[jira] [Commented] (HDFS-15084) RBF: Remove useless param nsId in RouterRpcClient#getConnection

2019-12-30 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005235#comment-17005235 ] Fei Hui commented on HDFS-15084: [~ayushtkn] [~weichiu] could you please have a look ? Thanks > RBF:

[jira] [Commented] (HDFS-15085) Erasure Coding: some ORC data can not be recovery when partial DataNodes are shut down

2019-12-30 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005191#comment-17005191 ] Fei Hui commented on HDFS-15085: [~zhangbutao] Thanks for reporting this. Could you please give more

[jira] [Updated] (HDFS-15084) RBF: Remove useless param nsId in RouterRpcClient#getConnection

2019-12-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15084: --- Attachment: HDFS-15084.001.patch > RBF: Remove useless param nsId in RouterRpcClient#getConnection >

[jira] [Updated] (HDFS-15084) RBF: Remove useless param nsId in RouterRpcClient#getConnection

2019-12-29 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15084: --- Status: Patch Available (was: Open) > RBF: Remove useless param nsId in RouterRpcClient#getConnection >

[jira] [Created] (HDFS-15084) RBF: Remove useless param nsId in RouterRpcClient#getConnection

2019-12-29 Thread Fei Hui (Jira)
Fei Hui created HDFS-15084: -- Summary: RBF: Remove useless param nsId in RouterRpcClient#getConnection Key: HDFS-15084 URL: https://issues.apache.org/jira/browse/HDFS-15084 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15081: --- Environment: (was: x) > Typo in RetryCache#waitForCompletion annotation >

[jira] [Updated] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15081: --- Status: Patch Available (was: Open) > Typo in RetryCache#waitForCompletion annotation >

[jira] [Updated] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15081: --- Environment: x (was: Typo in RetryCache#waitForCompletion annotation {code} // Previous request has failed,

[jira] [Updated] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15081: --- Description: H > Typo in RetryCache#waitForCompletion annotation >

[jira] [Updated] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15081: --- Description: Typo in RetryCache#waitForCompletion annotation {code} // Previous request has failed, the

[jira] [Updated] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15081: --- Attachment: HDFS-15081.001.patch > Typo in RetryCache#waitForCompletion annotation >

[jira] [Commented] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004006#comment-17004006 ] Fei Hui commented on HDFS-15081: Upload simple fix > Typo in RetryCache#waitForCompletion annotation >

[jira] [Created] (HDFS-15081) Typo in RetryCache#waitForCompletion annotation

2019-12-27 Thread Fei Hui (Jira)
Fei Hui created HDFS-15081: -- Summary: Typo in RetryCache#waitForCompletion annotation Key: HDFS-15081 URL: https://issues.apache.org/jira/browse/HDFS-15081 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-26 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003619#comment-17003619 ] Fei Hui commented on HDFS-15079: Thanks [~hexiaoqiao] {quote} ClientId & CallId of request from Router

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-25 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003430#comment-17003430 ] Fei Hui commented on HDFS-15079: [~ayushtkn] {quote} The namenode Logic that you tend to add, that kind

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-25 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003264#comment-17003264 ] Fei Hui commented on HDFS-15078: [~elgoiri] {quote} Can we try to do it as an exception handling instead

[jira] [Comment Edited] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-25 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003233#comment-17003233 ] Fei Hui edited comment on HDFS-15079 at 12/25/19 11:40 AM: ---

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-25 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003233#comment-17003233 ] Fei Hui commented on HDFS-15079: [~ayushtkn][~elgoiri]Upload a overwrite UT, similar to HDFS-15078 >

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-25 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Attachment: UnexpectedOverWriteUT.patch > RBF: Client maybe get an unexpected result with network anomaly >

[jira] [Comment Edited] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-25 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003153#comment-17003153 ] Fei Hui edited comment on HDFS-15079 at 12/25/19 9:09 AM: -- [~elgoiri] HDFS-15078

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-25 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003153#comment-17003153 ] Fei Hui commented on HDFS-15079: [~elgoiri] HDFS-15078 has a test case, it's one case for this.

[jira] [Comment Edited] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002739#comment-17002739 ] Fei Hui edited comment on HDFS-15078 at 12/24/19 10:23 AM: --- {quote} The issue

[jira] [Comment Edited] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002739#comment-17002739 ] Fei Hui edited comment on HDFS-15078 at 12/24/19 10:02 AM: --- {quote} The issue

[jira] [Commented] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002762#comment-17002762 ] Fei Hui commented on HDFS-15079: General Idea: * client generate id and send it with call to namenode *

[jira] [Updated] (HDFS-15079) RBF: Client maybe get an unexpected result with network anomaly

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Summary: RBF: Client maybe get an unexpected result with network anomaly (was: RBF: Client may get an

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002739#comment-17002739 ] Fei Hui commented on HDFS-15078: {quote} The issue is the first router which c, That client did failover

[jira] [Commented] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002720#comment-17002720 ] Fei Hui commented on HDFS-12999: Yes, [~figo] doesn't seems active nowdays. Upload v003 patch on his

[jira] [Updated] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-12999: --- Attachment: HDFS-12999.003.patch > When reach the end of the block group, it may not need to flush all the

[jira] [Updated] (HDFS-15079) RBF: Client may get an unexpected result with network anomaly

2019-12-24 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15079: --- Issue Type: Bug (was: Improvement) > RBF: Client may get an unexpected result with network anomaly >

[jira] [Created] (HDFS-15079) RBF: Client may get an unexpected result with network anomaly

2019-12-24 Thread Fei Hui (Jira)
Fei Hui created HDFS-15079: -- Summary: RBF: Client may get an unexpected result with network anomaly Key: HDFS-15079 URL: https://issues.apache.org/jira/browse/HDFS-15079 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002714#comment-17002714 ] Fei Hui edited comment on HDFS-15078 at 12/24/19 7:58 AM: -- This fix can resolve

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002714#comment-17002714 ] Fei Hui commented on HDFS-15078: This fix can resolve some logs as follow {quote} 2019-12-24 15:46:20,717

[jira] [Comment Edited] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002603#comment-17002603 ] Fei Hui edited comment on HDFS-15078 at 12/24/19 4:21 AM: -- {quote} if the client

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002603#comment-17002603 ] Fei Hui commented on HDFS-15078: {quote} Moreover the case would be a rare scenario and this check would

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002586#comment-17002586 ] Fei Hui commented on HDFS-15078: v002 patch change {code} if (curCall == null || !curCall.isOpen()) {

[jira] [Updated] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15078: --- Attachment: HDFS-15078.002.patch > RBF: Should check connection channel before sending rpc to namenode >

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002571#comment-17002571 ] Fei Hui commented on HDFS-15078: [~ayushtkn][~elgoiri] I find there is a critical problem on RBF, this

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002374#comment-17002374 ] Fei Hui commented on HDFS-15078: [~ayushtkn] [~elgoiri] Could you please take a look? Thanks > RBF:

[jira] [Updated] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15078: --- Status: Patch Available (was: Open) > RBF: Should check connection channel before sending rpc to namenode >

[jira] [Updated] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2019-12-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15078: --- Attachment: HDFS-15078.001.patch > RBF: Should check connection channel before sending rpc to namenode >

  1   2   3   4   5   6   7   >