[jira] [Updated] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14806: -- Attachment: HDFS-14806.003.patch > Bootstrap standby may fail if used in-progress tailing >

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923707#comment-16923707 ] Chen Liang commented on HDFS-14806: --- This part I am aware. Having a loop with multiple RPC calls is

[jira] [Updated] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14822: -- Status: Patch Available (was: Open) > [SBN read] Revisit GlobalStateIdContext locking when getting

[jira] [Updated] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14822: -- Attachment: HDFS-14822.001.patch > [SBN read] Revisit GlobalStateIdContext locking when getting server

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923663#comment-16923663 ] Chen Liang commented on HDFS-14655: --- [~xkrogen] I agree. But in the particular case here, the only

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923657#comment-16923657 ] Chen Liang commented on HDFS-14655: --- [~xkrogen] IIUC, {{IPCLoggerChannel}} here is used on per JN

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-05 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923653#comment-16923653 ] Chen Liang commented on HDFS-14655: --- Thanks for working on this [~ayushtkn]! v01 patch LGTM overall,

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-04 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922806#comment-16922806 ] Chen Liang commented on HDFS-14806: --- Thanks for taking a look [~xkrogen]. bq. Calling the RPC

[jira] [Comment Edited] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922724#comment-16922724 ] Chen Liang edited comment on HDFS-14822 at 9/4/19 6:14 PM: --- Effectively there

[jira] [Commented] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922730#comment-16922730 ] Chen Liang commented on HDFS-14822: --- We have been applied this change internally and the testing so far

[jira] [Commented] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922724#comment-16922724 ] Chen Liang commented on HDFS-14822: --- Effectively there are three cases getLastSeenStateId() gets called

[jira] [Created] (HDFS-14822) Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Chen Liang (Jira)
Chen Liang created HDFS-14822: - Summary: Revisit GlobalStateIdContext locking when getting server state id Key: HDFS-14822 URL: https://issues.apache.org/jira/browse/HDFS-14822 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14822) [SBN read] Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14822: -- Summary: [SBN read] Revisit GlobalStateIdContext locking when getting server state id (was: Revisit

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-09-03 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921781#comment-16921781 ] Chen Liang commented on HDFS-13541: --- Thanks [~shv]! I've pushed v003 patch of branch-2, with the white

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-09-03 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921630#comment-16921630 ] Chen Liang commented on HDFS-14806: --- Thanks for taking a look [~ayushtkn]! The config

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-30 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919946#comment-16919946 ] Chen Liang commented on HDFS-14726: --- Just committed to branch-2. Thanks [~xkrogen] for the review, and

[jira] [Updated] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-30 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14726: -- Fix Version/s: 2.10.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-30 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919944#comment-16919944 ] Chen Liang commented on HDFS-14726: --- [~jhung] I just checked the tests, 

[jira] [Updated] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-08-30 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14806: -- Description: One issue we went across was that if in-progress tailing is enabled, bootstrap standby

[jira] [Updated] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-08-30 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14806: -- Status: Patch Available (was: Open) > Bootstrap standby may fail if used in-progress tailing >

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-08-30 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919937#comment-16919937 ] Chen Liang commented on HDFS-14806: --- Post v001 patch. Still trying to figure out a way to add a test.

[jira] [Updated] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-08-30 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14806: -- Attachment: HDFS-14806.001.patch > Bootstrap standby may fail if used in-progress tailing >

[jira] [Created] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-08-30 Thread Chen Liang (Jira)
Chen Liang created HDFS-14806: - Summary: Bootstrap standby may fail if used in-progress tailing Key: HDFS-14806 URL: https://issues.apache.org/jira/browse/HDFS-14806 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917072#comment-16917072 ] Chen Liang commented on HDFS-13541: --- Thanks for the review [~shv] ! Post v003 patch. > NameNode Port

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-27 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: HDFS-13541-branch-2.003.patch > NameNode Port based selective encryption >

[jira] [Created] (HDFS-14785) [SBN read] Change client logging to be less aggressive

2019-08-27 Thread Chen Liang (Jira)
Chen Liang created HDFS-14785: - Summary: [SBN read] Change client logging to be less aggressive Key: HDFS-14785 URL: https://issues.apache.org/jira/browse/HDFS-14785 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-14779) Fix logging error in TestEditLog#testMultiStreamsLoadEditWithConfMaxTxns

2019-08-26 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916241#comment-16916241 ] Chen Liang commented on HDFS-14779: --- Thanks for working on this [~jhung]. v001 patch LGTM, +1. > Fix

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-26 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916193#comment-16916193 ] Chen Liang commented on HDFS-13541: --- The branch-2 v001 patch has a bad backport causing an incompatible

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-26 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: HDFS-13541-branch-2.002.patch > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-26 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916156#comment-16916156 ] Chen Liang commented on HDFS-13977: --- Thanks for checking [~xkrogen]. I've committed the branch-2 patch.

[jira] [Updated] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-26 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13977: -- Fix Version/s: 3.1.4 2.10.0 Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-26 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: HDFS-13541-branch-2.001.patch > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-26 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915943#comment-16915943 ] Chen Liang commented on HDFS-14674: --- [~PhiloHe] looks like not only branch-3.1, it is the patch that

[jira] [Updated] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-23 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14674: -- Fix Version/s: 3.1.3 3.2.1 3.3.0 Resolution: Fixed

[jira] [Commented] (HDFS-14674) [SBN read] Got an unexpected txid when tail editlog

2019-08-23 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914566#comment-16914566 ] Chen Liang commented on HDFS-14674: --- Given Konstantin's +1, I've committed to trunk, branch-3.2 and

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-23 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914529#comment-16914529 ] Chen Liang commented on HDFS-13541: --- Thanks [~shv]! I've committed to branch-3.1. > NameNode Port

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-23 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914523#comment-16914523 ] Chen Liang commented on HDFS-13977: --- v003 patch LGTM, +1. Thanks  [~xkrogen]!  > NameNode can kill

[jira] [Commented] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

2019-08-21 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912740#comment-16912740 ] Chen Liang commented on HDFS-13977: --- v002 patch looks pretty good to me, and good discussions! just one

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-21 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912666#comment-16912666 ] Chen Liang commented on HDFS-13541: --- Thanks [~shv] for the review. Post v002 patch to address white

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-21 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: HDFS-13541-branch-3.1.002.patch > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-21 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912515#comment-16912515 ] Chen Liang commented on HDFS-14726: --- Thanks for the review [~xkrogen], I agree that it is safer to set

[jira] [Updated] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-21 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14726: -- Attachment: HDFS-14726-branch-2.003.patch > Fix JN incompatibility issue in branch-2 due to backport

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-20 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Labels: release-blocker (was: ) > NameNode Port based selective encryption >

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-20 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Target Version/s: 2.10.0, 3.3.0 (was: 3.3.0) > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-20 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911658#comment-16911658 ] Chen Liang commented on HDFS-14726: --- Sorry for the delay on getting back to this. Post v002 patch to

[jira] [Updated] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-20 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14726: -- Attachment: HDFS-14726-branch-2.002.patch > Fix JN incompatibility issue in branch-2 due to backport

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909310#comment-16909310 ] Chen Liang commented on HDFS-13541: --- Thanks for the review [~shv]! I've committed to branch-3.2, post

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: HDFS-13541-branch-3.1.001.patch > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-08-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907696#comment-16907696 ] Chen Liang commented on HDFS-13541: --- Thanks for the review [~shv], post v002 patch.

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-08-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: HDFS-13541-branch-3.2.002.patch > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-14277) [SBN read] Observer benchmark results

2019-08-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906521#comment-16906521 ] Chen Liang commented on HDFS-14277: --- Thanks for taking a look [~daryn]. I think it's a fair point

[jira] [Updated] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14724: -- Resolution: Fixed Fix Version/s: 2.10.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905701#comment-16905701 ] Chen Liang commented on HDFS-14724: --- Thanks [~jojochuang] for the review. The failed test is unrelated

[jira] [Updated] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14724: -- Status: Patch Available (was: Open) > Fix JDK7 compatibility in branch-2 >

[jira] [Updated] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14726: -- Status: Patch Available (was: Open) > Fix JN incompatibility issue in branch-2 due to backport of

[jira] [Updated] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14726: -- Attachment: HDFS-14726-branch-2.001.patch > Fix JN incompatibility issue in branch-2 due to backport

[jira] [Commented] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905568#comment-16905568 ] Chen Liang commented on HDFS-14726: --- Marked as blocker as we should solve this before 2.10 release so

[jira] [Updated] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14726: -- Priority: Blocker (was: Major) > Fix JN incompatibility issue in branch-2 due to backport of

[jira] [Created] (HDFS-14726) Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519

2019-08-12 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14726: - Summary: Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519 Key: HDFS-14726 URL: https://issues.apache.org/jira/browse/HDFS-14726 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14523) Remove excess read lock for NetworkToplogy

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905431#comment-16905431 ] Chen Liang commented on HDFS-14523: --- Thanks for filing this. The two locks do seem useless here, they

[jira] [Commented] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905417#comment-16905417 ] Chen Liang commented on HDFS-14724: --- Post 001 patch to just remove this import. Worked in my local

[jira] [Updated] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14724: -- Attachment: HDFS-14724-branch-2.001.patch > Fix JDK7 compatibility in branch-2 >

[jira] [Commented] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905397#comment-16905397 ] Chen Liang commented on HDFS-14724: --- I thought I had already replaced all the {{LongAccumulator}} with

[jira] [Assigned] (HDFS-14724) Fix JDK7 compatibility in branch-2

2019-08-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-14724: - Assignee: Chen Liang > Fix JDK7 compatibility in branch-2 > --

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904269#comment-16904269 ] Chen Liang commented on HDFS-14204: --- Thanks for the review [~shv]! I've committed v007 patch to

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- Attachment: HDFS-14204-branch-2.007.patch > Backport HDFS-12943 to branch-2 >

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902570#comment-16902570 ] Chen Liang commented on HDFS-14204: --- Post v006 patch, to rebase, also included two more Jiras that I

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- Attachment: HDFS-14204-branch-2.006.patch > Backport HDFS-12943 to branch-2 >

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- Attachment: (was: HDFS-14204-branch-2.006.patch) > Backport HDFS-12943 to branch-2 >

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- Attachment: HDFS-14204-branch-2.006.patch > Backport HDFS-12943 to branch-2 >

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902559#comment-16902559 ] Chen Liang commented on HDFS-14204: --- Thanks for your interest [~haiyang Hu]! Currently I'm just fix a

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900326#comment-16900326 ] Chen Liang commented on HDFS-14204: --- Thanks for review [~shv]. Post v005 patch. > Backport HDFS-12943

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-08-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- Attachment: HDFS-14204-branch-2.005.patch > Backport HDFS-12943 to branch-2 >

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-08-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899066#comment-16899066 ] Chen Liang commented on HDFS-14370: --- Good discussion here! v002 patch LGTM, I ran the failed tests a

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Status: Patch Available (was: Open) > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-13541) NameNode Port based selective encryption

2019-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897581#comment-16897581 ] Chen Liang commented on HDFS-13541: --- Working on backport to branch-3.x and branch-2, post synthesized

[jira] [Updated] (HDFS-13541) NameNode Port based selective encryption

2019-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13541: -- Attachment: HDFS-13541-branch-3.2.001.patch > NameNode Port based selective encryption >

[jira] [Commented] (HDFS-14674) Got an unexpected txid when tail editlog

2019-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897392#comment-16897392 ] Chen Liang commented on HDFS-14674: --- Thanks for the finding [~wangzhaohui]! Since this could

[jira] [Updated] (HDFS-14674) Got an unexpected txid when tail editlog

2019-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14674: -- Priority: Blocker (was: Major) > Got an unexpected txid when tail editlog >

[jira] [Commented] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893071#comment-16893071 ] Chen Liang commented on HDFS-14204: --- Post v004 patch. Included more more recent bug fix patches.

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- Attachment: HDFS-14204-branch-2.004.patch > Backport HDFS-12943 to branch-2 >

[jira] [Updated] (HDFS-14573) Backport Standby Read to branch-3

2019-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14573: -- Resolution: Fixed Fix Version/s: 3.0.0 3.1.0

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892973#comment-16892973 ] Chen Liang commented on HDFS-14573: --- Thanks for the review [~shv]! I've committed branch-3.0 v02 patch.

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887514#comment-16887514 ] Chen Liang commented on HDFS-14655: --- Thanks for sharing the details [~ayushtkn]! I also wondered if

[jira] [Updated] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12979: -- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887443#comment-16887443 ] Chen Liang commented on HDFS-12979: --- The failed tests are unrelated, I've committed v015 patch to

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887426#comment-16887426 ] Chen Liang commented on HDFS-14655: --- Post a POC patch with the idea of cancelling unfinished calls

[jira] [Updated] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14655: -- Attachment: HDFS-14655.poc.patch > SBN : Namenode crashes if one of The JN is down >

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887342#comment-16887342 ] Chen Liang commented on HDFS-14655: --- Thanks [~ayushtkn]. I'm also thinking of cancelling outstanding

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887284#comment-16887284 ] Chen Liang commented on HDFS-14655: --- Thanks [~ayushtkn]. Then looks like even without observer read, as

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886396#comment-16886396 ] Chen Liang commented on HDFS-12979: --- Good catch...post v015 patch. > StandbyNode should upload FsImage

[jira] [Updated] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12979: -- Attachment: HDFS-12979.015.patch > StandbyNode should upload FsImage to ObserverNode after

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886384#comment-16886384 ] Chen Liang commented on HDFS-14655: --- Thanks for reporting this and really appreciate the investigation

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886380#comment-16886380 ] Chen Liang commented on HDFS-12979: --- Thanks for the comments [~xkrogen]! Post v014 patch. >

[jira] [Updated] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12979: -- Attachment: HDFS-12979.014.patch > StandbyNode should upload FsImage to ObserverNode after

[jira] [Updated] (HDFS-14573) Backport Standby Read to branch-3

2019-07-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14573: -- Attachment: HDFS-14573-branch-3.0.002.patch > Backport Standby Read to branch-3 >

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

2019-07-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884143#comment-16884143 ] Chen Liang commented on HDFS-14573: --- Committed 3.1 v003 patch to branch 3.1. Working on 3.0 backport.

[jira] [Updated] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

2019-07-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14611: -- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

2019-07-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883311#comment-16883311 ] Chen Liang commented on HDFS-14611: --- The failed tests are unrelated. I've committed v003 patch to

[jira] [Updated] (HDFS-14573) Backport Standby Read to branch-3

2019-07-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14573: -- Attachment: HDFS-14573-branch-3.1.003.patch > Backport Standby Read to branch-3 >

<    1   2   3   4   5   6   7   8   9   10   >