[jira] [Updated] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14017: -- Attachment: HDFS-14017-HDFS-12943.012.patch > ObserverReadProxyProviderWithIPFailover should work with

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2018-11-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684222#comment-16684222 ] Chen Liang commented on HDFS-12943: --- [~xiangheng] thanks for trying Observer read! What was the full

[jira] [Commented] (HDFS-14059) Test reads from standby on a secure cluster with Configured failover

2018-11-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684229#comment-16684229 ] Chen Liang commented on HDFS-14059: --- Thanks for sharing [~zero45]! For (1), On a quick glance of the

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.013.patch > NN status discovery does not leverage delegation token >

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684433#comment-16684433 ] Chen Liang commented on HDFS-14035: --- Thanks for the review [~shv]! The failed test

[jira] [Updated] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14017: -- Attachment: HDFS-14017-HDFS-12943.011.patch > ObserverReadProxyProviderWithIPFailover should work with

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686936#comment-16686936 ] Chen Liang commented on HDFS-14017: --- v011 patch to fix checkstyle issues. >

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.014.patch > NN status discovery does not leverage delegation token >

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685620#comment-16685620 ] Chen Liang commented on HDFS-14035: --- Discussed with [~xkrogen] offline, seems we can also resolve race

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673712#comment-16673712 ] Chen Liang commented on HDFS-14017: --- Thanks for the clarification [~xkrogen]. bq. when the active

[jira] [Updated] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14035: -- Attachment: HDFS-14035-HDFS-12943.004.patch > NN status discovery does not leverage delegation token >

[jira] [Commented] (HDFS-14035) NN status discovery does not leverage delegation token

2018-11-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673535#comment-16673535 ] Chen Liang commented on HDFS-14035: --- Rebased with v004 patch > NN status discovery does not leverage

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599019#comment-16599019 ] Chen Liang commented on HDFS-13880: --- [~shv] Masync is just the current name I picked for methods that

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Status: Patch Available (was: Open) > Add mechanism to allow certain RPC calls to bypass sync >

[jira] [Commented] (HDFS-13872) Only some protocol methods should perform msync wait

2018-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599035#comment-16599035 ] Chen Liang commented on HDFS-13872: --- Somehow I missed this Jira completely...so I filed HDFS-13880 and

[jira] [Commented] (HDFS-13924) Handle BlockMissingException when reading from observer

2018-09-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622626#comment-16622626 ] Chen Liang commented on HDFS-13924: --- Thanks for the update [~csun]! Just to add to my previous comment:

[jira] [Commented] (HDFS-13873) ObserverNode should reject read requests when it is too far behind.

2018-09-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622645#comment-16622645 ] Chen Liang commented on HDFS-13873: --- [~csun] any updates/plans for this? I saw you are busy with two

[jira] [Commented] (HDFS-13873) ObserverNode should reject read requests when it is too far behind.

2018-09-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622948#comment-16622948 ] Chen Liang commented on HDFS-13873: --- Thanks [~csun]! I had some thoughts on this, sharing here for

[jira] [Commented] (HDFS-13873) ObserverNode should reject read requests when it is too far behind.

2018-09-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626547#comment-16626547 ] Chen Liang commented on HDFS-13873: --- Update here for reference: Synced offline with Konstantin. Seems

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689781#comment-16689781 ] Chen Liang commented on HDFS-14017: --- Hmmm...thanks for the checking [~xkrogen]! >

[jira] [Commented] (HDFS-14058) Test reads from standby on a secure cluster with IP failover

2018-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689993#comment-16689993 ] Chen Liang commented on HDFS-14058: --- The tests I've run include the following. Please note that the

[jira] [Commented] (HDFS-14181) Suspect there is a bug in NetworkTopology.java chooseRandom function.

2019-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732304#comment-16732304 ] Chen Liang commented on HDFS-14181: --- Sorry for the late response, just got back from vacation. The fix

[jira] [Created] (HDFS-14205) Backport HDFS-6440 to branch-2

2019-01-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14205: - Summary: Backport HDFS-6440 to branch-2 Key: HDFS-14205 URL: https://issues.apache.org/jira/browse/HDFS-14205 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-01-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14204: - Summary: Backport HDFS-12943 to branch-2 Key: HDFS-14204 URL: https://issues.apache.org/jira/browse/HDFS-14204 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-01-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- External issue ID: hdfs-12943 > Backport HDFS-12943 to branch-2 > --- > >

[jira] [Updated] (HDFS-14142) Move ipfailover config key out of HdfsClientConfigKeys

2018-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14142: -- Resolution: Fixed Fix Version/s: HDFS-12943 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-14142) Move ipfailover config key out of HdfsClientConfigKeys

2018-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719300#comment-16719300 ] Chen Liang commented on HDFS-14142: --- The checkstyle warning can be fixed by adding final keyword to the

[jira] [Updated] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-12-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13617: -- Status: Patch Available (was: In Progress) > Allow wrapping NN QOP into token in encrypted message >

[jira] [Commented] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-12-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715323#comment-16715323 ] Chen Liang commented on HDFS-13617: --- Have been busy with another project...coming back to this. Post

[jira] [Updated] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-12-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13617: -- Attachment: HDFS-13617.004.patch > Allow wrapping NN QOP into token in encrypted message >

[jira] [Commented] (HDFS-14146) Handle exception from internalQueueCall

2018-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719556#comment-16719556 ] Chen Liang commented on HDFS-14146: --- Thanks [~csun] for reporting! Interesting...in what situation did

[jira] [Commented] (HDFS-14146) Handle exception from internalQueueCall

2018-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719613#comment-16719613 ] Chen Liang commented on HDFS-14146: --- This is a good discussion and good point on the deadlock

[jira] [Commented] (HDFS-14116) Fix a potential class cast error in ObserverReadProxyProvider

2018-12-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719657#comment-16719657 ] Chen Liang commented on HDFS-14116: --- Thanks for the update [~csun]! v002 patch looks pretty good

[jira] [Commented] (HDFS-14116) Fix a potential class cast error in ObserverReadProxyProvider

2018-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720720#comment-16720720 ] Chen Liang commented on HDFS-14116: --- Just one more trivial thing, can we fix at least the third one of

[jira] [Commented] (HDFS-14116) ObserverReadProxyProvider should work with protocols other than ClientProtocol

2018-12-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723327#comment-16723327 ] Chen Liang commented on HDFS-14116: --- I had an offline discussion with [~shv]. So it looks like we were

[jira] [Comment Edited] (HDFS-12943) Consistent Reads from Standby Node

2018-12-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723272#comment-16723272 ] Chen Liang edited comment on HDFS-12943 at 12/17/18 10:45 PM: -- Hi

[jira] [Commented] (HDFS-14116) ObserverReadProxyProvider should work with protocols other than ClientProtocol

2018-12-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723521#comment-16723521 ] Chen Liang commented on HDFS-14116: --- Thanks [~shv] for the patch! +1 from me on v005 patch >

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2018-12-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723272#comment-16723272 ] Chen Liang commented on HDFS-12943: --- Hi [~brahmareddy], Thanks for testing! The timeout issue seems

[jira] [Commented] (HDFS-14116) Fix a potential class cast error in ObserverReadProxyProvider

2018-12-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715883#comment-16715883 ] Chen Liang commented on HDFS-14116: --- I applied the patch and reran NNThroughtputBenchmark. The run did

[jira] [Comment Edited] (HDFS-14116) Fix a potential class cast error in ObserverReadProxyProvider

2018-12-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715883#comment-16715883 ] Chen Liang edited comment on HDFS-14116 at 12/11/18 1:04 AM: - I applied the

[jira] [Updated] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-12-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13617: -- Attachment: HDFS-13617.005.patch > Allow wrapping NN QOP into token in encrypted message >

[jira] [Commented] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-12-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718001#comment-16718001 ] Chen Liang commented on HDFS-13617: --- Fix the checkstyle, javac, findbug warnings in v005 patch. >

[jira] [Commented] (HDFS-13873) ObserverNode should reject read requests when it is too far behind.

2018-12-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16717750#comment-16717750 ] Chen Liang commented on HDFS-13873: --- I guess there are (at least) two directions: estimate-based and

[jira] [Created] (HDFS-14142) Move ipfailover config key out of HdfsClientConfigKeys

2018-12-11 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14142: - Summary: Move ipfailover config key out of HdfsClientConfigKeys Key: HDFS-14142 URL: https://issues.apache.org/jira/browse/HDFS-14142 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-14142) Move ipfailover config key out of HdfsClientConfigKeys

2018-12-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14142: -- Attachment: HDFS-14142-HDFS-12943.001.patch > Move ipfailover config key out of HdfsClientConfigKeys >

[jira] [Updated] (HDFS-14142) Move ipfailover config key out of HdfsClientConfigKeys

2018-12-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14142: -- Status: Patch Available (was: Open) > Move ipfailover config key out of HdfsClientConfigKeys >

[jira] [Commented] (HDFS-14138) Description errors in the comparison logic of transaction ID

2018-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720798#comment-16720798 ] Chen Liang commented on HDFS-14138: --- Hey [~xiangheng] thanks for looking through the code! I missed

[jira] [Updated] (HDFS-14138) Description errors in the comparison logic of transaction ID

2018-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14138: -- Resolution: Fixed Fix Version/s: HDFS-12943 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-14138) Description errors in the comparison logic of transaction ID

2018-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721786#comment-16721786 ] Chen Liang commented on HDFS-14138: --- Thanks [~csun] for chiming in! I've committed the v000 patch to

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2018-12-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725379#comment-16725379 ] Chen Liang commented on HDFS-12943: --- Hi [~brahmareddy], Some more notes to add: 1. getHAServiceState()

[jira] [Assigned] (HDFS-14138) Description errors in the comparison logic of transaction ID

2018-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-14138: - Assignee: xiangheng > Description errors in the comparison logic of transaction ID >

[jira] [Updated] (HDFS-14138) Description errors in the comparison logic of transaction ID

2018-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14138: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-12943 > Description errors in the comparison

[jira] [Commented] (HDFS-14138) Description errors in the comparison logic of transaction ID

2018-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721657#comment-16721657 ] Chen Liang commented on HDFS-14138: --- Hi [~xiangheng], absolutely no worries, and welcome to the

[jira] [Commented] (HDFS-14116) ObserverReadProxyProvider should work with protocols other than ClientProtocol

2018-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721686#comment-16721686 ] Chen Liang commented on HDFS-14116: --- I've committed v004 patch to the feature branch, thanks [~csun]

[jira] [Updated] (HDFS-14116) ObserverReadProxyProvider should work with protocols other than ClientProtocol

2018-12-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14116: -- Resolution: Fixed Fix Version/s: HDFS-12943 Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-14116) Fix a potential class cast error in ObserverReadProxyProvider

2018-11-29 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14116: - Summary: Fix a potential class cast error in ObserverReadProxyProvider Key: HDFS-14116 URL: https://issues.apache.org/jira/browse/HDFS-14116 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-11-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703810#comment-16703810 ] Chen Liang commented on HDFS-13547: --- Thanks for checking [~vinodkv]! Will commit to 3.1.1 to branch-3

[jira] [Commented] (HDFS-14116) Fix a potential class cast error in ObserverReadProxyProvider

2018-11-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703877#comment-16703877 ] Chen Liang commented on HDFS-14116: --- Thanks [~csun]! Yeah I can another look later. Posting error stack

[jira] [Resolved] (HDFS-13547) Add ingress port based sasl resolver

2018-11-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-13547. --- Resolution: Fixed Fix Version/s: 3.1.1 > Add ingress port based sasl resolver >

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-11-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703845#comment-16703845 ] Chen Liang commented on HDFS-13547: --- Committed v004 patch to branch-3 and branch-3.1.1. > Add ingress

[jira] [Updated] (HDFS-14120) ORFPP should also clone DT for the virtual IP

2018-11-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14120: -- Description: Currently with HDFS-14017, ORFPP behaves the similar way on handling delegation as

[jira] [Created] (HDFS-14120) ORFPP should also clone DT for the virtual IP

2018-11-30 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14120: - Summary: ORFPP should also clone DT for the virtual IP Key: HDFS-14120 URL: https://issues.apache.org/jira/browse/HDFS-14120 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-14126) DataNode DirectoryScanner holding global lock for too long

2018-12-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709085#comment-16709085 ] Chen Liang commented on HDFS-14126: --- Thanks for reporting [~jojochuang]. I have not seen this issue

[jira] [Commented] (HDFS-14116) Fix a potential class cast error in ObserverReadProxyProvider

2018-12-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710791#comment-16710791 ] Chen Liang commented on HDFS-14116: --- Thanks for the finding [~shv], seems this error is different

[jira] [Updated] (HDFS-14120) ORFPP should also clone DT for the virtual IP

2018-12-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14120: -- Resolution: Fixed Status: Resolved (was: Patch Available) > ORFPP should also clone DT for

[jira] [Commented] (HDFS-14120) ORFPP should also clone DT for the virtual IP

2018-12-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708038#comment-16708038 ] Chen Liang commented on HDFS-14120: --- Thanks [~shv] for the review! I've committed to the feature

[jira] [Updated] (HDFS-14120) ORFPP should also clone DT for the virtual IP

2018-12-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14120: -- Status: Patch Available (was: Open) > ORFPP should also clone DT for the virtual IP >

[jira] [Updated] (HDFS-14120) ORFPP should also clone DT for the virtual IP

2018-12-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14120: -- Attachment: HDFS-14120-HDFS-12943.001.patch > ORFPP should also clone DT for the virtual IP >

[jira] [Commented] (HDFS-13547) Add ingress port based sasl resolver

2018-12-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707743#comment-16707743 ] Chen Liang commented on HDFS-13547: --- I was not aware of this about fix-version for released version,

[jira] [Commented] (HDFS-14058) Test reads from standby on a secure cluster with IP failover

2018-12-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709359#comment-16709359 ] Chen Liang commented on HDFS-14058: --- Another test done: 6. Performed manual failover while a TeraSort

[jira] [Updated] (HDFS-14058) Test reads from standby on a secure cluster with IP failover

2018-12-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14058: -- Attachment: dfsio_crs.with-crs.txt dfsio_crs.no-crs.txt > Test reads from standby on a

[jira] [Commented] (HDFS-14058) Test reads from standby on a secure cluster with IP failover

2018-12-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709444#comment-16709444 ] Chen Liang commented on HDFS-14058: --- Post some numbers from running DFSIO test, I ran the test for both

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-12-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Fix Version/s: HDFS-12943 > Add msync server implementation. > > >

[jira] [Comment Edited] (HDFS-14058) Test reads from standby on a secure cluster with IP failover

2018-12-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689993#comment-16689993 ] Chen Liang edited comment on HDFS-14058 at 12/5/18 12:02 AM: - The tests were

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16690185#comment-16690185 ] Chen Liang commented on HDFS-14017: --- I've committed v014 patch to feature branch, thanks for all the

[jira] [Updated] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14017: -- Resolution: Fixed Fix Version/s: HDFS-12943 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-14017) ObserverReadProxyProviderWithIPFailover should work with HA configuration

2018-11-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16690170#comment-16690170 ] Chen Liang commented on HDFS-14017: --- Thanks for looking into this [~xkrogen]! I agree that there should

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-09-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.005.patch > Add configurable additional RPC listener to NameNode >

[jira] [Commented] (HDFS-13898) Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode

2018-09-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615149#comment-16615149 ] Chen Liang commented on HDFS-13898: --- Thanks [~csun] for reporting and fixing this! My main question was

[jira] [Commented] (HDFS-13924) Handle BlockMissingException when reading from observer

2018-09-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618247#comment-16618247 ] Chen Liang commented on HDFS-13924: --- Good finding, thanks for reporting [~csun]! I'm wondering, is

[jira] [Commented] (HDFS-13924) Handle BlockMissingException when reading from observer

2018-09-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618281#comment-16618281 ] Chen Liang commented on HDFS-13924: --- Thanks [~csun]. I see, so I imagine the error did not happen on

[jira] [Commented] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-09-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618291#comment-16618291 ] Chen Liang commented on HDFS-13566: --- {{TestLeaseRecovery2}} failed regardless of whether the patch is

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-09-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.006.patch > Add configurable additional RPC listener to NameNode >

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614159#comment-16614159 ] Chen Liang commented on HDFS-13880: --- I've committed v005 patch to the feature branch (with the unused

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Add mechanism to allow certain

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2018-12-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16724465#comment-16724465 ] Chen Liang commented on HDFS-12943: --- Hi [~brahmareddy] bq. you can see this issue if

[jira] [Commented] (HDFS-14205) Backport HDFS-6440 to branch-2

2019-01-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754241#comment-16754241 ] Chen Liang commented on HDFS-14205: --- Thanks for chiming in [~csun]! I also had a patch for this

[jira] [Updated] (HDFS-14205) Backport HDFS-6440 to branch-2

2019-01-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14205: -- Attachment: HDFS-14205-branch-2.001.patch > Backport HDFS-6440 to branch-2 >

[jira] [Updated] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13699: -- Attachment: HDFS-13699.009.patch > Add DFSClient sending handshake token to DataNode, and allow

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808008#comment-16808008 ] Chen Liang commented on HDFS-13699: --- Thanks for the clarification [~shv]! I've attached v009 patch to

[jira] [Updated] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13699: -- Attachment: HDFS-13699.010.patch > Add DFSClient sending handshake token to DataNode, and allow

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-04-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808186#comment-16808186 ] Chen Liang commented on HDFS-13699: --- Post v010 patch with one additional unused import fix. > Add

[jira] [Updated] (HDFS-14205) Backport HDFS-6440 to branch-2

2019-03-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14205: -- Resolution: Fixed Fix Version/s: 2.10.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14205) Backport HDFS-6440 to branch-2

2019-03-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802083#comment-16802083 ] Chen Liang commented on HDFS-14205: --- I have backported v009 patch to branch-2, thanks [~csun] for the

[jira] [Commented] (HDFS-14205) Backport HDFS-6440 to branch-2

2019-03-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801988#comment-16801988 ] Chen Liang commented on HDFS-14205: --- Thanks [~csun] for the clarification. I re-ran the two tests again

[jira] [Commented] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-03-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799351#comment-16799351 ] Chen Liang commented on HDFS-13699: --- Post v007 patch with various refactoring. The logic remains the

[jira] [Updated] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2019-03-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13699: -- Attachment: HDFS-13699.007.patch > Add DFSClient sending handshake token to DataNode, and allow

[jira] [Updated] (HDFS-14397) Backport HADOOP-15684 to branch-2

2019-04-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14397: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Backport HADOOP-15684 to branch-2

[jira] [Commented] (HDFS-14397) Backport HADOOP-15684 to branch-2

2019-04-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809404#comment-16809404 ] Chen Liang commented on HDFS-14397: --- +1 on v001 patch, I've committed to branch-2, thanks for the

[jira] [Commented] (HDFS-14415) Backport HDFS-13799 to branch-2

2019-04-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811148#comment-16811148 ] Chen Liang commented on HDFS-14415: --- The tests also passed in my local run. +1 to v000 patch, I've

<    10   11   12   13   14   15   16   17   18   19   >