[jira] [Updated] (HDFS-12951) Incorrect javadoc in SaslDataTransferServer.java#receive

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12951: -- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-12958) Ozone: remove setAllocatedBytes method in ContainerInfo

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12958: -- Attachment: HDFS-12958-HDFS-7240.001.patch Post v001 patch. [~nandakumar131] would you mind taking a

[jira] [Updated] (HDFS-12958) Ozone: remove setAllocatedBytes method in ContainerInfo

2017-12-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12958: -- Status: Patch Available (was: Open) > Ozone: remove setAllocatedBytes method in ContainerInfo >

[jira] [Commented] (HDFS-12940) Ozone: KSM: TestKeySpaceManager#testExpiredOpenKey fails occasionally

2018-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308660#comment-16308660 ] Chen Liang commented on HDFS-12940: --- [~nandakumar131] how often did you see these tests fail? I ran

[jira] [Commented] (HDFS-12980) Ozone: SCM: Restructuring container state transition and events

2018-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308761#comment-16308761 ] Chen Liang commented on HDFS-12980: --- Thanks for working on this [~nandakumar131]! I'm just looking at

[jira] [Commented] (HDFS-12980) Ozone: SCM: Restructuring container state transition and events

2018-01-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308880#comment-16308880 ] Chen Liang commented on HDFS-12980: --- Thanks for the illustration [~anu]! Still though, is there a reason

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-06-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519803#comment-16519803 ] Chen Liang commented on HDFS-12977: --- It seems the name space ID is picked up here by reading 

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767-HDFS-12943.002.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-08-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567299#comment-16567299 ] Chen Liang commented on HDFS-13767: --- Thanks [~shv] and [~xkrogen] for the review and the comments! Post

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562713#comment-16562713 ] Chen Liang commented on HDFS-13688: --- Thanks for the review [~xkrogen]! Posted v005 patch to remove

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.005.patch > Introduce msync API call > > >

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-07-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767.WIP.002.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-07-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558934#comment-16558934 ] Chen Liang commented on HDFS-13767: --- Upload WIP.002 patch. The main difference from WIP.001 patch is

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564011#comment-16564011 ] Chen Liang commented on HDFS-13767: --- Thanks for the followup discussion [~xkrogen]! Many thanks to the

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767.WIP.004.patch > Add msync server implementation. >

[jira] [Comment Edited] (HDFS-13767) Add msync server implementation.

2018-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564576#comment-16564576 ] Chen Liang edited comment on HDFS-13767 at 8/1/18 12:59 AM: Post WIP.v004

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-07-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564576#comment-16564576 ] Chen Liang commented on HDFS-13767: --- Post WIP.v004 patch. The main changes are: # changed to

[jira] [Comment Edited] (HDFS-13767) Add msync server implementation.

2018-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568843#comment-16568843 ] Chen Liang edited comment on HDFS-13767 at 8/3/18 10:21 PM: Thanks for

[jira] [Assigned] (HDFS-13780) Postpone NameNode state discovery in ObserverReadProxyProvider until the first real RPC call.

2018-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-13780: - Assignee: Chen Liang > Postpone NameNode state discovery in ObserverReadProxyProvider until the

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Status: Patch Available (was: In Progress) > Add msync server implementation. >

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767-HDFS-12943.001.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-08-01 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565704#comment-16565704 ] Chen Liang commented on HDFS-13767: --- Post v001 patch to fix the naming of the patch... > Add msync

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767.WIP.003.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-07-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16560384#comment-16560384 ] Chen Liang commented on HDFS-13767: --- Thanks for the comments [~shv]! Updated WIP.003 patch with you

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568843#comment-16568843 ] Chen Liang commented on HDFS-13767: --- Thanks for comments [~zero45]. bq. (2) A concern about the unit

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568860#comment-16568860 ] Chen Liang commented on HDFS-13767: --- Thanks [~zero45]. I updated the previous comment, which I should

[jira] [Comment Edited] (HDFS-13767) Add msync server implementation.

2018-08-03 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568843#comment-16568843 ] Chen Liang edited comment on HDFS-13767 at 8/3/18 10:12 PM: Thanks for

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-08-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578665#comment-16578665 ] Chen Liang commented on HDFS-13767: --- The failed test is unrelated, I've committed to the feature

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Add msync server implementation.

[jira] [Commented] (HDFS-13735) Make QJM HTTP URL connection timeout configurable

2018-08-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578846#comment-16578846 ] Chen Liang commented on HDFS-13735: --- Thanks for pointing out [~shv]. I've committed to branch-3.0 and

[jira] [Commented] (HDFS-13779) Implement performFailover logic for ObserverReadProxyProvider.

2018-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581498#comment-16581498 ] Chen Liang commented on HDFS-13779: --- Thanks for the patch [~xkrogen], looking good to me overall, some

[jira] [Commented] (HDFS-13779) Implement performFailover logic for ObserverReadProxyProvider.

2018-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581729#comment-16581729 ] Chen Liang commented on HDFS-13779: --- I see, so I guess the incremented {{currentIndex}} only takes

[jira] [Commented] (HDFS-13779) Implement performFailover logic for ObserverReadProxyProvider.

2018-08-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583130#comment-16583130 ] Chen Liang commented on HDFS-13779: --- Thanks for the correction [~xkrogen]! Makes sense to me. I recall

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767-HDFS-12943.003.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-08-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570565#comment-16570565 ] Chen Liang commented on HDFS-13767: --- Post v003 patch to fix the issue as [~zero45] found. The test

[jira] [Commented] (HDFS-13735) Make QJM HTTP URL connection timeout configurable

2018-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575151#comment-16575151 ] Chen Liang commented on HDFS-13735: --- I've committed to trunk, thanks [~csun] for the contribution and

[jira] [Updated] (HDFS-13735) Make QJM HTTP URL connection timeout configurable

2018-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13735: -- Resolution: Fixed Fix Version/s: 3.1.2 3.2.0 Status: Resolved

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: (was: HDFS-13767-HDFS-12943.004.patch) > Add msync server implementation. >

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767-HDFS-12943.004.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575532#comment-16575532 ] Chen Liang commented on HDFS-13767: --- Thanks [~shv] for the catch! Upload v004 patch. Investigated the

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-08-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767-HDFS-12943.004.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13851) Remove AlignmentContext from AbstractNNFailoverProxyProvider

2018-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590753#comment-16590753 ] Chen Liang commented on HDFS-13851: --- v001 patch LGTM, +1 > Remove AlignmentContext from

[jira] [Commented] (HDFS-13848) Refactor NameNode failover proxy providers

2018-08-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590828#comment-16590828 ] Chen Liang commented on HDFS-13848: --- v002 patch LGTM overall, only some minor comments: - In

[jira] [Commented] (HDFS-13782) ObserverReadProxyProvider should work with IPFailoverProxyProvider

2018-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592318#comment-16592318 ] Chen Liang commented on HDFS-13782: --- As a minimal conflict resolution Jira, v002 patch LGTM, pending

[jira] [Comment Edited] (HDFS-13782) ObserverReadProxyProvider should work with IPFailoverProxyProvider

2018-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592318#comment-16592318 ] Chen Liang edited comment on HDFS-13782 at 8/24/18 11:57 PM: - As a minimal

[jira] [Commented] (HDFS-13848) Refactor NameNode failover proxy providers

2018-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592219#comment-16592219 ] Chen Liang commented on HDFS-13848: --- v005 patch LGTM, +1 pending Jenkins. > Refactor NameNode failover

[jira] [Created] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13880: - Summary: Add mechanism to allow certain RPC calls to bypass sync Key: HDFS-13880 URL: https://issues.apache.org/jira/browse/HDFS-13880 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-13779) Implement performFailover logic for ObserverReadProxyProvider.

2018-08-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595716#comment-16595716 ] Chen Liang commented on HDFS-13779: --- Thanks for the patch [~xkrogen]! LGTM overall, only some minor

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.002.patch > Introduce msync API call > > >

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551018#comment-16551018 ] Chen Liang commented on HDFS-13688: --- Seems HADOOP-15610 has resolved the jenkins issue. Resubmit v001

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Status: Patch Available (was: In Progress) > Introduce msync API call > > >

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16547193#comment-16547193 ] Chen Liang commented on HDFS-13688: --- Post v001 patch for a Jenkins run. The main difference from

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.001.patch > Introduce msync API call > > >

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-18 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548173#comment-16548173 ] Chen Liang commented on HDFS-13688: --- I was checking the failed builds. It seemed all the most recent

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545720#comment-16545720 ] Chen Liang commented on HDFS-13688: --- Thanks [~linyiqun], [~zero45] for the comments! Sorry for the late

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545898#comment-16545898 ] Chen Liang commented on HDFS-13688: --- I was rebasing the patch, and I found that one of my tests failed.

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553152#comment-16553152 ] Chen Liang commented on HDFS-13688: --- I thought HADOOP-15610 was merge to the branch but I guess I was

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.002.patch > Introduce msync API call > > >

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554874#comment-16554874 ] Chen Liang commented on HDFS-13688: --- Had an offline discussion with [~shv], updated v003 patch. Some

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.003.patch > Introduce msync API call > > >

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: (was: HDFS-13688-HDFS-12943.003.patch) > Introduce msync API call >

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.003.patch > Introduce msync API call > > >

[jira] [Updated] (HDFS-13688) Introduce msync API call

2018-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13688: -- Attachment: HDFS-13688-HDFS-12943.004.patch > Introduce msync API call > > >

[jira] [Commented] (HDFS-13688) Introduce msync API call

2018-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556051#comment-16556051 ] Chen Liang commented on HDFS-13688: --- Two of the failed tests are actually related, post v004 patch to

[jira] [Created] (HDFS-13767) Add msync server implementation.

2018-07-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13767: - Summary: Add msync server implementation. Key: HDFS-13767 URL: https://issues.apache.org/jira/browse/HDFS-13767 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Work started] (HDFS-13767) Add msync server implementation.

2018-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13767 started by Chen Liang. - > Add msync server implementation. > > >

[jira] [Updated] (HDFS-13767) Add msync server implementation.

2018-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13767: -- Attachment: HDFS-13767.WIP.001.patch > Add msync server implementation. >

[jira] [Commented] (HDFS-13767) Add msync server implementation.

2018-07-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556255#comment-16556255 ] Chen Liang commented on HDFS-13767: --- Post WIP.001 patch for early reviews. Some notes to ease the

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Attachment: HDFS-13880-HDFS-12943.002.patch > Add mechanism to allow certain RPC calls to bypass sync

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Attachment: HDFS-13880-HDFS-12943.001.patch > Add mechanism to allow certain RPC calls to bypass sync

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597967#comment-16597967 ] Chen Liang commented on HDFS-13880: --- Post v001 patch. The basic approach is that, extending

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597971#comment-16597971 ] Chen Liang commented on HDFS-13880: --- Post v002 patch with a minor optimization. [~shv] would you mind

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599429#comment-16599429 ] Chen Liang commented on HDFS-13880: --- {quote}LMK if there are other options? I am in favor of 

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599427#comment-16599427 ] Chen Liang commented on HDFS-13880: --- Thanks for the comments [~xkrogen], [~shv]

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-06 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Attachment: HDFS-13880-HDFS-12943.003.patch > Add mechanism to allow certain RPC calls to bypass sync

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Attachment: HDFS-13880-HDFS-12943.005.patch > Add mechanism to allow certain RPC calls to bypass sync

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609586#comment-16609586 ] Chen Liang commented on HDFS-13880: --- Post v005 patch to address Erik's comments, along with a couple

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609516#comment-16609516 ] Chen Liang commented on HDFS-13880: --- Thanks for follow up [~xkrogen]. That is a good point about

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Attachment: HDFS-13880-HDFS-12943.004.patch > Add mechanism to allow certain RPC calls to bypass sync

[jira] [Commented] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-09-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607772#comment-16607772 ] Chen Liang commented on HDFS-13880: --- Thanks for the review [~xkrogen]! All comments addressed, just one

[jira] [Commented] (HDFS-13017) Block Storage: implement simple iscsi discovery in jscsi server

2018-01-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325395#comment-16325395 ] Chen Liang commented on HDFS-13017: --- Thanks [~elek] for working on this! v001 patch LGTM, just one

[jira] [Commented] (HDFS-13036) Reusing the volume storage ID obtained by replicaInfo

2018-01-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333123#comment-16333123 ] Chen Liang commented on HDFS-13036: --- Thanks [~liaoyuxiangqin] for the catch! The failed tests are

[jira] [Updated] (HDFS-13036) Reusing the volume storage ID obtained by replicaInfo

2018-01-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13036: -- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.004.patch > Add configurable additional RPC listener to NameNode >

[jira] [Commented] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611397#comment-16611397 ] Chen Liang commented on HDFS-13566: --- Post v004 patch with the configuration key changes, and more unit

[jira] [Commented] (HDFS-11398) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure still fails intermittently

2018-03-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395717#comment-16395717 ] Chen Liang commented on HDFS-11398: --- Hi [~linyiqun], Thanks for reporting this. I looked at the patch

[jira] [Commented] (HDFS-11142) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2018-03-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395828#comment-16395828 ] Chen Liang commented on HDFS-11142: --- Hi [~linyiqun], Thanks for reporting this! One question, is there

[jira] [Comment Edited] (HDFS-11142) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2018-03-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395828#comment-16395828 ] Chen Liang edited comment on HDFS-11142 at 3/12/18 8:33 PM: Hi [~linyiqun],

[jira] [Commented] (HDFS-13418) NetworkTopology should be configurable when enable DFSNetworkTopology

2018-04-10 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432565#comment-16432565 ] Chen Liang commented on HDFS-13418: --- Thanks for the discussion [~Tao Jie] and [~linyiqun]! The change in

[jira] [Commented] (HDFS-13418) NetworkTopology should be configurable when enable DFSNetworkTopology

2018-04-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434231#comment-16434231 ] Chen Liang commented on HDFS-13418: --- Thans [~Tao Jie] and [~linyiqun] for the followup! v003 patch LGTM,

[jira] [Commented] (HDFS-13286) Add haadmin commands to transition between standby and observer

2018-04-23 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449121#comment-16449121 ] Chen Liang commented on HDFS-13286: --- Thanks [~csun] for working on this! the patch LGTM, only two minor

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402512#comment-16402512 ] Chen Liang commented on HDFS-12977: --- Thanks [~zero45] for working on this! patch looks pretty good to

[jira] [Commented] (HDFS-13610) [Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync

2018-06-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526676#comment-16526676 ] Chen Liang commented on HDFS-13610: --- v003 patch LGTM, +1, thanks for working on this feature

[jira] [Updated] (HDFS-13791) Limit logging frequency of edit tail related statements

2018-09-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13791: -- Resolution: Fixed Fix Version/s: HDFS-12943 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-13791) Limit logging frequency of edit tail related statements

2018-09-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630753#comment-16630753 ] Chen Liang commented on HDFS-13791: --- +1 on v006 patch, I've committed to the feature branch, thanks

[jira] [Updated] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-10-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13880: -- Fix Version/s: HDFS-12943 > Add mechanism to allow certain RPC calls to bypass sync >

[jira] [Commented] (HDFS-13961) TestObserverNode refactoring

2018-10-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640314#comment-16640314 ] Chen Liang commented on HDFS-13961: --- +1 to v002 patch. > TestObserverNode refactoring >

[jira] [Commented] (HDFS-13523) Support observer nodes in MiniDFSCluster

2018-10-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647201#comment-16647201 ] Chen Liang commented on HDFS-13523: --- +1 on v005 patch. > Support observer nodes in MiniDFSCluster >

[jira] [Updated] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-10-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-13566: -- Attachment: HDFS-13566.010.patch > Add configurable additional RPC listener to NameNode >

[jira] [Commented] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-10-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16653875#comment-16653875 ] Chen Liang commented on HDFS-13566: --- Thanks for the review [~shv]! post v10 patch > Add configurable

<    8   9   10   11   12   13   14   15   16   17   >