[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2017-08-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119398#comment-16119398 ] Chao Sun commented on HDFS-6440: Would love to see this feature in branch-2. How much work is involved to

[jira] [Created] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-16 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12669: --- Summary: Implement toString() for EditLogInputStream Key: HDFS-12669 URL: https://issues.apache.org/jira/browse/HDFS-12669 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206604#comment-16206604 ] Chao Sun commented on HDFS-12669: - I want to assign this to myself and start contributing to HDFS. [~zhz],

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154494#comment-16154494 ] Chao Sun commented on HDFS-10702: - Thanks [~clouderajiayi] and [~mackrorysd] for this great work! we are

[jira] [Assigned] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-12669: --- Assignee: Chao Sun > Implement toString() for EditLogInputStream >

[jira] [Commented] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208250#comment-16208250 ] Chao Sun commented on HDFS-12669: - Thanks [~andrew.wang]! > Implement toString() for EditLogInputStream >

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267719#comment-16267719 ] Chao Sun commented on HDFS-12836: - Doesn't look like the test failures are related. [~jojochuang]: can you

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Attachment: HDFS-12836.3.patch Thanks [~jojochuang]. Attaching patch v3 to address the checkstyle issue. >

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271923#comment-16271923 ] Chao Sun commented on HDFS-12836: - [~jojochuang] The checkstyle passed but there are some failures again

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Status: Patch Available (was: Open) > startTxId could be greater than endTxId when tailing in-progress

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Attachment: HDFS-12836.2.patch Thanks [~jojochuang]. Yes I think this is a good suggestion. Uploaded patch

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-12-01 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274879#comment-16274879 ] Chao Sun commented on HDFS-12836: - Thanks [~jojochuang] for the review! > startTxId could be greater than

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: HDFS-12932.0.patch Attaching patch v0 to address the issue. > Confusing LOG message for block

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Status: Patch Available (was: Open) > Confusing LOG message for block replication >

[jira] [Created] (HDFS-12932) Confusing LOG message for block replication

2017-12-15 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12932: --- Summary: Confusing LOG message for block replication Key: HDFS-12932 URL: https://issues.apache.org/jira/browse/HDFS-12932 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2017-12-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297979#comment-16297979 ] Chao Sun commented on HDFS-12943: - [~chris.douglas] I did some experiment with the POC patch, on 2.8.3. It

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: HDFS-12932.1.patch Thanks [~vagarychen] for taking a look! Yes I agree it's probably better to

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: (was: HDFS-12932.1.patch) > Confusing LOG message for block replication >

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: HDFS-12932.1.patch Re-attaching patch v1 to trigger jenkins. > Confusing LOG message for block

[jira] [Created] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-17 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12836: --- Summary: startTxId could be greater than endTxId when tailing in-progress edit log Key: HDFS-12836 URL: https://issues.apache.org/jira/browse/HDFS-12836 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259891#comment-16259891 ] Chao Sun commented on HDFS-12836: - This issue happens when not all NNs in the cluster enable the

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Attachment: HDFS-12836.1.patch Thanks [~jojochuang]. I attached a patch with a test case. It would be great

[jira] [Commented] (HDFS-12932) Fix confusing LOG message for block replication

2017-12-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298819#comment-16298819 ] Chao Sun commented on HDFS-12932: - Thanks [~vagarychen] and [~ywskycn] for reviewing the patch! > Fix

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2017-12-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298876#comment-16298876 ] Chao Sun commented on HDFS-12943: - bq. Thanks Chao Sun, interesting results! You used only 1 SBN to server

[jira] [Commented] (HDFS-13522) Support observer node from Router-Based Federation

2018-05-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464214#comment-16464214 ] Chao Sun commented on HDFS-13522: - Sounds good [~elgoiri]. I'll finish

[jira] [Commented] (HDFS-13286) Add haadmin commands to transition between standby and observer

2018-05-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464312#comment-16464312 ] Chao Sun commented on HDFS-13286: - Thanks [~xkrogen] for all the help! > Add haadmin commands to

[jira] [Commented] (HDFS-13522) Support observer node from Router-Based Federation

2018-05-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463444#comment-16463444 ] Chao Sun commented on HDFS-13522: - Yes [~elgoiri] I agree that on {{RouterRpcClient}} side the

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479379#comment-16479379 ] Chao Sun commented on HDFS-13578: - [~xkrogen]: good point. I think we should recommend people to disable

[jira] [Commented] (HDFS-13600) Add toString() for RemoteMethod

2018-05-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483104#comment-16483104 ] Chao Sun commented on HDFS-13600: - Oops found out this is already resolved via HDFS-13364. > Add

[jira] [Resolved] (HDFS-13600) Add toString() for RemoteMethod

2018-05-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-13600. - Resolution: Duplicate > Add toString() for RemoteMethod > --- > >

[jira] [Created] (HDFS-13600) Add toString() for RemoteMethod

2018-05-21 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13600: --- Summary: Add toString() for RemoteMethod Key: HDFS-13600 URL: https://issues.apache.org/jira/browse/HDFS-13600 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-23 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488091#comment-16488091 ] Chao Sun commented on HDFS-13578: - Thanks [~elgoiri]. Regarding: {code} for (Method m : allMethods) {

[jira] [Work started] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-05-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12976 started by Chao Sun. --- > Introduce StandbyReadProxyProvider > -- > >

[jira] [Updated] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13578: Status: Patch Available (was: Open) > Add ReadOnly annotation to methods in ClientProtocol >

[jira] [Comment Edited] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-25 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491251#comment-16491251 ] Chao Sun edited comment on HDFS-13578 at 5/25/18 8:50 PM: -- Thanks [~xkrogen]!

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-25 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491251#comment-16491251 ] Chao Sun commented on HDFS-13578: - Thanks [~xkrogen]! 1. Regarding methods need ReadOnly, you're right, I

[jira] [Commented] (HDFS-13607) [Edit Tail Fast Path Pt 1] Enhance JournalNode with an in-memory cache of recent edit transactions

2018-05-25 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491357#comment-16491357 ] Chao Sun commented on HDFS-13607: - Thanks [~xkrogen]. The patch looks really good. I just have a few minor

[jira] [Updated] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13578: Attachment: HDFS-13578-HDFS-12943.002.patch > Add ReadOnly annotation to methods in ClientProtocol >

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489692#comment-16489692 ] Chao Sun commented on HDFS-13578: - Uploaded patch v2 to fix style issues. > Add ReadOnly annotation to

[jira] [Commented] (HDFS-13602) Optimize checkOperation(WRITE) check in FSNamesystem getBlockLocations

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489822#comment-16489822 ] Chao Sun commented on HDFS-13602: - Thanks [~xkrogen] for creating this JIRA. Submitted patch v0 to do the

[jira] [Updated] (HDFS-13602) Optimize checkOperation(WRITE) check in FSNamesystem getBlockLocations

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13602: Attachment: HDFS-13602.000.patch > Optimize checkOperation(WRITE) check in FSNamesystem getBlockLocations >

[jira] [Updated] (HDFS-13602) Optimize checkOperation(WRITE) check in FSNamesystem getBlockLocations

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13602: Status: Patch Available (was: Open) > Optimize checkOperation(WRITE) check in FSNamesystem

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489851#comment-16489851 ] Chao Sun commented on HDFS-12978: - [~shv]: bq. When SBN is applying edits it holds like four different

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489856#comment-16489856 ] Chao Sun commented on HDFS-12978: - bq. Much worse than that, when serving a segment, the JournalNode

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490207#comment-16490207 ] Chao Sun commented on HDFS-12978: - [~shv] got it, although I'm not sure how effective this would be

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489937#comment-16489937 ] Chao Sun commented on HDFS-13578: - [~elgoiri]: I see what you mean. Can this be done by adding a notice to

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489915#comment-16489915 ] Chao Sun commented on HDFS-13578: - Got it. Will make the change. bq. Not sure of the wording of XXX but

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490023#comment-16490023 ] Chao Sun commented on HDFS-13578: - OK. Uploaded patch v4 to address the comments. > Add ReadOnly

[jira] [Updated] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13578: Attachment: HDFS-13578-HDFS-12943.004.patch > Add ReadOnly annotation to methods in ClientProtocol >

[jira] [Updated] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13578: Attachment: HDFS-13578-HDFS-12943.000.patch > Add ReadOnly annotation to methods in ClientProtocol >

[jira] [Created] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-16 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13578: --- Summary: Add ReadOnly annotation to methods in ClientProtocol Key: HDFS-13578 URL: https://issues.apache.org/jira/browse/HDFS-13578 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-23 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487776#comment-16487776 ] Chao Sun commented on HDFS-13578: - Thanks [~elgoiri]: updated patch v1 with test cases. > Add ReadOnly

[jira] [Updated] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-23 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13578: Attachment: HDFS-13578-HDFS-12943.001.patch > Add ReadOnly annotation to methods in ClientProtocol >

[jira] [Commented] (HDFS-13607) [Edit Tail Fast Path Pt 1] Enhance JournalNode with an in-memory cache of recent edit transactions

2018-06-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506301#comment-16506301 ] Chao Sun commented on HDFS-13607: - +1 on the simpler design in handling the layout versions. The latest

[jira] [Updated] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Attachment: HDFS-12976-HDFS-12943.000.patch > Introduce StandbyReadProxyProvider >

[jira] [Updated] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Attachment: HDFS-12976-HDFS-12943.000.patch > Introduce StandbyReadProxyProvider >

[jira] [Updated] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Attachment: (was: HDFS-12976-HDFS-12943.000.patch) > Introduce StandbyReadProxyProvider >

[jira] [Commented] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505080#comment-16505080 ] Chao Sun commented on HDFS-12976: - Thanks [~vagarychen]! I addressed most of your comments except this

[jira] [Commented] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505088#comment-16505088 ] Chao Sun commented on HDFS-12976: - Uploaded patch v0, and stripped off the parts about configuration and

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506297#comment-16506297 ] Chao Sun commented on HDFS-12976: - Hey [~xkrogen]. Thanks for the feedback. The reason for keeping

[jira] [Updated] (HDFS-13641) Add metrics for edit log tailing

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13641: Attachment: HDFS-13641.003.patch > Add metrics for edit log tailing > - >

[jira] [Commented] (HDFS-13641) Add metrics for edit log tailing

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510668#comment-16510668 ] Chao Sun commented on HDFS-13641: - Thanks [~linyiqun]. I think the previous patch was checking metrics 

[jira] [Comment Edited] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510679#comment-16510679 ] Chao Sun edited comment on HDFS-12976 at 6/13/18 6:27 AM: -- Thanks [~shv].

[jira] [Comment Edited] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510679#comment-16510679 ] Chao Sun edited comment on HDFS-12976 at 6/13/18 6:27 AM: -- Thanks [~shv].

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Attachment: HDFS-12976-HDFS-12943.002.patch > Introduce ObserverReadProxyProvider >

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510679#comment-16510679 ] Chao Sun commented on HDFS-12976: - Thanks [~shv]. Addressed the issues (should have enabled the 

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Status: Patch Available (was: In Progress) > Introduce ObserverReadProxyProvider >

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511293#comment-16511293 ] Chao Sun commented on HDFS-12976: - Oops, my bad. Thanks [~xkrogen]! > Introduce

[jira] [Commented] (HDFS-13674) Improve documentation on Metrics

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511966#comment-16511966 ] Chao Sun commented on HDFS-13674: - Thanks [~linyiqun]! will appreciate your review :) > Improve

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511612#comment-16511612 ] Chao Sun commented on HDFS-12976: - Hmm.. there are some test failures that are related. Will fix and

[jira] [Created] (HDFS-13674) Improve documentation on Metrics

2018-06-13 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13674: --- Summary: Improve documentation on Metrics Key: HDFS-13674 URL: https://issues.apache.org/jira/browse/HDFS-13674 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514067#comment-16514067 ] Chao Sun commented on HDFS-12976: - [~xkrogen]: let me know if I misunderstood anything - if someone is

[jira] [Updated] (HDFS-13687) ConfiguredFailoverProxyProvider could direct requests to SBN

2018-06-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13687: Status: Patch Available (was: Open) > ConfiguredFailoverProxyProvider could direct requests to SBN >

[jira] [Updated] (HDFS-13687) ConfiguredFailoverProxyProvider could direct requests to SBN

2018-06-15 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13687: Attachment: HDFS-13687.000.patch > ConfiguredFailoverProxyProvider could direct requests to SBN >

[jira] [Created] (HDFS-13687) ConfiguredFailoverProxyProvider could direct requests to SBN

2018-06-15 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13687: --- Summary: ConfiguredFailoverProxyProvider could direct requests to SBN Key: HDFS-13687 URL: https://issues.apache.org/jira/browse/HDFS-13687 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13687) ConfiguredFailoverProxyProvider could direct requests to SBN

2018-06-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514963#comment-16514963 ] Chao Sun commented on HDFS-13687: - cc [~shv], [~xkrogen]. > ConfiguredFailoverProxyProvider could direct

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514962#comment-16514962 ] Chao Sun commented on HDFS-12976: - [~shv] Yes, I created HDFS-13687 to fix this. Could you take a look?

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-11 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Attachment: HDFS-12976-HDFS-12943.001.patch > Introduce ObserverReadProxyProvider >

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-11 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508426#comment-16508426 ] Chao Sun commented on HDFS-12976: - Thanks [~xkrogen], [~vagarychen] and [~shv], for the very helpful

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Summary: Introduce ObserverReadProxyProvider (was: Introduce ObeserverReadProxyProvider) > Introduce

[jira] [Updated] (HDFS-12976) Introduce ObeserverReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Summary: Introduce ObeserverReadProxyProvider (was: Introduce StandbyReadProxyProvider) > Introduce

[jira] [Commented] (HDFS-12976) Introduce StandbyReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505462#comment-16505462 ] Chao Sun commented on HDFS-12976: - Sure [~elgoiri]: I can extract this and put it in a separate JIRA. It

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-11 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508546#comment-16508546 ] Chao Sun commented on HDFS-12976: - Merged trunk into HDFS-12943 and uploaded patch v1.  > Introduce

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-14 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513349#comment-16513349 ] Chao Sun commented on HDFS-12976: - Yes that's the issue. However, if we keep the logic in

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-14 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12976: Attachment: HDFS-12976-HDFS-12943.003.patch > Introduce ObserverReadProxyProvider >

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-14 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513373#comment-16513373 ] Chao Sun commented on HDFS-12976: - Adopted [~shv]'s suggestion and attached patch v3. The

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505606#comment-16505606 ] Chao Sun commented on HDFS-12976: - Thanks. I'll create a JIRA for the refactoring. One minor issue is

[jira] [Created] (HDFS-13664) Refactor ConfiguredFailoverProxyProvider to make inheritance easier

2018-06-07 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13664: --- Summary: Refactor ConfiguredFailoverProxyProvider to make inheritance easier Key: HDFS-13664 URL: https://issues.apache.org/jira/browse/HDFS-13664 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13664) Refactor ConfiguredFailoverProxyProvider to make inheritance easier

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13664: Attachment: HDFS-13664.000.patch > Refactor ConfiguredFailoverProxyProvider to make inheritance easier >

[jira] [Updated] (HDFS-13664) Refactor ConfiguredFailoverProxyProvider to make inheritance easier

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13664: Status: Patch Available (was: Open) > Refactor ConfiguredFailoverProxyProvider to make inheritance easier

[jira] [Commented] (HDFS-13664) Refactor ConfiguredFailoverProxyProvider to make inheritance easier

2018-06-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505683#comment-16505683 ] Chao Sun commented on HDFS-13664: - Attached patch v0. cc [~elgoiri], [~shv]. > Refactor

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493910#comment-16493910 ] Chao Sun commented on HDFS-13578: - {quote}For the datanode methods, does it matter that it is marked as

[jira] [Updated] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13578: Attachment: HDFS-13578-HDFS-12943.005.patch > Add ReadOnly annotation to methods in ClientProtocol >

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494170#comment-16494170 ] Chao Sun commented on HDFS-13578: - Attached patch v5. > Add ReadOnly annotation to methods in

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494018#comment-16494018 ] Chao Sun commented on HDFS-13578: - Hmm... seems there are some other operations that are UNCHECKED and

[jira] [Commented] (HDFS-13578) Add ReadOnly annotation to methods in ClientProtocol

2018-05-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494060#comment-16494060 ] Chao Sun commented on HDFS-13578: - Got it. Sorry I got confused on the UNCHECKED annotation. Will upload

[jira] [Assigned] (HDFS-13641) Add metrics for edit log tailing

2018-05-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-13641: --- Assignee: Chao Sun Description: We should add metrics for each iteration of edit log tailing,

[jira] [Created] (HDFS-13641) Add metrics for edit log tailin

2018-05-30 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13641: --- Summary: Add metrics for edit log tailin Key: HDFS-13641 URL: https://issues.apache.org/jira/browse/HDFS-13641 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-13641) Add metrics for edit log tailing

2018-05-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13641: Status: Patch Available (was: Open) > Add metrics for edit log tailing >

[jira] [Updated] (HDFS-13641) Add metrics for edit log tailing

2018-05-30 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13641: Attachment: HDFS-13641-HDFS-12943.000.patch > Add metrics for edit log tailing >

  1   2   3   4   5   6   7   8   9   10   >