[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2019-09-24 Thread zy.jordan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936665#comment-16936665 ] zy.jordan commented on HDFS-12978: -- Hi, [~shv], it really cost too much if don't cache the edit log

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2019-07-17 Thread zy.jordan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887584#comment-16887584 ] zy.jordan commented on HDFS-12978: -- Hi, [~shv], Could you let me know which issue is involved in the

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497281#comment-16497281 ] Hudson commented on HDFS-12978: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14328 (See

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497192#comment-16497192 ] Chen Liang commented on HDFS-12978: --- Thanks [~shv] for the followup! I'm okay with optimizing this

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496137#comment-16496137 ] Konstantin Shvachko commented on HDFS-12978: Checked {{doTailEdits()}} again. Adding a loop

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493883#comment-16493883 ] Chen Liang commented on HDFS-12978: --- Thanks for the clarification [~shv]! I missed that. So in this

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491363#comment-16491363 ] Konstantin Shvachko commented on HDFS-12978: [~csun] I agree re-initializing input streams on

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-25 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491231#comment-16491231 ] Chen Liang commented on HDFS-12978: --- I read through the discussion, seems the concerns are mostly on

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490207#comment-16490207 ] Chao Sun commented on HDFS-12978: - [~shv] got it, although I'm not sure how effective this would be

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490113#comment-16490113 ] genericqa commented on HDFS-12978: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489961#comment-16489961 ] Konstantin Shvachko commented on HDFS-12978: [~csun] answering your questions. I don't want to

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489954#comment-16489954 ] Konstantin Shvachko commented on HDFS-12978: On the second thought decided to keep the

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489889#comment-16489889 ] genericqa commented on HDFS-12978: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489856#comment-16489856 ] Chao Sun commented on HDFS-12978: - bq. Much worse than that, when serving a segment, the JournalNode

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489851#comment-16489851 ] Chao Sun commented on HDFS-12978: - [~shv]: bq. When SBN is applying edits it holds like four different

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489615#comment-16489615 ] Konstantin Shvachko commented on HDFS-12978: Added {{max-txns-per-lock}} to

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488293#comment-16488293 ] Konstantin Shvachko commented on HDFS-12978: [~linyiqun] I don't think that {{Long.MAX_VALUE =

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487665#comment-16487665 ] Erik Krogen commented on HDFS-12978: When I originally went down this path (in discussions with

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486667#comment-16486667 ] genericqa commented on HDFS-12978: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12978) Fine-grained locking while consuming journal stream.

2018-05-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486627#comment-16486627 ] Yiqun Lin commented on HDFS-12978: -- Hi [~shv], I don't think {{Long.MAX_VALUE}} is a appropriate value