[jira] [Commented] (SPARK-29043) [History Server]Only one replay thread of FsHistoryProvider work because of straggler

2019-09-15 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929939#comment-16929939 ] feiwang commented on SPARK-29043: - Thanks, [~kabhwan]. > [History Server]Only one repl

[jira] [Commented] (SPARK-29043) [History Server]Only one replay thread of FsHistoryProvider work because of straggler

2019-09-11 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927533#comment-16927533 ] Jungtaek Lim commented on SPARK-29043: -- 5+! I'm very surprised to hear that, as

[jira] [Commented] (SPARK-29043) [History Server]Only one replay thread of FsHistoryProvider work because of straggler

2019-09-11 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927402#comment-16927402 ] feiwang commented on SPARK-29043: - * How long "spark.history.fs.update.interval" has bee

[jira] [Commented] (SPARK-29043) [History Server]Only one replay thread of FsHistoryProvider work because of straggler

2019-09-11 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927345#comment-16927345 ] Jungtaek Lim commented on SPARK-29043: -- Hmm... it would be better for us if you can

[jira] [Commented] (SPARK-29043) [History Server]Only one replay thread of FsHistoryProvider work because of straggler

2019-09-11 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927305#comment-16927305 ] feiwang commented on SPARK-29043: - [~kabhwan] yes, Other replay threads are waiting for

[jira] [Commented] (SPARK-29043) [History Server]Only one replay thread of FsHistoryProvider work because of straggler

2019-09-10 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927205#comment-16927205 ] Jungtaek Lim commented on SPARK-29043: -- It's asynchronous for replaying logs: it's

[jira] [Commented] (SPARK-29043) [History Server]Only one replay thread of FsHistoryProvider work because of straggler

2019-09-10 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927198#comment-16927198 ] feiwang commented on SPARK-29043: - I think we can change it to Asynchronous. > [Histor