[jira] [Commented] (SPARK-23386) Enable direct application links before replay
[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360371#comment-16360371 ] Marcelo Vanzin commented on SPARK-23386: The umbrella you refer to is closed and only covered what the spec attached to it described. New features, bug, enhancements, etc, should not be attached to it. > Enable direct application links before replay > - > > Key: SPARK-23386 > URL: https://issues.apache.org/jira/browse/SPARK-23386 > Project: Spark > Issue Type: Improvement > Components: Deploy >Affects Versions: 2.2.1 >Reporter: Gera Shegalov >Priority: Minor > > In a deployment with multiple 10K of large event logs it may take *many > hours* until all logs are replayed. Most our users use SHS by clicking on a > link in a client log in case of an error. Direct links currently don't work > until the event log is processed in a replay thread. This Jira proposes to > link appid to the event logs already during scan, without a full replay. This > makes on-demand retrievals accessible almost immediately upon SHS start. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23386) Enable direct application links before replay
[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359831#comment-16359831 ] Apache Spark commented on SPARK-23386: -- User 'gerashegalov' has created a pull request for this issue: https://github.com/apache/spark/pull/20575 > Enable direct application links before replay > - > > Key: SPARK-23386 > URL: https://issues.apache.org/jira/browse/SPARK-23386 > Project: Spark > Issue Type: Improvement > Components: Deploy >Affects Versions: 2.2.1 >Reporter: Gera Shegalov >Priority: Major > > In a deployment with multiple 10K of large event logs it may take *many > hours* until all logs are replayed. Most our users use SHS by clicking on a > link in a client log in case of an error. Direct links currently don't work > until the event log is processed in a replay thread. This Jira proposes to > link appid to the event logs already during scan, without a full replay. This > makes on-demand retrievals accessible almost immediately upon SHS start. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org