[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622588#comment-16622588
]
shahid edited comment on SPARK-25246 at 9/20/18 7:35 PM:
---------------------------------------------------------
[~devaraj.k], Ideally when the application start, it should display in the
incomplete page of the History server UI.
In this scenario, the application will list in the HistoryServer UI, only after
some events happened.
was (Author: shahid):
[~devaraj.k], Ideally when the application start, it should display in the
incomplete page of the History server UI.
In this scenario, the application will list in the HistoryServer UI, once some
events happened.
> When the spark.eventLog.compress is enabled, the Application is not showing
> in the History server UI ('incomplete application' page), initially.
> ------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-25246
> URL: https://issues.apache.org/jira/browse/SPARK-25246
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.1
> Reporter: shahid
> Priority: Major
>
> 1) bin/spark-shell --master yarn --conf "spark.eventLog.compress=true"
> 2) hdfs dfs -ls /spark-logs
> {code:java}
> -rwxrwx--- 1 root supergroup *0* 2018-08-27 03:26
> /spark-logs/application_1535313809919_0005.lz4.inprogress
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
