[
https://issues.apache.org/jira/browse/SPARK-25246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622588#comment-16622588
]
shahid commented on SPARK-25246:
--------------------------------
[~devaraj.k], Ideally when the application start, it should display in the
incomplete page of the History server UI.
In this scenario, the application will list in the HistoryServer UI, once some
events happened.
> When the spark.eventLog.compress is enabled, the Application is not showing
> in the History server UI ('incomplete application' page), initially.
> ------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-25246
> URL: https://issues.apache.org/jira/browse/SPARK-25246
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.1
> Reporter: shahid
> Priority: Major
>
> 1) bin/spark-shell --master yarn --conf "spark.eventLog.compress=true"
> 2) hdfs dfs -ls /spark-logs
> {code:java}
> -rwxrwx--- 1 root supergroup *0* 2018-08-27 03:26
> /spark-logs/application_1535313809919_0005.lz4.inprogress
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
