Teng Qiu created SPARK-12053:
--------------------------------
Summary: EventLog for completed applications always not found if
spark.eventLog.compress is true
Key: SPARK-12053
URL: https://issues.apache.org/jira/browse/SPARK-12053
Project: Spark
Issue Type: Bug
Components: Spark Core, Web UI
Affects Versions: 1.5.2
Environment: single AWS EC2 instance with Ubuntu
spark standalone mode
Reporter: Teng Qiu
EventLog for completed applications always not found with following settings:
{code}
spark.eventLog.enabled true
spark.eventLog.compress true
spark.eventLog.dir file:///tmp/spark-events
{code}
On Web UI, it shows always "No event logs found for application app-2015xxxxxxx"
but there are files under /tmp/spark-events/ , such as:
app-20151130143343-0000.snappy
app-20151130144008-0001.snappy.inprogress
app-20151130152905-0002.snappy.inprogress
app-20151130153215-0003.snappy
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
