Marcelo Vanzin created SPARK-2261:
-------------------------------------
Summary: Spark application event logs are not very
NameNode-friendly
Key: SPARK-2261
URL: https://issues.apache.org/jira/browse/SPARK-2261
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 1.0.0
Reporter: Marcelo Vanzin
Priority: Minor
Currently, EventLoggingListener will generate application logs using, in the
worst case, five different entries in the file system:
* The directory to hold the files
* One file for the Spark version
* One file for the event logs
* One file to identify the compression codec of the event logs
* One file to say the application is finished.
It would be better to be more friendly to the NameNodes and use a single entry
for all of those.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
