Yu Peng created SPARK-17711:
-------------------------------
Summary: Compress rolled executor logs
Key: SPARK-17711
URL: https://issues.apache.org/jira/browse/SPARK-17711
Project: Spark
Issue Type: New Feature
Reporter: Yu Peng
Currently, rolled executor logs are not compressed. If the executor produces a
lot of logs, it may consume all executor disk space and fail the task. With
this feature, executor will compress the rolled stderr/stdout like log4j to
reduce disk usage.
[~mengxr]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
