Yongjia Wang created SPARK-11354:
------------------------------------
Summary: Expose custom log4j to executor page in Spark standalone
cluster
Key: SPARK-11354
URL: https://issues.apache.org/jira/browse/SPARK-11354
Project: Spark
Issue Type: Improvement
Components: Web UI
Reporter: Yongjia Wang
Spark use log4j, which is very flexible. However, on the executor page in
standalone cluster, only stdout and stderr are shown in the UI. In the default
log4j profile, all messages are forwarded to System.err which is in turned
written to the file stderr in executor directory. Similarly, stdout is written
to the stdout file in executor directory.
It would be very useful to show all the file appenders configured in a custom
log4j profile. Right now, these file appenders are written to the executor
directory, but they are not exposed to the UI.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
