Mahesh Ambule created SPARK-21711:
-------------------------------------
Summary: spark-submit command should accept log4j configuration
parameters for spark client logging.
Key: SPARK-21711
URL: https://issues.apache.org/jira/browse/SPARK-21711
Project: Spark
Issue Type: Improvement
Components: Spark Submit
Affects Versions: 2.1.0, 1.6.0
Reporter: Mahesh Ambule
Priority: Minor
Currently, log4j properties can be specified in spark 'conf' directory in
log4j.properties file.
The spark-submit command can override these log4j properties for driver and
executors logs. But it can not override log4j properties for spark and yarn
clients in yarn-cluster mode.
The user should be able to pass log4j properties for spark and yarn client
using spark-submit command.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
