Никита Соколов created SPARK-50073:
--------------------------------------

             Summary: Intended way of using log4j plugins
                 Key: SPARK-50073
                 URL: https://issues.apache.org/jira/browse/SPARK-50073
             Project: Spark
          Issue Type: Question
          Components: Documentation
    Affects Versions: 3.5.3
            Reporter: Никита Соколов


I want to use a log4j plugin, which would append the logs of Master JVM using 
classes from some 3rd party JARs:
[https://logging.apache.org/log4j/2.x/manual/plugins.html|https://logging.apache.org/log4j/2.x/manual/plugins.html#plugin-discovery]

The Spark configuration documentation says that I should configure the log4j 
via conf/log4j2.properties.
[https://spark.apache.org/docs/latest/configuration.html#configuring-logging]

This would require me to add my JARs on the class-path of Master, but it is not 
customizable and always is $SPARK_HOME/jars:

[https://github.com/apache/spark/blob/master/bin/spark-class#L71]

Is it intended to add such JARs to the $SPARK_HOME/jars?

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to