[
https://issues.apache.org/jira/browse/SPARK-20161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated SPARK-20161:
---------------------------------
Description: The default log4j file in
{{spark/conf/log4j.properties.template}} doesn't display the thread-id when
printing out the logs. It would be very useful to add this, especially for
YARN. Currently, logs from all the different threads in a single executor are
sent to the same log file. This makes debugging difficult as it is hard to
filter out what logs come from what thread.
> Default spark/conf/log4j.properties.template should print thread-id in
> ConversionPattern
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-20161
> URL: https://issues.apache.org/jira/browse/SPARK-20161
> Project: Spark
> Issue Type: Improvement
> Components: Deploy, YARN
> Affects Versions: 2.1.0
> Reporter: Sahil Takiar
>
> The default log4j file in {{spark/conf/log4j.properties.template}} doesn't
> display the thread-id when printing out the logs. It would be very useful to
> add this, especially for YARN. Currently, logs from all the different threads
> in a single executor are sent to the same log file. This makes debugging
> difficult as it is hard to filter out what logs come from what thread.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
