[
https://issues.apache.org/jira/browse/SPARK-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963509#comment-14963509
]
Ryan Williams edited comment on SPARK-11162 at 10/19/15 4:01 PM:
-----------------------------------------------------------------
In the second message (of 2 total, afaict) on the thread, "eric wong" lays out
two steps for enabling DEBUG logging; the first step involves changing a local
copy of {{log4j.properties}}, whereas the second involves passing certain
parameters to {{spark-submit}}.
I was hoping for a way to not have to modify a local {{log4j.properties}} file,
but to get debug logging by only passing parameters to {{spark-submit}}.
I suppose this issue is confusingly named since technically all of this can be
accomlished "from the command line", so I'll rename it to reflect that I'd like
a config flag to {{spark-submit}} to enable different logging levels.
Also, even modifying {{log4j.properties}} in various places and passing it to
the {{--files}} flag, I am unable to get DEBUG logging on the client in
{{yarn-client}} mode, i.e. {{--files log4j.properties}} makes all of my YARN
containers have debug logging, but I still only get INFO logging in e.g. my
{{spark-shell}} session that is running locally.
was (Author: rdub):
In the second message (of 2 total, afaict) on the thread, "eric wong" lays out
two steps for enabling DEBUG logging; the first step involves changing a local
copy of {{log4j.properties}}, whereas the second involves passing certain
parameters to {{spark-submit}}.
I was hoping for a way to not have to modify a local {{log4j.properties}} file,
but to get debug logging by only passing parameters to {{spark-submit}}.
> Allow enabling debug logging from the command line
> --------------------------------------------------
>
> Key: SPARK-11162
> URL: https://issues.apache.org/jira/browse/SPARK-11162
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.5.1
> Reporter: Ryan Williams
> Priority: Minor
>
> Per [~vanzin] on [the user
> list|http://apache-spark-user-list.1001560.n3.nabble.com/how-to-set-log-level-of-spark-executor-on-YARN-using-yarn-cluster-mode-tp16528p16529.html],
> it would be nice if debug-logging could be enabled from the command line.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
