[
https://issues.apache.org/jira/browse/SPARK-25118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25118:
------------------------------------
Assignee: (was: Apache Spark)
> Need a solution to persist Spark application console outputs when running in
> shell/yarn client mode
> ---------------------------------------------------------------------------------------------------
>
> Key: SPARK-25118
> URL: https://issues.apache.org/jira/browse/SPARK-25118
> Project: Spark
> Issue Type: Improvement
> Components: Spark Submit
> Affects Versions: 2.0.0, 2.1.0, 2.2.0, 2.3.0
> Reporter: Ankur Gupta
> Priority: Major
>
> We execute Spark applications in YARN Client mode a lot of time. When we do
> so the Spark Driver logs are printed to the console.
> We need a solution to persist the console outputs for later usage. This can
> be either for doing some troubleshooting or for some another log analysis.
> Ideally, we would like to persist these along with Yarn logs (when
> application is run in Yarn Client mode). Also, this has to be end-user
> agnostic, so that the logs are available for later usage without requiring
> the end-user to make some configuration changes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
