set spark.logConf as true in spark-default.conf will log the property in driver side. But it would only log the property you set, not including the properties with default value.
On Mon, Dec 28, 2015 at 8:18 PM, alvarobrandon <alvarobran...@gmail.com> wrote: > Hello: > > I was wondering if its possible to log properties from Spark Applications > like spark.yarn.am.memory, spark.driver.cores, > spark.reducer.maxSizeInFlight > without having to access the SparkConf object programmatically. I'm trying > to find some kind of log file that has traces of the execution of Spark > apps > and its parameters. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Is-there-anyway-to-log-properties-from-a-Spark-application-tp25820.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Best Regards Jeff Zhang
