Hi Divya,
Have you tried this command *yarn logs -applicationId
application_x_ *?
(where application_x_ is the id of the application and
may be found in the output of the 'spark-submit' command or in the
yarn's webui)
It will collect the logs from all the executors
Hi,
I have initialised the logging in my spark App
/*Initialize Logging */
val log = Logger.getLogger(getClass.getName)
Logger.getLogger("org").setLevel(Level.OFF)
Logger.getLogger("akka").setLevel(Level.OFF)
log.warn("Some text"+Somemap.size)
When I run my spark job in using spark-submit like
