deshanxiao commented on issue #23486: [SPARK-26457] Show hadoop configurations in HistoryServer environment tab URL: https://github.com/apache/spark/pull/23486#issuecomment-452541591 @planga82 For yarn application, it will be convenient because we don't need to see hadoop configurations in two sides. I used to meet with a case where users set "fs.impl.disable.cache"=true caused out of memory when they list so many hdfs files. It will not be shown in spark properties if they just set it in hadoop configuration files.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
