LuciferYang commented on PR #39139: URL: https://github.com/apache/spark/pull/39139#issuecomment-1363732297
> > Should we clean up the spark.ui.store.path directory when SparkContext.stop()? Otherwise, 1.The disk space occupied by the spark.ui.store.path directory will continue to grow. 2. When submitting new App and reusing the spark.ui.store.path directory, we will see the content related to the previous App, which is a bit strange > > Good question. We can have a configuration for this one. By default, we delete the RocksDB instance. Some users may want to see the history, or the file can be used for history server. OK, let me file a new jira first to tracking this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
