zhli1142015 commented on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-641744773
> could you describe an end-to-end use case that can reproduce the error page in PR description? Does it only happen when leveldb is evicted or UI server is Sure, for our cases, we host many big event files (>200, average level db size is 60~70 Mb) in history server, so when we switch pages for different applications , it would trigger `HistoryServerDiskManager` ro release disk space. then error happened. For reproducing in dev machine, you can specify below configuration and run HS with two applications, and open the first application job page, then open the second one. spark.history.retainedApplications 1 spark.history.store.maxDiskUsage 10k spark.history.store.path d://cache ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
