shaohk opened a new pull request #25494: [SPARK-28655] [patch] Support to cut the event log, and solve the history server was too slow when event log is too large. URL: https://github.com/apache/spark/pull/25494 …slow when open the application and event log is too large, and add event log split with the config spark.eventLog.cuttype ### What changes were proposed in this pull request? Support to cut the event log, and solve the history server was too slow when event log is too large. When the cuttype is configed, the EventLoggingListener will check the logpath, if the logpath is changed, the eventlog writer will be created when all jobs are end. And there is a write/read lock to ensure the multiprocess safe. ### Why are the changes needed? When the eventlog is very large, the history server will be oom. ### How was this patch tested? manual tests  
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
