DaveDeCaprio commented on issue #24028: [SPARK-26917][SQL] Further reduce locks in CacheManager URL: https://github.com/apache/spark/pull/24028#issuecomment-471674845 In response to @cloud-fan I updated this PR to stored the cached data in a scala immutable IndexedSeq. As a result of this, there is no longer a need for read locks at all. cachedData is changed to a var and all we need is a write lock for things that want to update the var. From a code clarity perspective I think this solution is cleaner. In addition to removing read locks, it removes several java to scala collection conversions.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
