Github user tdas commented on the issue:
https://github.com/apache/spark/pull/20767
@koeninger good question Cody! I think we should fix this limitation
eventually. The only reason I am not doing that in this PR is to keep the
changes minimum for backporting to 2.3.x. Eventually, we should not do such
cache management, and rather use something like [Apache Common
Pool](https://commons.apache.org/proper/commons-pool/index.html).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
