Github user TomaszGaweda commented on the issue:
https://github.com/apache/spark/pull/21360
I've tesed it with my application that had problem with predicate pushdowns
to database. Looks good, performance is degradated a bit, but it was previously
ran on Spark 2.3, not 2.4. However, memory consumption is much better as I
don't have to cache input Datasets.
LGTM From functional side. @gatorsmile @cloud-fan Could you please review
it? Thanks!
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]