Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20476
https://github.com/apache/spark/pull/19424 is the original PR that
introduced the new rule `PushDownOperatorsToDataSource`. Both of us reviewed
it. : )
Thank you for your understanding! We can have more design discussion in the
next few months when you tried the new data source APIs. The code quality is
always critical for Spark. We are trying to add more test cases to ensure the
codes are stable and well-tested, even if we introduced new APIs.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
