Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20476
@gatorsmile, thanks for the context. If we need to redesign push-down, then
I think we should do that separately and with a design plan.
**I don't think it's a good idea to bundle it into an unrelated API
update.**
For one thing, we want to be able to use the existing tests for the
redesigned push-down strategy, not reimplement them in pieces. We also don't
want to conflate the two changes for early adopters of the new API. V2 should
be as reliable as possible by minimizing new behavior.
This just isn't the right place to test out experimental designs for
push-down operations.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
