Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20476
@rdblue Operator pushdown is part of the [data source API V2
SPIP](https://docs.google.com/document/d/1n_vUVbF4KD3gxTmkNEon5qdQ-Z8qU5Frf6WMQZ6jJVM/edit#):
https://issues.apache.org/jira/browse/SPARK-15689
Based on the PR review history, it sounds like you also reviewed the
proposal and the prototype. Since we are trying to finish the release of Spark
2.3, it might be too late to rewrite everything at the last minute.
When more users try it, we might get more feedbacks about this. Then, we
can have more discussion. Hopefully, in the next release, the community can get
the consensus about the design of operator push-down.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
