Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21319
I'll open a PR to demonstrate what I'm proposing. It wouldn't change the
plan, it would use a reader and push-down to report stats correctly as a
temporary fix.
I'm -1 on this PR. I'll have to take a closer look if needed, but in the
first pass I see that it breaks equality by relying on a user-supplied reader
instance. The problems this addresses are still working around the fact that
the reader is carried in the logical plan, so I don't think we should make
these changes.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
