Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18664
Yup, I admit there could be some exceptions (there have been actually) but
that should still be the baseline we should basically pursue. Probably, we
could treat this Arrow optimisation as an evolving configuration option for now
due to those differences but the final goal should be the matched behaviour.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]