Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19459
I think it is a bug, we should fix it first.
BTW I'm fine to upgrade arrow, just make sure we get everything we need at
the arrow version we wanna upgrade, then remove all the hacks at Spark side. We
should throw exception if users have an old arrow version installed.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
