Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21939
> We are already not testing all the combinations and at least I manually
test other combinations locally. For the minimum PyArrow upgrade for Spark
itself in the code base, wouldn't we better make it up after 2.4.0 release, and
target it 3.0.0?
Yea makes sense, since we don't have time to do the followups(like binary
type support) within Spark 2.4.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
