Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/20465
Looking back at when pyarrow was last upgraded in #19884, pandas and
pyarrow were upgraded on all workers for python 3, but there were maybe some
concerns or difficulties with upgrading for python 2 and pypy environments at
that time. That is why the above failure is from python 2 with an older version
of pandas.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
