Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/21939
@BryanCutler we currently test spark against only one version of pyarrow
(and against py27 and py34)..
setting things up to test against a matrix of python/pyarrow versions will
have to take place after the code freeze/2.4 release and it won't necessarily
be straightforward due to the mechanics of how the python test-running
framework is set up. see:
https://github.com/apache/spark/blob/master/python/run-tests.py
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]