BryanCutler edited a comment on issue #24298: [SPARK-27276][PYTHON][SQL] Increase minimum version of pyarrow to 0.12.1 and remove prior workarounds URL: https://github.com/apache/spark/pull/24298#issuecomment-480388163 @shaneknapp are you going to leave Pandas at version 0.19.2 or is that being upgraded as well for the python 3.6 env? Since pyarrow 0.12.1 requires numpy >= 1.14, I'm not sure if older versions of Pandas will work Conda doesn't like it, maybe have to manually override ``` UnsatisfiableError: The following specifications were found to be in conflict: - pandas=0.19.2 - pyarrow=0.12.1 -> arrow-cpp[version='>=0.12.1,<0.13.0a0,>=0.12.1,<1.0a0'] -> numpy[version='>=1.14,<2.0a0'] -> numpy-base==1.16.2=py36hde5b4d6_0 ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
