raulcd commented on PR #14715:
URL: https://github.com/apache/arrow/pull/14715#issuecomment-1327409831
> @raulcd The problem seems to be a format of `SPARK_VERSION`.
@kiszk you are correct. I got confused by the other check on the script
which seems to be wrong then:
```
if [ "${SPARK_VERSION:0:2}" == "2." ]; then
#
https://github.com/apache/spark/blob/master/docs/sql-pyspark-pandas-with-arrow.md#compatibility-setting-for-pyarrow--0150-and-spark-23x-24x
export ARROW_PRE_0_15_IPC_FORMAT=1
fi
```
I've updated to:
```
if [ "${SPARK_VERSION:1:2}" == "2." ]; then
```
even though it was not used as we don't have any nightly test for versions
lower than `3.1.2`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
