please see: https://issues.apache.org/jira/browse/SPARK-25079
this is holding back the arrow 0.10.0 upgrade. i'm fairly certain that things won't break w/this bump, and it shouldn't impact the 2.4 cut and code freeze, but i'd like to have some pyspark folks chime in. thanks in advance, shane -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu