We are in the process of upgrading pyarrow in the testing environment, which might cause pyspark test failures until https://github.com/apache/spark/pull/26133 is merged. Apologies for the lack of notice beforehand, but I jumped the gun a little and forgot this would affect other builds too. The PR for the upgrade is all ready to go and *should* pass current tests. I'll keep an eye on it and try to get it resolved tonight. If it becomes a problem, we can try to downgrade pyarrow to where it was.
Thanks, Bryan