Hi all,
The incompatible changes from different Spark 3 versions, namely spark
3.0.x, spark 3.1.x, and the latest spark 3.2, are making the spark support
difficult. I'm proposing to drop Spark 3.0.x support from the next major
release 0.11.0. Spark 3.0.x has been supported since 0.7.0 through 0.10.0.
The Spark 3 support matrix will look like
- 0.11.0
- 3.2.0 (default build), 3.1.x
- 0.10.x
- 3.1.x (default build), 3.0.x
- 0.7.0 - 0.9.0
- 3.0.x
- 0.6.0 and prior
- not supported
Thanks.
Best,
Raymond
