GitHub user zhztheplayer edited a discussion: Drop Spark 3.2 support
I've heard more and more people are upgrading their Spark clusters from 3.2 to higher versions. So perhaps it's necessary for us to discuss about dropping Spark 3.2 support from our main branch. I have been auditing on the feasibility of this change because we can have chance to solve a long-existing issue https://github.com/apache/incubator-gluten/issues/540 after the migration. The issue doesn't impact the stability of Gluten but could make the columnar batch management code complex to maintain, and could slightly impact performance. There might be other bonuses so feel free to supplement here. GitHub link: https://github.com/apache/incubator-gluten/discussions/8491 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
