Yup I think buidling consensus on what goes in 4.X is something we’ll need to do.
On Mon, Jun 12, 2023 at 11:56 AM Dongjoon Hyun <dongjoon.h...@gmail.com> wrote: > Thank you for sharing those. I'm also interested in taking advantage of > it. Also, I hope `spark-upgrade` can help us in line with Spark 4.0. > > However, we don't need to discuss any of this if we don't build a > consensus on both Spark 4.0 or next Scala version. > > We don't have a vehicle at all to reach there yet. > > In the community, I saw a bottleneck; "No in 3.x era" and "No for 4.0 yet > because XXX" > > Dongjoon. > > -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau