Re: Moving to Spark 3x from Spark2

2022-09-01 Thread Martin Andersson
You should check the release notes and upgrade instructions. From: rajat kumar Sent: Thursday, September 1, 2022 12:44 To: user @spark Subject: Moving to Spark 3x from Spark2 EXTERNAL SENDER. Do not click links or open attachments unless you recognize

Re: Moving to Spark 3x from Spark2

2022-09-01 Thread Khalid Mammadov
Hi Rajat There were a lot of changes between those versions and the only possible option to assess impact to do your testings unfortunately. Most probably you will have to do some changes to your codebase. Regards Khalid On Thu, 1 Sept 2022, 11:45 rajat kumar, wrote: > Hello Members, > > We

Moving to Spark 3x from Spark2

2022-09-01 Thread rajat kumar
Hello Members, We want to move to Spark 3 from Spark2.4 . Are there any changes we need to do at code level which can break the existing code? Will it work by simply changing the version of spark & scala ? Regards Rajat