Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?

[Sean Owen]

See the pom.xml file
https://github.com/apache/spark/blob/master/pom.xml#L3590
2.13.8 at the moment; IIRC there was some Scala issue that prevented
updating to 2.13.9. Search issues/PRs.

On Tue, Oct 11, 2022 at 6:11 PM Henrik Park  wrote:

> scala 2.13.9 was released. do you know which spark version would have it
> built-in?
>
> thanks
>
> Sean Owen wrote:
> > I would imagine that Scala 2.12 support goes away, and Scala 3 support
> > is added, for maybe Spark 4.0, and maybe that happens in a year or so.
>
> --
> Simple Mail
> https://simplemail.co.in/
>
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>
>

Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?

[Henrik Park]

scala 2.13.9 was released. do you know which spark version would have it 
built-in?


thanks

Sean Owen wrote:
I would imagine that Scala 2.12 support goes away, and Scala 3 support 
is added, for maybe Spark 4.0, and maybe that happens in a year or so.


--
Simple Mail
https://simplemail.co.in/

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?

[Sean Owen]

For Spark, the issue is maintaining simultaneous support for multiple Scala
versions, which has historically been mutually incompatible across minor
versions.
Until Scala 2.12 support is reasonable to remove, it's hard to also support
Scala 3, as it would mean maintaining three versions of code.
I would imagine that Scala 2.12 support goes away, and Scala 3 support is
added, for maybe Spark 4.0, and maybe that happens in a year or so.

For end users, I don't think there are big differences, so I don't think
learning one or the other matters a lot. Scala 3 is a lot like 2.13.
But I don't think you'll be able to write Scala 3 Spark apps anytime soon.

On Tue, Oct 11, 2022 at 7:57 AM Никита Романов 
wrote:

> No one knows for sure except Apache, but I’d learn Scala 2 if I were you.
> Even if Spark one day migrates to Scala 3 (which is not given), it’ll take
> a while for the industry to adjust. It even takes a while to move from
> Spark 2 to Spark 3 (Scala 2.11 to Scala 2.12). I don’t think your knowledge
> of Scala 2 will be outdated any time soon.
>
> You can also compare it with Python 2 vs 3: although Python 3 dominates
> these days (almost 15 years after the release!), Python 2 is still used.
>
>
> Понедельник, 10 октября 2022, 10:24 +03:00 от Oliver Plohmann <
> oli...@objectscape.org >:
>
> Hello,
>
> I was lucky and will be joining a project where Spark is being used in
> conjunction with Python. Scala will not be used at all. Everything will
> be Python. This means that I have free choice whether to start diving
> into Scala 2 or Scala 3. For future Spark jobs knowledge of Scala will
> be very precious (the job ads here for Spark always mention Java, Python
> and Scala.
>
> I was always interested in Scala and because it is a plus when applying
> for Spark jobs I will start learning and develop some spare time project
> with it. Question is now whether first to learn Scala 2 or start right
> away with learning Scala 3. That also boils down to the question whether
> Spark will ever be migrated to Scala 3. I have way too little
> understanding of Spark and Scala to be able to make some reasonable
> guess here.
>
> So that's why I'm asking here: Does anyone have some idea whether Spark
> will ever be migrated toScala 3 or have some idea how long it will take
> till any migration work might be started?
>
> Thank you.
>
>
> -
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>
>
>
>
>
>
> --
>
> --
> Никита Романов
> Отправлено из Почты Mail.ru 
>

Re: As a Scala newbie starting to work with Spark does it make more sense to learn Scala 2 or Scala 3?

[Никита Романов]

No one knows for sure except Apache, but I’d learn Scala 2 if I were you. Even 
if Spark one day migrates to Scala 3 (which is not given), it’ll take a while 
for the industry to adjust. It even takes a while to move from Spark 2 to Spark 
3 (Scala 2.11 to Scala 2.12). I don’t think your knowledge of Scala 2 will be 
outdated any time soon.
 
You can also compare it with Python 2 vs 3: although Python 3 dominates these 
days (almost 15 years after the release!), Python 2 is still used. 
  
>Понедельник, 10 октября 2022, 10:24 +03:00 от Oliver Plohmann < 
>oli...@objectscape.org >:
> 
>Hello,
>
>I was lucky and will be joining a project where Spark is being used in
>conjunction with Python. Scala will not be used at all. Everything will
>be Python. This means that I have free choice whether to start diving
>into Scala 2 or Scala 3. For future Spark jobs knowledge of Scala will
>be very precious (the job ads here for Spark always mention Java, Python
>and Scala.
>
>I was always interested in Scala and because it is a plus when applying
>for Spark jobs I will start learning and develop some spare time project
>with it. Question is now whether first to learn Scala 2 or start right
>away with learning Scala 3. That also boils down to the question whether
>Spark will ever be migrated to Scala 3. I have way too little
>understanding of Spark and Scala to be able to make some reasonable
>guess here.
>
>So that's why I'm asking here: Does anyone have some idea whether Spark
>will ever be migrated toScala 3 or have some idea how long it will take
>till any migration work might be started?
>
>Thank you.
>
>
>-
>To unsubscribe e-mail:  user-unsubscr...@spark.apache.org 
 
   
 
--

--
Никита Романов
Отправлено из Почты  Mail.ru