Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/22160#discussion_r211689639
--- Diff: pom.xml ---
@@ -2756,7 +2756,7 @@
<profile>
<id>scala-2.12</id>
<properties>
- <scala.version>2.12.6</scala.version>
+ <scala.version>2.12.4</scala.version>
--- End diff --
Since 2.12.6 removes the hacks we were using to initialize Spark context,
if we want to revert SPARK-24418, we have to use older version of 2.12.x
My 2 cents, reverting SPARK-24418 will make 2.12 work harder since we have
to deal with Scala Shell issue as part of the tasks.
Alternatively, instead of reverting SPARK-24418, we should consider to
merge https://github.com/apache/spark/pull/21749 which fixes the message
printing issue.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
