Patrick Wendell created SPARK-1469:
--------------------------------------
Summary: Scheduler mode should accept lower-case definitions and
have nicer error messages
Key: SPARK-1469
URL: https://issues.apache.org/jira/browse/SPARK-1469
Project: Spark
Issue Type: Bug
Components: Spark Core
Reporter: Patrick Wendell
Fix For: 1.1.0
I tried setting spark.scheduler.mode=fair and I got the following nasty
exception:
{code}
java.util.NoSuchElementException: None.get
at scala.None$.get(Option.scala:313)
at scala.None$.get(Option.scala:311)
at scala.Enumeration.withName(Enumeration.scala:132)
at
org.apache.spark.scheduler.TaskSchedulerImpl.<init>(TaskSchedulerImpl.scala:101)
at
org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:1338)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:230)
at
org.apache.spark.repl.SparkILoop.createSparkContext(SparkILoop.scala:956)
at $iwC$$iwC.<init>(<console>:8)
at $iwC.<init>(<console>:14)
at <init>(<console>:16)
at .<init>(<console>:20)
at .<clinit>(<console>)
{code}
We should do two improvements:
1. We should make the built in ones case insensitive (fair/FAIR, fifo/FIFO).
2. If an invalid mode is given we should print a better error message.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
