Jacek Laskowski created SPARK-11859:
---------------------------------------
Summary: Regex for master URL for Mesos accepts incorrect zk://
prefix
Key: SPARK-11859
URL: https://issues.apache.org/jira/browse/SPARK-11859
Project: Spark
Issue Type: Bug
Components: Mesos
Affects Versions: 1.6.0
Environment: the latest sources
Reporter: Jacek Laskowski
Priority: Minor
{{val MESOS_REGEX = """(mesos|zk)://.*""".r}} (see
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L2748)
accepts "zk://..." as the master URL for Mesos.
{code}
scala> val MESOS_REGEX = """(mesos|zk)://.*""".r
MESOS_REGEX: scala.util.matching.Regex = (mesos|zk)://.*
scala> "zk://aaa" match { case mesosUrl @ MESOS_REGEX(_) => println(mesosUrl) }
zk://aaa
{code}
However, {{zk://localhost:5050}} master URL breaks spark-shell:
{code}
➜ spark git:(master) ✗ ./bin/spark-shell --master zk://localhost:5050
Error: Master must start with yarn, spark, mesos, or local
Run with --help for usage help or --verbose for debug output
{code}
It should probably be {{mesos://zk://localhost:5050}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
