Marc Paller created ZEPPELIN-865:
------------------------------------
Summary: Selects wrong version of spark to run
Key: ZEPPELIN-865
URL: https://issues.apache.org/jira/browse/ZEPPELIN-865
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-interpreter
Affects Versions: 0.6.0
Environment: OS: FC20, Spark 1.6.1, hadoop 2.7.1, hbase 1.2.1
Reporter: Marc Paller
Fix For: 0.6.0
Created a new spark interpreter for a new notebook. Each time the code is
executed it works correctly and the log (zeppelin-interpreter-spark-) shows
INFO [2016-05-22 19:21:58,613] ({pool-2-thread-2}
SparkInterpreter.java[createSparkContext]:257) - ------ Create new SparkContext
spark://hadoop-master:7077 -------
INFO [2016-05-22 19:21:58,647] ({pool-2-thread-2} Logging.scala[logInfo]:58) -
Running Spark version 1.6.1
However, if I then attempt to use the original spark interpreter for another
new notebook, the log (zeppelin-interpreter-spark-) shows
INFO [2016-05-22 18:58:43,511] ({pool-2-thread-2}
SparkInterpreter.java[createSparkContext]:257) - ------ Create new SparkContext
spark://hadoop-master:7077 -------
INFO [2016-05-22 18:58:43,543] ({pool-2-thread-2} Logging.scala[logInfo]:59) -
Running Spark version 1.4.1
And it cannot connect to the spark master...
INFO [2016-05-22 18:58:45,215] ({sparkDriver-akka.actor.default-dispatcher-4}
Logging.scala[logInfo]:59) - Connecting to master
akka.tcp://sparkMaster@hadoop-master:7077/user/Master...
INFO [2016-05-22 18:59:05,241] ({sparkDriver-akka.actor.default-dispatcher-4}
Logging.scala[logInfo]:59) - Connecting to master
akka.tcp://sparkMaster@hadoop-master:7077/user/Master...
INFO [2016-05-22 18:59:25,237] ({sparkDriver-akka.actor.default-dispatcher-4}
Logging.scala[logInfo]:59) - Connecting to master
akka.tcp://sparkMaster@hadoop-master:7077/user/Master...
ERROR [2016-05-22 18:59:45,242] ({sparkDriver-akka.actor.default-dispatcher-4}
Logging.scala[logError]:75) - Application has been killed. Reason: All masters
are unresponsive! Giving up.
WARN [2016-05-22 18:59:45,243] ({pool-2-thread-2}
Logging.scala[logWarning]:71) - Application ID is not initialized yet.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
