Re: Connect Exception Error in spark interactive shell...

The data may be spilled off to disk hence HDFS is a necessity for Spark. You can run Spark on a single machine & not use HDFS but in distributed mode HDFS will be required. Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On

Re: Connect Exception Error in spark interactive shell...

Mayur, While reading a local file which is not in HDFS through spark shell, does the HDFS need to be up and running ??? On Tue, Mar 18, 2014 at 9:46 PM, Mayur Rustagi wrote: > Your hdfs is down. Probably forgot to format namenode. > check if namenode is running >ps -aef|grep Namenode > if n

Re: Connect Exception Error in spark interactive shell...

Your hdfs is down. Probably forgot to format namenode. check if namenode is running ps -aef|grep Namenode if not & data in hdfs is not critical hadoop namenode -format & restart hdfs Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi

Re: Connect Exception Error in spark interactive shell...

Not sure whether this is related to https://github.com/amplab/docker-scripts/issues/24 On Tue, Mar 18, 2014 at 3:29 PM, Sai Prasanna wrote: > Hi ALL !! > > In the interactive spark shell i get the following error. > I just followed the steps of the video "First steps with spark - spark > screen

Connect Exception Error in spark interactive shell...

Hi ALL !! In the interactive spark shell i get the following error. I just followed the steps of the video "First steps with spark - spark screen cast #1" by andy konwinski... Any thoughts ??? scala> val textfile = sc.textFile("README.md") textfile: org.apache.spark.rdd.RDD[String] = MappedRDD[1