Re: Local Spark talking to remote HDFS?

2015-08-25 Thread Roberto Congiu
gt;>> > >>>>> val words=sc.textFile("hdfs:///tmp/people.txt") > >>>>> words.count > >>>>> > >>>>> However if I try to access it from a local Spark app on my Windows > >>>>> host, > >>&

Re: Local Spark talking to remote HDFS?

2015-08-25 Thread Steve Loughran
ile("hdfs:///tmp/people.txt") >>>>> words.count >>>>> >>>>> However if I try to access it from a local Spark app on my Windows >>>>> host, >>>>> it >>>>> doesn't work >>>>> &

Re: Local Spark talking to remote HDFS?

2015-08-25 Thread Dino Fancellu
My App") >> >> val sc = new SparkContext(conf) >> >> >> >> val words=sc.textFile("hdfs://localhost:8020/tmp/people.txt") >> >> words.count >> >> >> >> Emits >> >> >> >> >> &g

Re: Local Spark talking to remote HDFS?

2015-08-25 Thread Roberto Congiu
ng file name, it will tell > >> me > >> > >> > >> > >> My pom has > >> > >> > >> org.apache.spark > >> spark-core_2.11 > >> 1.4.1

Re: Local Spark talking to remote HDFS?

2015-08-24 Thread Dino Fancellu
;> words.count >> >> Emits >> >> >> >> The port 8020 is open, and if I choose the wrong file name, it will tell >> me >> >> >> >> My pom has >> >> >> org.apache.spark >>

Re: Local Spark talking to remote HDFS?

2015-08-24 Thread Roberto Congiu
provided > > > Am I doing something wrong? > > Thanks. > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Local-Spark-talking-to-remote-HDFS-tp24425.html > Sent from the Apache Spark

Local Spark talking to remote HDFS?

2015-08-24 Thread Dino Fancellu
k-user-list.1001560.n3.nabble.com/Local-Spark-talking-to-remote-HDFS-tp24425.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org